mirror of
https://github.com/tinygrad/tinygrad.git
synced 2026-01-09 15:08:02 -05:00
b2c3a28a5e
the norm itself has no significant value to add to Tensor method, but we would want Tensor.normalize
722 B
722 B
Neural Network classes
::: tinygrad.nn.BatchNorm2d ::: tinygrad.nn.Conv1d ::: tinygrad.nn.Conv2d ::: tinygrad.nn.ConvTranspose1d ::: tinygrad.nn.ConvTranspose2d ::: tinygrad.nn.Linear ::: tinygrad.nn.GroupNorm ::: tinygrad.nn.InstanceNorm ::: tinygrad.nn.LayerNorm ::: tinygrad.nn.LayerNorm2d ::: tinygrad.nn.RMSNorm ::: tinygrad.nn.Embedding
Optimizers
::: tinygrad.nn.optim.SGD ::: tinygrad.nn.optim.LARS ::: tinygrad.nn.optim.AdamW ::: tinygrad.nn.optim.Adam ::: tinygrad.nn.optim.LAMB
Load/Save
::: tinygrad.nn.state.safe_load ::: tinygrad.nn.state.safe_save ::: tinygrad.nn.state.get_state_dict ::: tinygrad.nn.state.get_parameters ::: tinygrad.nn.state.load_state_dict ::: tinygrad.nn.state.torch_load