tinygrad/docs/nn.md at 6a0ed46b1c7cad4ec4bd411e1fa359a1bd9001b0

mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-09 15:08:02 -05:00

Files

George Hotz 64563abc90 add LSTMCell to nn (#6080 )

* add LSTMCell to nn

* lstmcell works with no input on first

* fix no bias 0

* simpler

2024-08-14 12:08:42 -07:00

745 B

Raw Blame History

Neural Network classes

::: tinygrad.nn.BatchNorm ::: tinygrad.nn.Conv1d ::: tinygrad.nn.Conv2d ::: tinygrad.nn.ConvTranspose1d ::: tinygrad.nn.ConvTranspose2d ::: tinygrad.nn.Linear ::: tinygrad.nn.GroupNorm ::: tinygrad.nn.InstanceNorm ::: tinygrad.nn.LayerNorm ::: tinygrad.nn.LayerNorm2d ::: tinygrad.nn.RMSNorm ::: tinygrad.nn.Embedding ::: tinygrad.nn.LSTMCell

Optimizers

::: tinygrad.nn.optim.SGD ::: tinygrad.nn.optim.LARS ::: tinygrad.nn.optim.AdamW ::: tinygrad.nn.optim.Adam ::: tinygrad.nn.optim.LAMB

Load/Save

::: tinygrad.nn.state.safe_load ::: tinygrad.nn.state.safe_save ::: tinygrad.nn.state.get_state_dict ::: tinygrad.nn.state.get_parameters ::: tinygrad.nn.state.load_state_dict ::: tinygrad.nn.state.torch_load

745 B Raw Blame History

Neural Network classes

Optimizers

Load/Save

745 B

Raw Blame History