github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-02-17 18:11:49 -05:00
Code Issues Packages Projects Releases Wiki Activity

Refactor nn.optim (#1091)

Browse Source 
* Refactor: nn.optim.py

* Refactor: nn.optim.py; Fix all tests

* Refactor: Replace all optim.get_parameters()

* Refactor: Revert list comp.

* Refactor: Replace optim.get_state_dict

* Refactor: Change quickstart.md
This commit is contained in:
Reza Rezvan
2023-07-03 00:07:30 +02:00
committed by GitHub
parent 10f1aeb144
commit 8ae9a054ae
15 changed files with 44 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
tinygrad/nn/optim.py
View File

@@ -67,7 +67,3 @@ class LAMB(Optimizer):
r = 1.0
t.assign(t.detach() - self.lr * r * up)
self.realize([self.t] + self.m + self.v)
# TODO: remove this
from tinygrad.state import get_state_dict, get_parameters # pylint: disable=unused-import # noqa: F401