Files
tinygrad/test
chenyu 5ae252ae83 use at least float32 for optim.lr (#4297)
* use at least float32 for optim.lr

when doing mixed precision training (float32 weight, default_float=half), still use float32 to store lr.
it would have been upcasted later in actual weight update, but would have lost precision.
this improved resnet convergence significantly

* undo type annotation
2024-04-25 14:42:28 -04:00
..
2024-04-23 16:28:14 -04:00
2024-03-14 13:34:14 -07:00
2024-04-16 11:48:43 +04:00
2023-12-01 11:34:47 -08:00
2020-12-15 23:44:08 -08:00
2023-06-25 10:38:58 -07:00
2024-04-11 08:24:57 -07:00
2024-04-12 22:32:16 -07:00
2024-04-04 17:38:19 -04:00
2024-03-18 16:47:07 -04:00
2024-03-26 21:02:46 -07:00
2023-12-07 17:07:05 -08:00
2024-04-02 11:38:21 -04:00
2024-04-09 13:47:25 -07:00
2024-03-06 13:34:21 -08:00
2024-03-12 09:49:47 -07:00
2024-03-26 21:02:46 -07:00