add support for adam

This commit is contained in:
George Hotz
2020-10-18 13:50:23 -07:00
parent 55f9db8af6
commit 26ce2d93c3
3 changed files with 33 additions and 6 deletions

View File

@@ -40,5 +40,4 @@ print(y.grad) # dz/dy
* Implement gradcheck (numeric)
* Implement convolutions
* Implement Adam optimizer