4847 Commits

Author SHA1 Message Date
George Hotz
f8311f5ecd print fp/bp mnist 2020-10-25 15:08:18 -07:00
George Hotz
5c179d18ad add profiling for mnist net 2020-10-25 14:20:55 -07:00
George Hotz
8fcada8071 faster and better convnet 2020-10-25 13:48:44 -07:00
George Hotz
96f9cdb8a0 woah, fastconv is wrong 2020-10-25 12:56:42 -07:00
George Hotz
bb98cdfef7 improve conv testing 2020-10-25 12:46:04 -07:00
George Hotz
ef24aac09e finally, fast convs 2020-10-25 12:39:44 -07:00
George Hotz
67506eb6ba fast im2col 2020-10-25 11:49:35 -07:00
George Hotz
c9968756d1 allow the line profiler to work 2020-10-25 11:13:40 -07:00
George Hotz
5062c2c8ff profile conv better 2020-10-25 11:11:00 -07:00
George Hotz
c74764bac3 oops, set to None 2020-10-25 08:28:18 -07:00
George Hotz
935f5ddaaa always keep batch size out front 2020-10-25 08:14:07 -07:00
George Hotz
b91fd3afad maxpool 2020-10-25 07:43:34 -07:00
George Hotz
5216a1d9f3 refactor into tensor and ops 2020-10-23 10:34:21 -07:00
George Hotz
9b9e47f369 added conv profile test 2020-10-23 09:46:10 -07:00
George Hotz
5756115e57 anyone else let down by the fast conv? 2020-10-23 09:09:29 -07:00
George Hotz
bcb60e0b7c wow, you have to name them test 2020-10-23 06:33:18 -07:00
George Hotz
2259c9faa1 low lr improves rmsprop 2020-10-23 06:22:32 -07:00
George Hotz
eda29fa0e0 clean up test 2020-10-23 06:11:38 -07:00
George Hotz
373b4e341b Merge pull request #15 from f0ti/master
added RMSprop optim
2020-10-23 06:08:20 -07:00
f0ti
0b87aaca1e update rsmprop 2020-10-23 14:46:45 +02:00
f0ti
c5f726ec2e all three 2020-10-23 11:53:01 +02:00
f0ti
6a38ccb6b0 update rmsprop and readme 2020-10-23 11:49:43 +02:00
George Hotz
21ebb0b769 if you wait 24 seconds, that gets 98% 2020-10-22 21:49:14 -07:00
George Hotz
816f648161 chans doesn't need to be in self 2020-10-22 21:19:35 -07:00
George Hotz
77251cc6c3 7x7 conv = more accuracy 2020-10-22 21:10:27 -07:00
f0ti
7e1eddb0c5 added RMSprop optim 2020-10-23 02:50:02 +02:00
0xNaN
d95adbddb4 gradcheck now returns only a bool, refactoring of test_gradcheck 2020-10-22 01:28:52 +02:00
0xNaN
adbfc67456 test jacobian and numerical_jacobian against torch.autograd.functional.jacobian 2020-10-22 01:28:52 +02:00
0xNaN
1561d3b9c0 extracting jacobian and test_jacobian 2020-10-22 01:28:52 +02:00
0xNaN
93bc3c22a0 tiny gradcheck 2020-10-22 01:28:52 +02:00
Adrian Garcia Badaracco
9a8be135a7 incorporate changes 2020-10-21 13:21:44 -05:00
Adrian Garcia Badaracco
02adb0ac3a Make test_mnist runnable by pytest and directly 2020-10-21 11:30:08 -05:00
Adrian Garcia Badaracco
5afe6b1f68 rename files 2020-10-21 11:28:03 -05:00
George Hotz
d91902948b add reshape support and OMG the CONVS are SO SLOW 2020-10-21 09:12:19 -07:00
George Hotz
e3110c9922 backward pass for conv2d, lol i mostly guessed and made shapes match 2020-10-21 08:45:35 -07:00
George Hotz
5c2ac48c11 write forward pass for convolution 2020-10-19 09:33:06 -07:00
George Hotz
2681c79bc5 simple tests, repr not str 2020-10-18 14:55:20 -07:00
George Hotz
4019c38942 more readme 2020-10-18 14:38:20 -07:00
George Hotz
cc9054e3ec refactor into utils 2020-10-18 14:36:29 -07:00
George Hotz
0c3dd12b3b i hate tabs 2020-10-18 14:33:13 -07:00
George Hotz
a139f34bb6 fix nll loss in example 2020-10-18 14:27:54 -07:00
George Hotz
26ce2d93c3 add support for adam 2020-10-18 13:50:23 -07:00
George Hotz
6532233d24 refactor better 2020-10-18 13:33:02 -07:00
George Hotz
92fd23df66 refactor into a few files 2020-10-18 13:30:25 -07:00
George Hotz
118c2eebe3 write sgd class 2020-10-18 13:27:59 -07:00
George Hotz
54eafe6c12 update readme 2020-10-18 13:08:14 -07:00
George Hotz
83417d4b4c readme and dirs 2020-10-18 12:48:17 -07:00