github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-22 13:28:06 -05:00
Code Issues Packages Projects Releases Wiki Activity
10,417 Commits 205 Branches 14 Tags
reprocess_node_experiments
Commit Graph

4433 Commits

Author SHA1 Message Date
George Hotz
fbff6ab2e5 fix strided convs, GPU env var for enet 2020-11-07 10:26:37 -08:00
George Hotz
ec03eb44bd tinygrad does forward pass convs on GPU 2020-11-07 10:15:56 -08:00
George Hotz
bc7758cc5b getting convs to work on gpu 2020-11-07 09:17:57 -08:00
George Hotz
3302286e68 yayay test_sgd_gpu passes 2020-11-07 08:48:17 -08:00
George Hotz
38e112cccd logsoftmax test 2020-11-07 07:26:53 -08:00
Rene Delgado
cd54697fd8 fix gpu sum forward (#61) 
* ignore venv

* add sum test

* fix sum forward
 2020-11-05 21:59:16 -08:00
NeuralLink
cc605da36d Stable Sigmoid op (#59) 
* 🔨 Added stable sigmoid

* ✅ added sigmoid test

* 🔧 suppressed overflow warning

* 🔧 clean up
 2020-11-05 21:57:50 -08:00
George Hotz
f178d23ff3 gpu relu is good 2020-11-02 08:25:32 -08:00
George Hotz
231c1134bd cute trick for GPU test 2020-11-02 08:17:17 -08:00
George Hotz
5201a8e89f matmul on GPU 2020-11-01 08:54:20 -08:00
George Hotz
41e7d59aed test dot 2020-11-01 07:51:35 -08:00
George Hotz
1f544d6ece test mnist on GPU 2020-11-01 07:46:17 -08:00
George Hotz
9ac1ad40d6 Add GPU Support! (do not merge yet) (#41) 
* copy tensors to and from gpu

* add on GPU

* adding works

* we stick shapes in

* works on cpu and gpu

* test changes, not passing yet

* something else

* op tests pass

* add, mean, and sum have working forward/backward

* mul ops test

* no gpu support, no problem

* test pass, clean up later

* gpu cleanup

* cleanup test ops, don't let div fail

* revert more

* aimpler dispatcher

* clean up grad

* GPU and

* grad is a Tensor now

* gate test on GPU

* cleanups

* late loading gpu

* GPU as input option

* last cleanups
 2020-11-01 07:00:49 -08:00
George Hotz
2c7e75d733 group conv: forward pass works (#34) 
* forward pass works

* got the backward pass

* okay, it's now a coho
 2020-10-30 09:19:20 -07:00
George Hotz
339a35b081 div needs help 2020-10-30 08:32:16 -07:00
George Hotz
c14473f87d unit test for batchnorm2d 2020-10-30 08:19:58 -07:00
George Hotz
5e7e359706 fix tests 2020-10-29 08:19:07 -07:00
George Hotz
9ae3e9daf3 shape has to be a kwarg now, idk why this didn't break before 2020-10-29 08:13:05 -07:00
George Hotz
f84f6c1edd write sqrt and div using pow 2020-10-29 07:57:25 -07:00
Göktuğ Karakaşlı
4b163ee270 efficient version of adam (#20) 
* counteracted bias initialization

* test new adam

* add optimizer tests

* rename helper function names to fix the test

* remove redundant import
 2020-10-27 15:54:40 -07:00
George Hotz
f9788eba14 parameters, and start on efficientnet 2020-10-27 08:53:35 -07:00
George Hotz
1654008c1f conv stride support 2020-10-26 08:54:43 -07:00
George Hotz
2a55d7402b clean up ops, refactor pool backward. add stride test 2020-10-26 08:47:11 -07:00
George Hotz
93dceb4bee fix kernel_size bug, name like torch, add test 2020-10-26 08:38:53 -07:00
Timothy Mc Alister
15e5988323 make default parameters work for functions 2020-10-26 12:43:36 +01:00
George Hotz
2d37fd686b test ops 2020-10-25 19:03:49 -07:00
George Hotz
2eebbd32c6 ops test speed 2020-10-25 19:01:02 -07:00
George Hotz
b27bcbe4b4 avgpool and test refactor 2020-10-25 18:40:01 -07:00
George Hotz
4c42676cb6 400 -> 200 2020-10-25 17:19:59 -07:00
George Hotz
567707a5f6 rename max_pool2d to match torch, remove more fast conv crap 2020-10-25 17:16:47 -07:00
George Hotz
ea41f5e1c1 seems more generic 2020-10-25 16:40:37 -07:00
George Hotz
2333c4dea7 no tqdm in actions 2020-10-25 16:40:08 -07:00
George Hotz
ad48061927 better sort in torch profiler 2020-10-25 16:07:49 -07:00
George Hotz
82f8e10813 no hacks in that test 2020-10-25 15:52:05 -07:00
George Hotz
4baa4c041f it's crazy how much faster pytorch is than numpy 2020-10-25 15:42:33 -07:00
George Hotz
5ddbd7f04b 2 to 3x slower than torch 2020-10-25 15:27:33 -07:00
George Hotz
f8311f5ecd print fp/bp mnist 2020-10-25 15:08:18 -07:00
George Hotz
5c179d18ad add profiling for mnist net 2020-10-25 14:20:55 -07:00
George Hotz
8fcada8071 faster and better convnet 2020-10-25 13:48:44 -07:00
George Hotz
96f9cdb8a0 woah, fastconv is wrong 2020-10-25 12:56:42 -07:00
George Hotz
bb98cdfef7 improve conv testing 2020-10-25 12:46:04 -07:00
George Hotz
ef24aac09e finally, fast convs 2020-10-25 12:39:44 -07:00
George Hotz
67506eb6ba fast im2col 2020-10-25 11:49:35 -07:00
George Hotz
c9968756d1 allow the line profiler to work 2020-10-25 11:13:40 -07:00
George Hotz
5062c2c8ff profile conv better 2020-10-25 11:11:00 -07:00
George Hotz
c74764bac3 oops, set to None 2020-10-25 08:28:18 -07:00
George Hotz
935f5ddaaa always keep batch size out front 2020-10-25 08:14:07 -07:00
George Hotz
b91fd3afad maxpool 2020-10-25 07:43:34 -07:00
George Hotz
5216a1d9f3 refactor into tensor and ops 2020-10-23 10:34:21 -07:00
George Hotz
9b9e47f369 added conv profile test 2020-10-23 09:46:10 -07:00