Commit Graph

469 Commits

Author SHA1 Message Date
George Hotz
ec03eb44bd tinygrad does forward pass convs on GPU 2020-11-07 10:15:56 -08:00
George Hotz
3302286e68 yayay test_sgd_gpu passes 2020-11-07 08:48:17 -08:00
George Hotz
38e112cccd logsoftmax test 2020-11-07 07:26:53 -08:00
Rene Delgado
cd54697fd8 fix gpu sum forward (#61)
* ignore venv

* add sum test

* fix sum forward
2020-11-05 21:59:16 -08:00
NeuralLink
cc605da36d Stable Sigmoid op (#59)
* 🔨 Added stable sigmoid

*  added sigmoid test

* 🔧 suppressed overflow warning

* 🔧 clean up
2020-11-05 21:57:50 -08:00
George Hotz
f178d23ff3 gpu relu is good 2020-11-02 08:25:32 -08:00
George Hotz
231c1134bd cute trick for GPU test 2020-11-02 08:17:17 -08:00
George Hotz
5201a8e89f matmul on GPU 2020-11-01 08:54:20 -08:00
George Hotz
41e7d59aed test dot 2020-11-01 07:51:35 -08:00
George Hotz
9ac1ad40d6 Add GPU Support! (do not merge yet) (#41)
* copy tensors to and from gpu

* add on GPU

* adding works

* we stick shapes in

* works on cpu and gpu

* test changes, not passing yet

* something else

* op tests pass

* add, mean, and sum have working forward/backward

* mul ops test

* no gpu support, no problem

* test pass, clean up later

* gpu cleanup

* cleanup test ops, don't let div fail

* revert more

* aimpler dispatcher

* clean up grad

* GPU and

* grad is a Tensor now

* gate test on GPU

* cleanups

* late loading gpu

* GPU as input option

* last cleanups
2020-11-01 07:00:49 -08:00
George Hotz
2c7e75d733 group conv: forward pass works (#34)
* forward pass works

* got the backward pass

* okay, it's now a coho
2020-10-30 09:19:20 -07:00
George Hotz
339a35b081 div needs help 2020-10-30 08:32:16 -07:00
George Hotz
f84f6c1edd write sqrt and div using pow 2020-10-29 07:57:25 -07:00
George Hotz
1654008c1f conv stride support 2020-10-26 08:54:43 -07:00
George Hotz
2a55d7402b clean up ops, refactor pool backward. add stride test 2020-10-26 08:47:11 -07:00
George Hotz
93dceb4bee fix kernel_size bug, name like torch, add test 2020-10-26 08:38:53 -07:00
George Hotz
2d37fd686b test ops 2020-10-25 19:03:49 -07:00
George Hotz
2eebbd32c6 ops test speed 2020-10-25 19:01:02 -07:00
George Hotz
b27bcbe4b4 avgpool and test refactor 2020-10-25 18:40:01 -07:00