Commit Graph

11577 Commits

Author SHA1 Message Date
George Hotz
355402504e ops work 2020-11-02 07:03:23 -08:00
Marcel Bischoff
af5a4e0f5a alternative to einsum which is slow in extreme cases (#44)
* streamlined numerical_jacobian

* Got rid of the g loop in Conv2D.forward

* ereased stupid line

* nothing

* no loops in Conv2D forward

* Conv2D backprop improved

* stupid things in examples

* alternative to einsum

* Conv2D backward einsum alternative

* tidying up

* tidied up

* no ravel

* got rid of print

* Update efficientnet.py

* Update efficientnet.py

* Update efficientnet.py

* only tensordot

* 255.0

* whitespace

* aspect ratio error in efficientnet

* noprint

Co-authored-by: Marcel Bischoff <marcel@Marcels-iMac.local>
2020-11-02 06:36:07 -08:00
George Hotz
5201a8e89f matmul on GPU 2020-11-01 08:54:20 -08:00
George Hotz
41e7d59aed test dot 2020-11-01 07:51:35 -08:00
George Hotz
1f544d6ece test mnist on GPU 2020-11-01 07:46:17 -08:00
George Hotz
499604d69b convert tensor to gpu 2020-11-01 07:34:50 -08:00
George Hotz
bac6bfda11 with that at least it's only 10x slower 2020-11-01 07:30:19 -08:00
George Hotz
9ac1ad40d6 Add GPU Support! (do not merge yet) (#41)
* copy tensors to and from gpu

* add on GPU

* adding works

* we stick shapes in

* works on cpu and gpu

* test changes, not passing yet

* something else

* op tests pass

* add, mean, and sum have working forward/backward

* mul ops test

* no gpu support, no problem

* test pass, clean up later

* gpu cleanup

* cleanup test ops, don't let div fail

* revert more

* aimpler dispatcher

* clean up grad

* GPU and

* grad is a Tensor now

* gate test on GPU

* cleanups

* late loading gpu

* GPU as input option

* last cleanups
2020-11-01 07:00:49 -08:00
liej6799
c06a4fcc80 Fix temp location for windows (#39)
* Fix temp location for windows

* Make sure get tempfile for other os also.

* Update utils.py
2020-10-31 17:21:14 -07:00
George Hotz
7c0dc8f48b more whitespace 2020-10-31 11:05:11 -07:00
George Hotz
e01e35e545 14 ops to write for GPU 2020-10-31 10:59:30 -07:00
George Hotz
06928cf3cc ENET WORKS 2020-10-31 10:42:58 -07:00
George Hotz
68cba88e8f fix enet bugs, now is mousetrap 2020-10-31 10:28:07 -07:00
George Hotz
a852143572 simpler conv2d 2020-10-31 09:20:20 -07:00
Marcel Bischoff
e5153d401f Conv2D forward without loops much faster, backward slightly faster (#38)
* streamlined numerical_jacobian

* Got rid of the g loop in Conv2D.forward

* ereased stupid line

* nothing

* no loops in Conv2D forward

* Conv2D backprop improved

Co-authored-by: Marcel Bischoff <marcel@Marcels-iMac.local>
2020-10-31 09:08:32 -07:00
George Hotz
053c319708 optional look at cat 2020-10-30 09:30:15 -07:00
George Hotz
2c7e75d733 group conv: forward pass works (#34)
* forward pass works

* got the backward pass

* okay, it's now a coho
2020-10-30 09:19:20 -07:00
George Hotz
339a35b081 div needs help 2020-10-30 08:32:16 -07:00
George Hotz
71aedc2309 it thinks it's washer. it's cat. bad net. you do bad. 2020-10-30 08:28:05 -07:00
George Hotz
c14473f87d unit test for batchnorm2d 2020-10-30 08:19:58 -07:00
George Hotz
843b1cb7d6 only warn once 2020-10-30 08:04:48 -07:00
Marcel Bischoff
16d324064e streamlined numerical_jacobian (#32)
Co-authored-by: Marcel Bischoff <marcel@Marcels-iMac.local>
2020-10-30 02:20:12 -07:00
Liam
127f878fa9 Clean init function (#29) 2020-10-29 17:45:55 -07:00
Afshin1354
c13b255847 Update gradcheck.py (#30) 2020-10-29 17:45:34 -07:00
Omar Ben Brahim
d0c3912517 fix for invalid GPU error caused by (test/test_net_speed.py::TestConvSpeed::test_mnist) when testing in CI (#31)
* install the pytorch cpu only version

* get rid of torch gpu version

* test passed seems to get rid of invalid gpu error

* added the libs to requirements.txt

* lol
2020-10-29 17:45:16 -07:00
George Hotz
1dde4ce609 oops, stay in float32 2020-10-29 08:24:12 -07:00
George Hotz
5e7e359706 fix tests 2020-10-29 08:19:07 -07:00
George Hotz
9ae3e9daf3 shape has to be a kwarg now, idk why this didn't break before 2020-10-29 08:13:05 -07:00
George Hotz
2db670ef26 enet refactor + no sigmoid warning 2020-10-29 08:08:21 -07:00
George Hotz
17fa74c15b factor out a couple nn ops 2020-10-29 08:01:12 -07:00
George Hotz
f84f6c1edd write sqrt and div using pow 2020-10-29 07:57:25 -07:00
Omar Ben Brahim
ec7bdb87ca clean up CI (#28) 2020-10-29 07:43:31 -07:00
George Hotz
cc17e3271a try to recognize cat. do not succeed 2020-10-27 21:41:52 -07:00
George Hotz
03d9c98f5b enet work 2020-10-27 21:23:02 -07:00
George Hotz
0ec279951f enet weight loading 2020-10-27 21:01:48 -07:00
George Hotz
e84ad3e27d enet runs 2020-10-27 20:16:29 -07:00
George Hotz
9166eb58bb more enet 2020-10-27 19:37:21 -07:00
George Hotz
41828d768f sigmoid and more enet 2020-10-27 19:13:47 -07:00
George Hotz
09d1ebcdaa examples is better 2020-10-27 18:57:00 -07:00
Göktuğ Karakaşlı
4b163ee270 efficient version of adam (#20)
* counteracted bias initialization

* test new adam

* add optimizer tests

* rename helper function names to fix the test

* remove redundant import
2020-10-27 15:54:40 -07:00
George Hotz
8d75c9e4c4 we have matmul too 2020-10-27 08:57:17 -07:00
George Hotz
f9788eba14 parameters, and start on efficientnet 2020-10-27 08:53:35 -07:00
George Hotz
0b68c08de0 literally just bump version for picture on pypi 2020-10-27 08:14:22 -07:00
George Hotz
6b5982b6b3 push pypi 2020-10-27 08:13:15 -07:00
George Hotz
716f86a572 sections 2020-10-27 08:10:51 -07:00
Liam
4a663d31da less than 1000 lines (#24)
* Actions sloccount check for < 1000 lines (tests and source)

* Sudo lol

* Test sloccount in actions ci

* More tests for the expression

* apt install test to do validation in cli

* fuck test

* try something that probably won't work

* ofcourse not

* test that test fails if lines greater than 1000

* more than 1000 results in 1,000 not 1000. Delete

* remove test lines. Should pass now

* Untouch file

Untouched a file that was changed in testing
2020-10-27 08:07:15 -07:00
George Hotz
dcf630dbeb Merge pull request #22 from tsmcalister/master
adds beautiful and meaningful logo
2020-10-26 16:41:10 -07:00
=
6b44a7f729 adds beautiful and meaningful logo 2020-10-26 18:12:49 +01:00
George Hotz
c5db2cf517 readme more 2020-10-26 09:21:48 -07:00
George Hotz
43591a1e71 make the example simpler 2020-10-26 09:19:20 -07:00