Commit Graph

995 Commits

Author SHA1 Message Date
George Hotz
609d11e699 trainer works with CIFAR 2020-12-06 12:20:14 -08:00
George Hotz
80a9c777ba requires grad, optim in train enet 2020-12-06 11:10:30 -08:00
George Hotz
c66c27d22e get parameters 2020-12-06 10:45:04 -08:00
George Hotz
51daaa43d4 fix memory leaks, add gc test 2020-12-06 10:34:40 -08:00
George Hotz
b8deb36e56 train BS=16 for 32 steps 2020-12-04 10:00:32 -08:00
adamritter
5797e63d9b Train efficientnet should respect NUM environment variable (#122)
Co-authored-by: holonomicjl <58403584+holonomicjl@users.noreply.github.com>
2020-11-16 20:02:31 -08:00
George Hotz
2ffb8de1ea move efficientnet to extra 2020-11-16 08:08:07 -08:00
dustcollector12
6f033ea30a enable local images for efficientnet.py (#116) 2020-11-13 07:00:12 -08:00
Marcel Bischoff
a3989f9e18 Supporting .png files in efficientnet (#102)
* to make it work locally

* definitely not working

* Conv2D GPU passes some of the tests

* Conv2D GPU passes more of the tests

* passes some tests and mnist

* removed unecessary code

* Conv2D Backpass works

* wrong test_ops.py

* white space + test backward

* ereased useless code

* removed default argument

* long lines

* works also with 4 channel .png files

* commenting out

* track
2020-11-10 20:06:24 -08:00
George Hotz
db755fa103 promote swish to a tensor ops 2020-11-10 15:48:11 -08:00
George Hotz
55012d21bb debug in backward pass too 2020-11-10 01:19:52 -08:00
George Hotz
c76a20b4be 4s and 7s work 2020-11-10 00:54:17 -08:00
George Hotz
8b23033fa9 support all the enet sizes 2020-11-09 18:04:16 -08:00
George Hotz
9db95ab942 fix enet padding 2020-11-09 17:56:57 -08:00
George Hotz
7ac1b163a5 add backward to enet train 2020-11-09 16:05:52 -08:00
George Hotz
8ca9c0205f train_efficientnet is broken still 2020-11-09 16:01:16 -08:00
George Hotz
53157fb876 add back scale 2020-11-09 10:20:56 -08:00
George Hotz
3ffbd47335 Revert "Revert "pygame is fine, cv2 can also do the trick (#79)" (#85)"
This reverts commit 6b982621f8.
2020-11-09 10:18:48 -08:00
George Hotz
6b982621f8 Revert "pygame is fine, cv2 can also do the trick (#79)" (#85)
This reverts commit e7f2f43331.
2020-11-09 10:03:38 -08:00
dustcollector12
e7f2f43331 pygame is fine, cv2 can also do the trick (#79)
* pygame is fine, cv2 can also do the trick

* retimg and copy constructor not needed

* shape is missing without copy constructor

* retimg put back

* addressing capture buffering
2020-11-09 10:02:06 -08:00
George Hotz
3ab8fb2189 oops, timing 2020-11-07 12:15:52 -08:00
George Hotz
e4c5fb0219 webcam support 2020-11-07 12:15:16 -08:00
George Hotz
e6c8321e5b enet is running on GPU 2020-11-07 11:33:46 -08:00
George Hotz
fbff6ab2e5 fix strided convs, GPU env var for enet 2020-11-07 10:26:37 -08:00
Marcel Bischoff
c69582744d Update efficientnet.py (#53)
from https://github.com/lukemelas/EfficientNet-PyTorch/blob/master/efficientnet_pytorch/utils.py
```
    blocks_args = [
        'r1_k3_s11_e1_i32_o16_se0.25',
        'r2_k3_s22_e6_i16_o24_se0.25',
        'r2_k5_s22_e6_i24_o40_se0.25',
       'r3_k3_s22_e6_i40_o80_se0.25',
        'r3_k5_s11_e6_i80_o112_se0.25',
        'r4_k5_s22_e6_i112_o192_se0.25',
        'r1_k3_s11_e6_i192_o320_se0.25',
    ]
```

now it's a persian cat.
2020-11-04 09:36:27 -08:00
Marcel Bischoff
c40862241d Revert "choose aspect ration dependent on landscape or portrait (#48)" (#51)
This reverts commit 2808411421.
2020-11-02 19:31:07 -08:00
Anders Aaen Springborg
2808411421 choose aspect ration dependent on landscape or portrait (#48) 2020-11-02 18:10:22 -08:00
Marcel Bischoff
af5a4e0f5a alternative to einsum which is slow in extreme cases (#44)
* streamlined numerical_jacobian

* Got rid of the g loop in Conv2D.forward

* ereased stupid line

* nothing

* no loops in Conv2D forward

* Conv2D backprop improved

* stupid things in examples

* alternative to einsum

* Conv2D backward einsum alternative

* tidying up

* tidied up

* no ravel

* got rid of print

* Update efficientnet.py

* Update efficientnet.py

* Update efficientnet.py

* only tensordot

* 255.0

* whitespace

* aspect ratio error in efficientnet

* noprint

Co-authored-by: Marcel Bischoff <marcel@Marcels-iMac.local>
2020-11-02 06:36:07 -08:00
George Hotz
e01e35e545 14 ops to write for GPU 2020-10-31 10:59:30 -07:00
George Hotz
06928cf3cc ENET WORKS 2020-10-31 10:42:58 -07:00
George Hotz
68cba88e8f fix enet bugs, now is mousetrap 2020-10-31 10:28:07 -07:00
George Hotz
053c319708 optional look at cat 2020-10-30 09:30:15 -07:00
George Hotz
2c7e75d733 group conv: forward pass works (#34)
* forward pass works

* got the backward pass

* okay, it's now a coho
2020-10-30 09:19:20 -07:00
George Hotz
71aedc2309 it thinks it's washer. it's cat. bad net. you do bad. 2020-10-30 08:28:05 -07:00
George Hotz
c14473f87d unit test for batchnorm2d 2020-10-30 08:19:58 -07:00
George Hotz
1dde4ce609 oops, stay in float32 2020-10-29 08:24:12 -07:00
George Hotz
2db670ef26 enet refactor + no sigmoid warning 2020-10-29 08:08:21 -07:00
George Hotz
17fa74c15b factor out a couple nn ops 2020-10-29 08:01:12 -07:00
George Hotz
cc17e3271a try to recognize cat. do not succeed 2020-10-27 21:41:52 -07:00
George Hotz
03d9c98f5b enet work 2020-10-27 21:23:02 -07:00
George Hotz
0ec279951f enet weight loading 2020-10-27 21:01:48 -07:00
George Hotz
e84ad3e27d enet runs 2020-10-27 20:16:29 -07:00
George Hotz
9166eb58bb more enet 2020-10-27 19:37:21 -07:00
George Hotz
41828d768f sigmoid and more enet 2020-10-27 19:13:47 -07:00
George Hotz
09d1ebcdaa examples is better 2020-10-27 18:57:00 -07:00