Commit Graph

7979 Commits

Author SHA1 Message Date
George Hotz
5577b9d3a0 clean up imports 2020-11-10 15:53:05 -08:00
George Hotz
db755fa103 promote swish to a tensor ops 2020-11-10 15:48:11 -08:00
George Hotz
5f4b76a21b touch ups 2020-11-10 15:44:47 -08:00
George Hotz
52ee913c98 move the mnist loader out of tinygrad proper 2020-11-10 15:37:39 -08:00
George Hotz
498b4d2f27 i32 and reduce line count a bit 2020-11-10 15:35:30 -08:00
George Hotz
df64658a2c weee, opencl tests in CI 2020-11-10 10:04:45 -08:00
George Hotz
d47a128812 pocl 2020-11-10 10:02:13 -08:00
George Hotz
c05401a9ca sudo maybe 2020-11-10 09:53:49 -08:00
George Hotz
09bc8eddfe clinfo 2020-11-10 09:51:38 -08:00
George Hotz
58e703d099 fix tests 2020-11-10 09:49:19 -08:00
George Hotz
23405cec43 intel opencl 2020-11-10 09:41:40 -08:00
George Hotz
33090c4b0d install more 2020-11-10 09:34:56 -08:00
George Hotz
a52590e76c cpu opencl maybe 2020-11-10 09:32:54 -08:00
George Hotz
f513302955 refactor profiler 2020-11-10 07:31:16 -08:00
adamritter
f27628b21c No separate pad2d kernel needed (#99)
Co-authored-by: holonomicjl <58403584+holonomicjl@users.noreply.github.com>
2020-11-10 06:47:53 -08:00
George Hotz
2d4a5d5950 readme 2020-11-10 01:27:04 -08:00
George Hotz
6e6bcbe5f2 shapes on backward 2020-11-10 01:23:31 -08:00
Ryan Neph
56f71ae8e5 Cleanup (#96)
* init GPU supsample retbuf to 0

* reduce GPU kernel source lines

ref: #94
2020-11-10 01:20:04 -08:00
George Hotz
55012d21bb debug in backward pass too 2020-11-10 01:19:52 -08:00
George Hotz
5d1985312c miniprofiler is real 2020-11-10 01:05:29 -08:00
George Hotz
c76a20b4be 4s and 7s work 2020-11-10 00:54:17 -08:00
George Hotz
ae0cd17c2d debug is env var, and simpler faster pad2d 2020-11-10 00:42:23 -08:00
George Hotz
f7d10d5639 DEBUG flag 2020-11-10 00:36:59 -08:00
George Hotz
6a56d5d030 remove pyopencl 2020-11-09 23:58:35 -08:00
George Hotz
943ff6490d logic error okay too 2020-11-09 23:55:21 -08:00
George Hotz
29b22d117f will gpu tests work? 2020-11-09 23:51:29 -08:00
George Hotz
abbf0d1328 cleanup logsoftmax 2020-11-09 23:47:04 -08:00
George Hotz
aeb90226a8 reduce lines with reduce_op 2020-11-09 23:36:44 -08:00
George Hotz
55c914912d minor cleanup 2020-11-09 23:14:59 -08:00
George Hotz
d41ad2bf37 uint2 saves lines 2020-11-09 23:11:20 -08:00
George Hotz
8b23033fa9 support all the enet sizes 2020-11-09 18:04:16 -08:00
George Hotz
9db95ab942 fix enet padding 2020-11-09 17:56:57 -08:00
George Hotz
866b759d3b match torch api for pad2d 2020-11-09 17:48:56 -08:00
George Hotz
daf073535f new -> zeros 2020-11-09 17:31:52 -08:00
Ryan Neph
16d564a53c finish unsupporting strided pool, add global avg pool test (#92) 2020-11-09 17:31:22 -08:00
George Hotz
7ac1b163a5 add backward to enet train 2020-11-09 16:05:52 -08:00
George Hotz
8ca9c0205f train_efficientnet is broken still 2020-11-09 16:01:16 -08:00
George Hotz
870b84a893 test pad2d backward on GPU 2020-11-09 15:50:43 -08:00
adamritter
b541c05d88 Pad2d backward pass on GPU (#89)
* Pad2d backward pass on GPU

* Faster Pad2D GPU backward pass (no zeroing needed)

* Fix out of bounds error

* Don't save prg

Co-authored-by: holonomicjl <58403584+holonomicjl@users.noreply.github.com>
2020-11-09 15:49:37 -08:00
George Hotz
e46d122f65 not supporting stride 2020-11-09 15:06:58 -08:00
Ryan Neph
c21c2a0b62 revert b0c0c5d: Strided Pool funcs (#74) (#87)
Strided CPU Pooling was introduced but assumes small kernel size
(<=(10,10)), but efficientnet.py feeds kernel_size=(112,112).

This causes a huge array buffer allocation in stack_for_pool() that
hangs inference for a long time or until system OOM.

Revert CPU Pooling for now, and re-introduce #74 later with a new
global-average-pooling op that can be used instead of avgpool2d with
large kernel size for efficientnet inference.

Co-authored-by: Ryan Neph <ryanneph@google.com>
2020-11-09 14:58:18 -08:00
George Hotz
53157fb876 add back scale 2020-11-09 10:20:56 -08:00
George Hotz
3ffbd47335 Revert "Revert "pygame is fine, cv2 can also do the trick (#79)" (#85)"
This reverts commit 6b982621f8.
2020-11-09 10:18:48 -08:00
George Hotz
6b982621f8 Revert "pygame is fine, cv2 can also do the trick (#79)" (#85)
This reverts commit e7f2f43331.
2020-11-09 10:03:38 -08:00
dustcollector12
e7f2f43331 pygame is fine, cv2 can also do the trick (#79)
* pygame is fine, cv2 can also do the trick

* retimg and copy constructor not needed

* shape is missing without copy constructor

* retimg put back

* addressing capture buffering
2020-11-09 10:02:06 -08:00
Ryan Neph
7e515308a5 label op subtests by params (#83) 2020-11-09 06:25:06 -08:00
Ryan Neph
5bedf566d1 tests should use rtol unless special case (#82) 2020-11-08 17:25:11 -08:00
Ryan Neph
04b9312a34 Fix GPU Pooling bug at boundary + better Pooling test coverage (#81)
* fixed Pooling bug

* Clarify Pooling tests
2020-11-08 17:25:01 -08:00
niclaswue
c57b1b9e7d deleted unnecessary import in utils (#78) 2020-11-08 15:55:16 -08:00
Ryan Neph
b0c0c5d0d6 strided Pool funcs (#74)
* *Pool2D GPU forward supports stride

* kernel_size from ctx instead of saved_tensors

* *Pool2D CPU forward supports stride

* update ctx.stride properly
2020-11-08 11:45:55 -08:00