George Hotz
29ae21bb0d
import tests from CL metal texture fix
2022-09-19 20:01:47 -04:00
George Hotz
57e804a9bf
add min support
2022-09-18 20:39:41 -04:00
YassineYousfi
2f0f91ba3d
support float16 onnx weights ( #384 )
2022-09-15 09:12:18 -04:00
George Hotz
3c3534736e
fix matmul kernel and tests
2022-09-13 08:31:04 -07:00
Comma Device
62e9419206
fix test failure on MATMUL=1 backward pass
2022-09-13 11:18:52 -04:00
Comma Device
3b82afc6a0
simple on device failing test
2022-09-13 10:59:15 -04:00
George Hotz
4efde1ba0a
test_matmul
2022-09-13 07:51:33 -07:00
George Hotz
0b8c2221b5
relax mnist test a tiny bit
2022-09-07 07:52:05 -07:00
George Hotz
ecc1a0470d
add Linear to tinygrad.nn
2022-09-07 07:40:48 -07:00
George Hotz
790af99a48
fix slice one multi, and linear can be simpler with new broadcasting
2022-09-06 19:51:33 -07:00
YassineYousfi
5aad460c7a
broadcast from right to left ( #375 )
...
* broadcast from right to left
* add another broadcasted add test
2022-09-06 16:36:13 -07:00
George Hotz
bcb867cdd6
better idea for numbers, do the division in python
2022-09-03 16:23:39 -07:00
George Hotz
033a3ecccf
found tinygrad bug
2022-09-03 12:32:43 -07:00
George Hotz
7f15779942
t.assign in optim
2022-08-20 14:04:33 -07:00
George Hotz
1eb12dafbc
reduce axis at the end
2022-08-20 07:40:56 -07:00
George Hotz
b132de677d
tinygrad.nn ( #367 )
...
* tinygrad.nn
* flake8
* working on pylint
* more pylint
* more pylint
* pylint passes
* networkx
* mypy can't infer that type
* junk
2022-08-18 07:41:00 -07:00
George Hotz
18fde22dac
fix that soon
2022-07-20 09:07:09 -07:00
George Hotz
5d45c6e516
Fold reduce ( #362 )
...
* folding reduce
* fold through movementops
* fixup shapes
* was too aggressive
* i knew we needed that
* don't recompute reduce
* working
* fix openpilot compile
* prunegraph openpilot
* types and reduce_shape
* refactor
* cleanups
* neater
* 1009
* 1004
* clean up reduce for 998
2022-07-19 09:24:02 -07:00
George Hotz
f76d41812b
prune graph
2022-07-17 15:38:43 -07:00
George Hotz
73b0471b25
join expands
2022-07-17 13:42:05 -07:00
George Hotz
cfabbbd6bb
more crap to remove without convs
2022-07-17 13:02:27 -07:00
George Hotz
5e96ed523a
fix opencl bug, no training on opencl
2022-07-17 12:55:26 -07:00
George Hotz
f93e297804
fix bug caused by rounding
2022-07-17 12:49:58 -07:00
George Hotz
cff297ef9d
w/e, that's a later prob
2022-07-17 12:32:50 -07:00
George Hotz
6375e7129a
opencl not imported
2022-07-17 12:14:39 -07:00
George Hotz
bf299802f8
fixup tests
2022-07-17 12:11:53 -07:00
George Hotz
3c4565fa21
SLICE -> PAD,SHRINK
2022-07-17 11:33:59 -07:00
George Hotz
cca089b11d
Revert "more expand -> repeat"
...
This reverts commit 2e7b1630a8 .
2022-07-17 08:41:48 -07:00
George Hotz
2e7b1630a8
more expand -> repeat
2022-07-17 08:40:49 -07:00
George Hotz
d04b274cd2
noop removal can replace with reshape
2022-07-16 08:32:42 -07:00
George Hotz
bcf422dfdd
Device2 ( #358 )
...
* option for matmul
* fixups
* fast like a nascar
* running
* thneed runner
* no buffer id makes no backing buffer
* move constant folding to the top
* runs on mac
* folded biases
* was v slow
* maybe just that
* elu touchup
* speed and float32
Co-authored-by: Comma Device <device@comma.ai >
2022-07-16 07:26:19 -07:00
George Hotz
5e46561f7e
no_grad = NOT backward
2022-07-10 20:54:57 -07:00
George Hotz
b34ae7876f
lol chr(10) not chr(13)
2022-07-10 20:03:11 -07:00
George Hotz
44848ee5dc
prints show we can precompute from the outside
2022-07-08 10:59:20 -07:00
George Hotz
04e7e4104c
track graph children and make lazycache use weak references
2022-07-07 11:01:18 -07:00
George Hotz
001cfe83a2
local
2022-07-07 10:05:26 -07:00
George Hotz
2720ef49ca
extra and test and tuple
2022-07-07 10:01:33 -07:00
George Hotz
81b73f97a3
Optiimzation ( #355 )
...
* constant folding into kernels
* that opt worth it?
* fix mypy
* ast one kernel
* save 2 lines in conv kernel
* debug print kernel count
* cl debugging
* early realize inputs
* refactor Device
2022-07-04 08:58:57 -07:00
George Hotz
e6e43e820e
should fix tests
2022-07-03 16:06:11 -07:00
George Hotz
d7aad46758
test lazy also, make TestMNIST faster
2022-07-03 15:19:19 -07:00
George Hotz
93c378dffc
add test for slice_one
2022-07-03 12:14:20 -07:00
George Hotz
f9a8412b68
make contiguous ops yellow
2022-07-02 17:54:04 -07:00
George Hotz
207b9e1df3
padding is now a param to conv2d
2022-07-02 17:11:12 -07:00
George Hotz
cde137d163
simple shapetracker tests
2022-07-02 16:02:15 -07:00
George Hotz
368c0ce2f6
NUM=-2 for ants
2022-07-02 15:47:10 -07:00
George Hotz
7276f8d6bf
improve constant folding, detach before moving tensor
2022-07-02 15:29:40 -07:00
George Hotz
e55a9833fb
a little more readable
2022-06-27 08:54:04 -07:00
George Hotz
3a414d7f50
cleanup, add flops tracking
2022-06-26 22:43:39 -07:00
George Hotz
dffde3de5a
support both asymmetric and negative padding
2022-06-26 17:59:25 -07:00
George Hotz
49c954b389
comments
2022-06-26 17:20:25 -07:00