George Hotz
c22afc52db
move the custom function example to a test
2023-03-08 10:05:04 -08:00
George Hotz
7d3b9d0e95
oops, things relied on that API. the global cache needs access to the ASTRunner class
2023-03-08 08:39:31 -08:00
George Hotz
4f957423c3
jitting custom ops + OPTLOCAL assignment bugfix
2023-03-08 08:30:37 -08:00
George Hotz
7285de41a1
tinygrad supports CUSTOM functions
2023-03-08 07:50:33 -08:00
George Hotz
00641aa45d
add challenge tests
2023-03-07 19:39:04 -08:00
George Hotz
e0244baf60
3 letters for graph op
2023-03-07 19:20:48 -08:00
George Hotz
46df02115d
bring back SHUFFLE_PAD_OPS as OPT>=4
2023-03-07 17:42:34 -08:00
George Hotz
4eb880550f
enable contract test
2023-03-07 17:32:28 -08:00
Alex Wang
d885d2d0f5
Allow 1s for contraction detection ( #663 )
...
* Allow 1s for contraction check
* More test cases for 1s
2023-03-07 17:31:28 -08:00
George Hotz
b561256a0e
allow all reduces ( #661 )
...
* allow all reduces
* push permute tests
* explict permute reshape push
* contractw1s
2023-03-07 15:36:01 -08:00
George Hotz
b14d31d6db
ConvNeXt + extras ( #657 )
...
* simple convnext implementation
* shorter function names
* need to realize the random functions now
* creating an optimizer realizes all params
* assign contiguous
* fix lazy lazy
* why was i doing that...add convnext to tests
* LazyNumpyArray
* enable assert + comment
* no two tiny
2023-03-06 22:10:56 -08:00
George Hotz
d8dda2af3a
openpilot fixups
2023-03-06 14:14:44 -08:00
George Hotz
4b9bc1615b
While fusion ( #654 )
...
* try this
* readme
* opt comments
2023-03-06 09:13:23 -08:00
George Hotz
066a65dad5
remove tflop number, i'll never update that when it's fast
2023-03-06 08:30:31 -08:00
George Hotz
6e763dc446
matmul example in readme
2023-03-06 08:25:13 -08:00
George Hotz
5dc227dba6
fix bug in ENABLE_METHOD_CACHE and enable for llvm
2023-03-06 07:43:40 -08:00
George Hotz
8c5dea8d72
fix CUDA float4 issues
2023-03-06 07:16:38 -08:00
George Hotz
7dbcc26582
fix up external tests
2023-03-06 06:52:28 -08:00
George Hotz
50012f679b
move get_contraction to shapetracker
2023-03-06 06:42:57 -08:00
Alex Wang
64ecbd91b5
Refactor contraction and add integration test cases for push permute ( #650 )
...
* Refactor contraction and add unit tests
* Fix typo; Fix TestConv.test_elu failure due to some ones in old_shape
* Add push permute test cases
* Fix mypy type annotation check error
* Add contraction unit test; Reshape to higher dimension is not contraction
2023-03-06 06:36:55 -08:00
Peter McDevitt
cb5be9697c
One less line in consume_flops ( #651 )
...
* less lines
* using walrus
* using original way
2023-03-05 23:34:45 -08:00
George Hotz
f028accae3
print upcasted colors
2023-03-05 22:12:42 -08:00
George Hotz
b2d4b2c06e
refactor imports and EOL whitespace
2023-03-05 20:52:03 -08:00
George Hotz
382f346523
clean up opt ( #649 )
...
* clean up opt
* don't let global kernels get too small
* 8192 -> 1024
* disable local shape for clang
* fix can_merge
* unroll the 5x5 depthwise convs in op
* load float4 check
2023-03-05 20:49:36 -08:00
George Hotz
7930c6ab5c
CLImage backing bug + test_vec_mul
2023-03-05 16:32:05 -08:00
George Hotz
8de24e3b05
accumulator can be a float4 ( #647 )
...
* remove reduceopop
* not float4 yet
* float4 acc works
* group_float4 on store
2023-03-05 15:44:41 -08:00
Cyril Roumégous
c10131ddf5
reduce number of lines ( #645 )
2023-03-05 15:42:32 -08:00
George Hotz
7989f79820
using image from mad branch saves 1ms on op model
2023-03-05 14:38:42 -08:00
George Hotz
7940ad258e
fix dropout test
2023-03-05 12:24:04 -08:00
George Hotz
3072e098c0
local workgroup optimizer
2023-03-05 12:08:12 -08:00
George Hotz
b1ba78ac38
move applegpu disassembler
2023-03-05 11:21:12 -08:00
George Hotz
e8de3f5736
Revert "less lines ( #643 )" ( #644 )
...
This reverts commit 30f2238994
2023-03-05 08:41:11 -08:00
Peter McDevitt
30f2238994
less lines ( #643 )
2023-03-05 08:37:14 -08:00
Comma Device
3da56ab41d
adreno disassembler
2023-03-05 10:32:03 -06:00
George Hotz
16b03f3c3b
wow, can't believe that was broken ( #642 )
...
* wow, can't believe that was broken
* remove namedtuple comment
2023-03-04 22:28:28 -08:00
George Hotz
4a607f7d65
more ext gpu tests
2023-03-04 21:00:08 -08:00
George Hotz
69198a73d2
test_1x1_24_6
2023-03-04 20:37:46 -08:00
George Hotz
f281f707bd
better function names
2023-03-04 18:27:37 -08:00
George Hotz
a77d792aff
Codegen gpu cleanups ( #640 )
...
* cleanups
* fixups
* handle pre upcasted global buffers
* early is just required
* delete junk from hand coded opt
* implicit upcast_in_mid_reduce
* speedup
* fix exec w validhacks
* reorder opt
* only need to check the output for that
* return total runtime from kernels if debugging
2023-03-04 15:31:51 -08:00
Patrick Geneva
10d40d3cf2
Expand the inline loop to prevent stack overflow from _deepwalk ( #638 )
...
* Expand the inline loop to prevent stack overflow
* Explicitly loop
2023-03-04 15:14:17 -08:00
George Hotz
b02a392d69
Improve local ( #635 )
...
* local is improving
* local is finding bugs
* new local should work
2023-03-04 09:30:49 -08:00
Patrick Geneva
117111825c
Fix windows file permission error ( #634 )
2023-03-04 09:23:55 -08:00
George Hotz
528cb3b3b9
fix ast test
2023-03-04 07:49:25 -08:00
George Hotz
8bc9277587
G.nodes isn't always valid
2023-03-04 07:24:43 -08:00
George Hotz
85f69b5489
metal needs the Cocoa
2023-03-03 23:22:15 -08:00
George Hotz
28a6ada4ce
line reduction in metal
2023-03-03 23:14:40 -08:00
George Hotz
893f136fe0
lines from helpers
2023-03-03 23:07:46 -08:00
George Hotz
81cda2b672
zero out s == 1 strides
2023-03-03 22:57:02 -08:00
George Hotz
aef336c079
merge_views is very powerful
2023-03-03 22:53:59 -08:00
George Hotz
b5b4edf59b
comments
2023-03-03 22:39:31 -08:00
