chenyu
ef3752625b
add test case of realize_size with 0 in shape ( #8011 )
2024-12-03 09:19:50 -05:00
Ahmed Harmouche
8818046940
YoloV8 on WebGPU ( #8007 )
...
Port YoloV8 to WebGPU
2024-12-03 15:10:41 +01:00
George Hotz
09eac42fd6
cache indexed uops in st [pr] ( #8008 )
...
* cache indexed uops in st [pr]
* remove arg from range
2024-12-03 21:27:07 +08:00
Sieds Lykles
e44183647f
Improved div folding ( #7996 )
...
* First version of div_mod folding together
* Working version with old div folding behaviour
* Test is fixed
* Fix linting
* Happy mypy
---------
Co-authored-by: chenyu <chenyu@fastmail.com >
2024-12-03 08:11:25 -05:00
George Hotz
32675a8a77
sacrifice ClangGraph on the altar of lines [pr] ( #8009 )
2024-12-03 21:11:15 +08:00
qazal
5441127417
assert const folding return shape matches [pr] ( #8006 )
2024-12-03 19:31:06 +08:00
George Hotz
dddfb494d7
don't mutate the uop/lazybuffer, just the Buffer [pr] ( #8000 )
...
* don't mutate the uop/lazybuffer, just the Buffer [pr]
* fix red test
* try different fix
* that
* that's the right fix
* test for fixed behavior
* bump to 3.12
2024-12-03 19:03:51 +08:00
qazal
ba1183314a
const_like can return a valid [pr] ( #8005 )
...
* const_like can return a valid [pr]
* fixup
2024-12-03 18:42:12 +08:00
qazal
4e91533419
test: don't ref until schedule ( #8004 )
2024-12-03 18:06:52 +08:00
George Hotz
b8bf5b2787
minor uop speedups [pr] ( #8002 )
...
* minor uop cleaner [pr]
* free uop creation speed by removing WeakValueDictionary
* a lil faster
* disable that test
* lines
* and it doesn't print non hit patterns
2024-12-03 17:04:48 +08:00
George Hotz
1028b34a20
add typing to basicblocks ( #7999 )
2024-12-03 15:05:11 +08:00
George Hotz
0905f87b68
hotfix: print only kernel time
2024-12-03 14:25:08 +08:00
chenyu
17d5719a38
add process replay to webgpu tests ( #7998 )
2024-12-02 20:27:29 -05:00
chenyu
c7bc75e634
alu(c?t0:f0, c?t1:f1) -> c?alu(t0,t1):alu(f0,f1) ( #7900 )
...
* alu(c?t0:f0, c?t1:f1) -> c?alu(t0,t1):alu(f0,f1)
only do if at least one branch is const, so total alu won't increase
* tests and interesting TODO cases
2024-12-02 17:19:27 -05:00
chenyu
b91fa24387
script to run regressed sd conv on metal ( #7995 )
...
* script to run regressed sd conv on metal
this and other similar `conv2d + add` kernels contributed to most of the speed regression
* # ruff: noqa: E501
2024-12-02 15:34:27 -05:00
geohotstan
0a2e10be1d
add SELU to Tensor ( #7993 )
...
* add selu
* more clean ups
2024-12-02 10:04:01 -05:00
Ahmed Harmouche
146e1caea3
Downgrade wgpu to prevent sd segfault ( #7969 )
2024-12-02 15:48:44 +01:00
wozeparrot
077e7e8ed2
fix: private segment sgpr on gfx103x ( #7987 )
...
Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com >
2024-12-02 20:54:50 +08:00
qazal
bb606e5bcf
process replayable ops.py changes from delete_lazy [pr] ( #7994 )
...
* process replayable ops.py changes from delete_lazy [pr]
* hotfix: seed tiny_jit
2024-12-02 19:38:31 +08:00
George Hotz
0c7477b108
no bool in range [pr] ( #7988 )
...
* no bool in range [pr]
* fix llvm
* add arg to range spec
* fix broken test
* forgot this one
* hotfix: test_tiny jit is a real test
2024-12-02 19:05:16 +08:00
Ahmed Harmouche
8909dbd82c
Remove wgpu specific checks from stable diffusion example ( #7991 )
2024-12-02 11:31:14 +01:00
qazal
e2916ff210
image dtype fixup refactor for delete_lazy [pr] ( #7989 )
2024-12-02 18:25:13 +08:00
Ahmed Harmouche
5340d3dedf
Merge pull request #7986 from tinygrad/atomics-in-smem-wgpu
...
Support packed types in smem on webgpu
2024-12-02 10:38:19 +01:00
Ahmed Harmouche
dfae038580
Simplify render_buf_dt
2024-12-02 10:27:59 +01:00
Ahmed Harmouche
1ea0925744
Support packed types in smem in webgpu
2024-12-02 10:13:25 +01:00
George Hotz
61b2cac507
basicblock is dataclass ( #7985 )
...
* basicblock is dataclass [pr]
* tiny cleanups
2024-12-02 16:48:39 +08:00
George Hotz
275951b730
clean up a few parents -> toposort [pr] ( #7984 )
...
* clean up a few parents -> toposort [pr]
* rename to old_parents + sched tests
* a few more
* that one
* second to last
* final
2024-12-02 15:59:31 +08:00
George Hotz
f17af70d17
replace all sparents with toposort ( #7983 )
2024-12-02 15:00:30 +08:00
George Hotz
b09310d8c2
add toposort method to uops, faster linearize [pr] ( #7982 )
...
* add toposort method to uops, faster linearize [pr]
* trust the toposort
* all toposort
* Revert "all toposort"
This reverts commit db123adfda
2024-12-02 14:46:16 +08:00
qazal
b797aee720
uop global buf number tracking try 2 [pr] ( #7912 )
...
* uop buffer init small refactor [pr]
* add early
* this way it doesn't need late
* buffer_num
* itertools.count
* count from 0
* down to 380
2024-12-02 14:45:17 +08:00
George Hotz
cbcc1c20eb
second try at block linearize ( #7892 )
...
* second try at block linearize
* weeee, works for lil matmul
* it's so beautiful
* test tiny passes
* fix bugs
* combine matching BLOCKENDS
* wrapping
* test lin failures passes
* those failures were fake
* flip sort order
* fix ptx tests
* deal with store better
* dumb ptx fix
* expect less
* reduce lines
* reduce lines
* less lines and cleaner
* no defaultdict
* tighter
* simpler block_parent_count
2024-12-02 13:43:09 +08:00
George Hotz
9b0859d717
PYTHON device is okay to use everywhere [pr] ( #7981 )
2024-12-02 12:34:42 +08:00
mesozoic-egg
90e2b2d577
Remove gated store, put rewrite to uopgraph [pr] ( #7975 )
...
* update test for gated store
* put gated store rewrite to uopgraph, rm from ptx
* update test
update test
update test
* remove gated st rewrite in llvm
* lint
---------
Co-authored-by: Mesozoic Egg <mesozoic.egg@proton.mail >
Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com >
2024-12-02 12:33:16 +08:00
George Hotz
d53cd92364
fix tests for delete lazy [pr] ( #7980 )
2024-12-02 12:00:48 +08:00
chenyu
254c86d712
ruff target-version "py38" -> "py310" ( #7978 )
2024-12-01 22:35:21 -05:00
George Hotz
6c1efb9a72
hotfix: amd gemv was flaky
2024-12-02 11:08:24 +08:00
chenyu
4e46c67327
small helpers cleanups ( #7977 )
...
less lines for ceildiv and partition, and removed one # noqa: E501
2024-12-01 21:50:47 -05:00
qazal
aa2e7b11f8
more const folding infra from the delete_lazy branch [pr] ( #7976 )
...
* more const folding infra from the delete_lazy branch [pr]
* sink base
* limit
2024-12-01 23:20:30 +08:00
ignaciosica
509c4a573f
increase tolerance on test ( #7972 )
2024-11-30 11:50:10 -05:00
qazal
ca20f281df
late folding size 0 ops ( #7940 )
...
* fold st size=0
* fold 0 here
* ops folding
* update realize
2024-12-01 00:40:02 +08:00
chenyu
c068e8c242
fetch cleanup ( #7970 )
...
reordered a bit to minimize the stuff in the with blocks
test manually with TestFetch and `DISABLE_HTTP_CACHE=1` on some examples
2024-11-30 11:00:33 -05:00
qazal
bb8e319680
unset TRACK_MATCH_STATS while initing beam buffers [pr] ( #7971 )
2024-11-30 23:56:58 +08:00
qazal
d0735d6489
swizzle store [pr] ( #7964 )
...
* swizzle store [pr]
* assign extra swizzle
* now arg is optional
* extra
2024-11-30 21:32:50 +08:00
qazal
6f17eedaea
schedule sink folding try 2 [pr] ( #7968 )
2024-11-30 20:46:26 +08:00
qazal
293e0f8a8e
make ASSIGN arg optional [pr] ( #7966 )
2024-11-30 19:40:33 +08:00
qazal
5615e92df8
const folding tests [pr] ( #7967 )
2024-11-30 19:27:30 +08:00
qazal
8780818d04
Revert "schedule sink folding with graph_rewrite [pr] ( #7963 )" ( #7965 )
...
This reverts commit 4529c5d0da
2024-11-30 19:02:06 +08:00
qazal
4529c5d0da
schedule sink folding with graph_rewrite [pr] ( #7963 )
...
* schedule sink folding with graph_rewrite [pr]
* x is reserved, use u
* match lazy const folding
2024-11-30 18:30:41 +08:00
nimlgen
10f431b96d
hcq replace update with sint ( #7899 )
...
* try sym hcq
* start with amd
* move to nv
* nv works
* cache and qcom
* fixes
* signals
* fix nv
* qcom fixes
* linter
* linter
* cache + typings
* fixes
* tiny fixes
* linter
* linter
* lntr
* ugh
* comments
2024-11-29 20:08:13 +03:00
chenyu
aa51f3c14e
update kernel counts in test_real_world ( #7960 )
...
the test was useless because it was looking at the jit graph counts. wrap with JIT=2 for now.
if it's stable we could consider making kernel count strict, which helps change like #7940
2024-11-29 11:14:54 -05:00
