github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-14 09:28:04 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,106 Commits 203 Branches 14 Tags
python_speed
Commit Graph

11106 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
chenyu
940a8d5ba9 default IGNORE_OOB=1 (#12441) 
* default IGNORE_OOB=1

z3 can get very slow with RANGEIFY, also update some kernel numbers to what it is

* add to test
 2025-10-03 04:16:19 -04:00
George Hotz
d290e77a5b pend substitutes for speed (#12440) 2025-10-03 15:49:19 +08:00
nimlgen
23d310bcc1 ptx: handle i8/u8 casts correctly (#12439) 
* ptx: handle casts correctly

* notsetp
 2025-10-03 15:34:15 +08:00
hooved
1e8945a28c Training loop for Stable Diffusion mlperf (#12315) 
* add diff

* fix edit error

* match master

* point reference to specific commit

* simplify wandb logging

* remove lr test, dehardcode device

* increase stack size limit
 2025-10-03 02:45:38 -04:00
George Hotz
c7849ac593 fix test lil model (#12437) 
* fix test lil model

* 4 not 3
 2025-10-03 02:28:37 -04:00
chenyu
0f82d92b9d use float for softmax in llm.py (#12438) 
fixed numerical issue in `CPU=1 RANGEIFY=1 python3 -m tinygrad.apps.llm`
 2025-10-03 02:27:56 -04:00
George Hotz
4c63f7e786 skip copies of reshaped buffers (#12430) 
* skip copies of reshaped buffers

* always run NOOP

* comment

* comment
 2025-10-03 13:05:47 +08:00
Sieds Lykles
0047bcc535 undo loaded comparison swap (#12436) 
* add rule

* add a test
 2025-10-03 06:57:29 +02:00
chenyu
f203d8b221 update RANGEIFY kernel count and test_masked_select (#12435) 2025-10-03 00:41:34 -04:00
wozeparrot
a6dd5a224b skip webgpu tests (#12433) 2025-10-02 21:31:07 -07:00
chenyu
bf99de7b1e update a few more tests for RANGEIFY (#12434) 2025-10-03 00:16:58 -04:00
George Hotz
9cd365c12e little changes from double gemm (#12429) 
* little changes from double gemm

* split pm_group_for_reduce

* pm_add_buffers_local

* Revert "pm_add_buffers_local"

This reverts commit 4d30a91db2.
 2025-10-03 10:31:51 +08:00
Sieds Lykles
16a65b4fd0 fix test_symbolic_gcd_div hang (#12427) 2025-10-03 04:21:16 +02:00
chenyu
2d24af888b REWRITE_STACK_LIMIT (#12426) 2025-10-02 21:51:04 -04:00
hooved
1b58ef0d60 Increase stack size limit in unified_rewrite (#12424) 
* increase stack size limit

* rerun CI due to random tqdm test fail
 2025-10-03 09:06:47 +08:00
qazal
17d36d0952 don't tag MSTACK/MSELECT on global buffers (#12423) 
* don't tag MSTACK/MSELECT

* fix
 2025-10-02 13:32:15 +03:00
chenyu
7b3912d8e4 relax atol for some tests (#12422) 2025-10-02 05:04:44 -04:00
chenyu
98163832e4 update RANGEIFY test_cast_padded (#12421) 
* update RANGEIFY test_cast_padded

* update test
 2025-10-02 04:37:35 -04:00
chenyu
37beef6de3 add null bert training test in ci (#12420) 
fails with RANGEIFY `RuntimeError: children not making progress`
 2025-10-02 04:05:19 -04:00
qazal
f21851b099 ops: n^2 .device property fix (#12419) 
* test case for a long rand chain

currently failing with RANGEIFY because device propogates too deep

* skip

* ops: n^2 .device property fix

* unskip

---------

Co-authored-by: Chen-Yu Yang <chenyu@fastmail.com>
 2025-10-02 03:28:12 -04:00
b1tg
ec177c80c2 rangeify: fix test_where_fold (llvm) (#12416) 
* rangeify: fix test_where_fold (AMD_LLVM)

* rm comment
 2025-10-02 02:57:49 -04:00
qazal
13a25b2e67 rangeify: don't shape INDEX on kernelize (#12417) 2025-10-02 09:45:37 +03:00
hooved
5d9035f5a6 Eval for Stable Diffusion mlperf (#12316) 
* add diff

* rerun ci

* refactor beam workaround, add test

* fix conflict

* linting
 2025-10-02 02:35:38 -04:00
hooved
0f804c9a83 Stable Diffusion model init for mlperf (#12314) 
* include clip pr diff

* updated unet and sd init

* dehardcode default device

* revert beam hang workaround

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
 2025-10-02 02:28:41 -04:00
George Hotz
0eee93f0c0 hotfix: disable split ranges for non rangeify 2025-10-02 13:15:24 +08:00
George Hotz
583553f467 split ranges (#12411) 
* split ranges

* simpler

* split ranges

* range str

* fix test

* oops

* faster

* no group 2

* tests

* dont_sub_ranges_for_image

* revert that
 2025-10-02 12:57:22 +08:00
qazal
6fc6b51b59 fix limit_bufs with kernelize (#12415) 2025-10-02 07:49:11 +03:00
qazal
d1c868f990 fix limit_bufs with multi (#12414) 2025-10-02 05:51:56 +03:00
qazal
2fcd55583f allow less kernels in external_test_opt (#12412) 
* allow less kernels in external_test_opt

* this was always 2
 2025-10-02 05:05:42 +03:00
qazal
8b48e19ce2 skip more multi remote tests (#12410) 2025-10-02 04:50:46 +03:00
George Hotz
3770dd9d80 annotate bufferize in viz 2025-10-02 09:20:50 +08:00
qazal
5b649616ff rangeify: detect and assert cycles (#12405) 
* rangeify: assert cycles

* rng=2

* any
 2025-10-02 03:39:43 +03:00
Sieds Lykles
9a64fc0d28 Load alt value with cast try 2 (#12407) 
* add or_casted

* add tests and fix old tests

* cast load

* move that to pm_render

* add allow_any_len to gated load patterns in renderers

* slice [:2]
 2025-10-02 00:55:29 +02:00
nimlgen
3e0e0290ce increase timeout in test_module_runs (#12408) 2025-10-01 22:01:44 +03:00
Sieds Lykles
2f8ac77c25 add allow_any_len to gated load patterns in renderers (#12406) 2025-10-01 20:35:32 +02:00
George Hotz
89bed28716 split reduceop (#12404) 
* some rangeify tests fixed

* bring split reduceop to rangeify

* fix tests
 2025-10-01 18:45:16 +08:00
George Hotz
74ee305948 some rangeify tests fixed (#12403) 2025-10-01 18:23:37 +08:00
qazal
f198a9e1ba skip test_multihost_aware_schedule, assign devices mismatch (#12396) 
* minimal failing remote test

* this should've never worked?

* skip that test
 2025-10-01 13:09:15 +03:00
b1tg
ac3d457d5e rangeify: TestReduceOpsConstFolding (#12397) 
Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2025-10-01 17:58:19 +08:00
George Hotz
60e52fbe36 support opts in contig, simpler (#12400) 2025-10-01 17:20:04 +08:00
chenyu
6c95b1f39d explicitly set device for CI unit test (#12399) 2025-10-01 05:16:54 -04:00
chenyu
6ba8bf282f skip test_masked_select for RANGEIFY PYTHON (#12395) 2025-10-01 04:13:31 -04:00
chenyu
689ab9151b more RANGEIFY tests (#12393) 
would have caught the load alt regression without adding too many tests
 2025-10-01 03:43:58 -04:00
chenyu
adc8c3b28f Revert "load alt value with cast (#12384)" (#12392) 
This reverts commit 05e91a248d.
 2025-10-01 03:20:04 -04:00
b1tg
154d114364 rangeify: fix abstractions2.py (#12386) 
* rangeify: fix abstractions2.py

* tests

* lint

* only abstractions2

* base
 2025-10-01 09:58:56 +03:00
George Hotz
fe96c8d345 add HALF flag to tinygrad.apps.llm 2025-10-01 14:44:59 +08:00
George Hotz
f205352cd7 remove ranges with 1s (#12388) 
* use op_in_parents

* remove the ranges of 1

* fix CL image thing

* fix realize
 2025-10-01 14:43:29 +08:00
qazal
90b1c0dd96 rangeify: test_where_fold kernel count (#12379) 
* rangeify: test_where_fold kernel count

* get these from the index

* replace ranges

* fine

* movement ops

* diff

* better
 2025-10-01 09:35:12 +03:00
b1tg
42748ccb92 rangeify: fix test_prequant_conv2d_1x1 (#12391) 2025-10-01 02:33:47 -04:00
Sieds Lykles
05e91a248d load alt value with cast (#12384) 
* add or_casted

* add tests and fix old tests

* cast load

* move that to pm_render
 2025-10-01 07:14:26 +02:00