github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-29 03:00:14 -04:00
Code Issues Packages Projects Releases Wiki Activity
12,239 Commits 248 Branches 14 Tags
db3db476ffdb2d568a588c92b7f694f7dbf38ad6
Commit Graph

12239 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
qazal
db3db476ff viz: add GB/s to SDMA (#14795) 
* work

* better

* fix that

* no decimal
 2026-02-16 20:09:20 +09:00
qazal
2b36708c6d viz: split all long labels with ... (#14794) 2026-02-16 19:18:42 +09:00
qazal
d213fe95a0 viz: integer ticks on the x axis, fix small cycle numbers (#14792) 2026-02-16 18:07:40 +09:00
George Hotz
47d39a6b8b add sqtt support to the emulator (#14791) 
* add sqtt support to the emulator

* more sqtt

* cleanup

* cleanups

* simpler tests

* some decent tests

* test branch
 2026-02-16 16:48:26 +08:00
wozeparrot
45aebe1572 hipkittens fa backward (#14723) 2026-02-16 00:38:44 -08:00
Nicolas Pinto
20b658b786 fuse MULACC after MUL->SHL (#14788) 
* decompositions: fuse (x << n) + c to MULACC

MUL→SHL converts x*(2^n) to x<<n before MULACC can fuse (x*c)+y.
Add pattern to also fuse (x<<n)+c → MULACC(x, 2^n, c) for backends
that support both MULACC and SHL.

* test: add test_mulacc_shl for SHL->MULACC fusion

* test: relax test_mulacc_unrolled to >= 4

SHL->MULACC fusion now also catches power-of-2 address calculations,
increasing MULACC count from 4 to 6 on PTX. the test's intent is that
each unrolled multiply is individually fused (not grouped), so >= 4
is the correct assertion.

---------

Co-authored-by: Prithvish <deformercoding@gmail.com>
Co-authored-by: Nicolas Pinto <41171+npinto@users.noreply.github.com>
Co-authored-by: Nicolas Pinto <npinto@mbp23.local>
 2026-02-16 16:26:44 +08:00
qazal
ac62d28ddc viz: amdgpu arch cleanup (#14790) 
* viz: amdgpu arch cleanup

* don't do that

* simpler sqttmap

* work

* self.arch
 2026-02-16 16:48:12 +09:00
George Hotz
401095e3e7 emulator barrier tests (#14789) 2026-02-16 15:31:01 +08:00
qazal
c7a4dbf918 viz: get program binary from the UOp (#14787) 
* viz: get program binary from the UOp

* remove that

* less

* rename View Program to View Source

* two words

* fix
 2026-02-16 15:46:58 +09:00
Bautista Garcia
0f1ca8eb43 torch_load: fix shared storage slicing (#14771) 
* faster zip_extract + usage in torch load

* clean zip in torch load

* working zipextract in torchload

* tar_extract in tar path

* faster tar path

* tests passing, cleanup needed

* faster tar with 1MB buffer

* comments

* unify storage_source with all paths

* use bufferedreader in zip path

* fix ruff

* clean

* removed unnecessary string conversion

* fix for tensors that share storage

* less hacky

* shared storage test

* test comment

* linter

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2026-02-16 14:30:13 +08:00
George Hotz
dff9cf35c2 amd asm emulator fixes + run it in CI (#14786) 
* amd asm fix, try 2

* fix tests
 2026-02-16 13:24:21 +08:00
qazal
55a4dfa2e0 cdna4 asm_gemm tests in CI on the null backend (#14785) 
* cdna4 asm_gemm tests in CI on the null backend

* no .numpy() in null

* better

* gemm/asm: device comes from renderer
 2026-02-16 14:06:23 +09:00
qazal
c2be31e75b move Estimates to rewrite rules [pr] (#14782) 
* move Estimates to rewrite rules [pr]

* don't need this cached_property

* tuple

* return
 2026-02-16 12:59:42 +09:00
George Hotz
0abcb9aac2 move more to mixins (#14780) 
* move more to mixins

* revert

* move some

* do not change

* more

* fix tests

* Revert "more"

This reverts commit d942d59fa4.

* go

* work

* more

* work

* guard

* base
 2026-02-16 11:35:00 +08:00
qazal
8e7c5f5b09 remove Tensor.training = True in test_arange (#14781) 2026-02-16 11:19:42 +09:00
kevvz
33b2ade8cd Rdna4 emulator test_ops, dtypes pass (#14773) 
* test_ops, test_dtypes pass

* merge cdna4

* ruff + more tests

* reorganize

* /backend

* again

* again...

* add rdna4
 2026-02-16 10:13:39 +08:00
qazal
156b6cb7e4 native bf16 cast in cdna4 (#14574) 
* native bf16 cast in cdna4

* don't need contig backward

* simpler

* contig bw still wins in those cases
 2026-02-16 10:51:32 +09:00
chenyu
3adb5062c5 clean up assign_to_contiguous [pr] (#14779) 
slice hazard is handled in fix_assign_hazard
 2026-02-15 20:45:49 -05:00
George Hotz
bd18217f32 add rdna3/rdna4/cdna4 to testamd (#14778) 
* add rdna3/rdna4/cdna4 to testamd

* test simplify

* ci cleanups

* mergable

* skip slow
 2026-02-16 09:45:16 +08:00
George Hotz
ac079e43d7 ElementwiseMixin (#14777) 2026-02-16 08:50:47 +08:00
Christopher Milan
9c95a11f90 autogen: handle rocm bump and better error wording (#14776) 
* autogen: handle rocm bump and better error wording

* regen
 2026-02-15 19:23:47 -05:00
chenyu
1ded250bbe remove collapse_nested_assign [pr] (#14775) 
the else branch is dead code, and we can check directly with UPat
 2026-02-15 18:04:47 -05:00
chenyu
17db43ab46 remove some contiguous call in frontend (#14772) 
these should work without contiguous
 2026-02-15 16:33:56 -05:00
nimlgen
26193cbf9a nv: prof cpu_access for nvd only (#14769) 2026-02-15 21:42:04 +03:00
qazal
33b31d9cd6 tinykittens flash attention dtype fix, add CI (#14770) 
* don't hardcdoe amd device

* add failing tests, ci too

* fix: fix for dtype mixin

* bump to rocm 7.1

---------

Co-authored-by: Woze Parrot <wozeparrot@gmail.com>
 2026-02-16 01:15:11 +09:00
chenyu
352845d8cc update cast to uint tests (#14768) 
result in valid range should work, add intermediate cast to NIRRenderer since it's UB for [128, 256)
 2026-02-15 10:55:13 -05:00
qazal
ceccc8eb86 unskip now passing multi tests [pr] (#14759) 2026-02-15 20:30:00 +09:00
George Hotz
713143a46a more mixins pt 2 (#14765) 
* more mixins pt 2

* lil cleanups
 2026-02-15 17:57:04 +08:00
qazal
9da7f5e733 disable process replay for AMD emulator renderer [pr] (#14766) 
* disable process replay for AMD emulator renderer [pr]

* line

* skip
 2026-02-15 18:52:37 +09:00
George Hotz
9759fd6193 dtype mixin (#14763) 
* dtype mixin

* dtype mixin methods
 2026-02-15 16:03:48 +08:00
qazal
42b6bf0b7a fix sdpa causal failing test on multi (#14762) 
* simple failing test

* device is from xq
 2026-02-15 16:54:33 +09:00
George Hotz
8091661df3 more more to mixins (#14761) 2026-02-15 15:18:37 +08:00
George Hotz
0e215c433d remove hack from cast (#14760) 
* remove hack from cast

* skip tests

* linters to 3.12, another skip

* fix rand

* m_
 2026-02-15 13:56:38 +08:00
George Hotz
d176af6269 start outerworld call test, fix gate (#14758) 2026-02-15 12:35:01 +08:00
qazal
9bb6014900 keep existing profile trace in viz cli (#14757) 2026-02-15 13:16:32 +09:00
chenyu
ca68037f26 lazy basic setitem to unrealized Tensor (#14756) 
undo the view and make it a mask, this fuses the setitem with any pending compute too.

one behavior change is that for target not backed by a buffer (const and arange), rangeify makes output contiguous under the hood.
this is stricter better than raise and ask user to call contiguous, as that would no longer be fuse-able.
 2026-02-14 20:27:03 -05:00
George Hotz
32980c74d1 hotfix: skip flaky tests, looped many times on tinymac3 2026-02-15 07:46:29 +08:00
chenyu
902dc7c09c fix test_numpy_parity_and_backward_2d (#14755) 
test setup issue, test failed locally with `RUN_SLOW=1`
 2026-02-14 17:59:00 -05:00
chenyu
043f5dbfa0 fix write-after-read tracking (#14754) 
AFTER-AFTER was silently dropped, which breaks write-after-read
 2026-02-14 17:23:05 -05:00
chenyu
d79c63a0ff test_multi_step_assign_read_write_same_buffer (#14752) 
pattern in LAMB that can be off subtly
 2026-02-14 16:39:08 -05:00
chenyu
95f4c7e90a fix limit_bufs to not limit index (#14751) 
index is not real buffer. also made MAX_KERNEL_BUFFERS a ContextVar
 2026-02-14 16:00:03 -05:00
chenyu
0ce4a55dad clean up test_setitem_slice (#14750) 
moved to test_setitem_schedule, and use contiguous zeros as scheduler handles empty differently now
 2026-02-14 14:29:16 -05:00
chenyu
8f6772fd8c more setitem kernel mem tests (#14749) 
* more setitem kernel mem tests

test only the slice is accessed

* update
 2026-02-14 11:01:03 -05:00
chenyu
446909fb7a more setitem kernel tests (#14748) 
check where realize happened
 2026-02-14 09:57:46 -05:00
nimlgen
4ab51b55bd stream pma decoder (#14746) 2026-02-14 17:40:18 +03:00
nimlgen
e1a18dadae fix devices for copies (#14747) 
* fix devices for copies

* add test
 2026-02-14 17:39:41 +03:00
George Hotz
e35bd960e8 Revert "use zip_extract and tar_extract in torch load (#14734)" (#14745) 
This reverts commit 9d9ef81608.
 2026-02-14 13:24:01 +08:00
Christopher Milan
eaa9506a00 disallow subnormals in emulated test_dtype (#14744) 2026-02-14 00:11:57 -05:00
Bautista Garcia
9d9ef81608 use zip_extract and tar_extract in torch load (#14734) 
* faster zip_extract + usage in torch load

* clean zip in torch load

* working zipextract in torchload

* tar_extract in tar path

* faster tar path

* tests passing, cleanup needed

* faster tar with 1MB buffer

* comments

* unify storage_source with all paths

* use bufferedreader in zip path

* fix ruff

* clean

* removed unnecessary string conversion
 2026-02-14 12:57:28 +08:00
qazal
c88bb075f0 hotfix: correct way to get renderer arch (#14743) 2026-02-14 12:38:20 +08:00