github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-29 03:00:14 -04:00
Code Issues Packages Projects Releases Wiki Activity
12,509 Commits 248 Branches 14 Tags
be23772d431abb24299a8bd332bc154ba496d736
Commit Graph

5236 Commits

Author SHA1 Message Date
George Hotz
fb43b415f9 fix symbolic shape call + chunked prefill (#15149) 
* fix precompile for symbolic shape

* chunked prefill

* cleaner

* test that
 2026-03-05 14:02:26 +08:00
George Hotz
8a82b26522 llm: print the prefill cache size (#15146) 
* print the llm prefill cache size

* mock that too
 2026-03-05 12:13:28 +08:00
George Hotz
72a9ed6e23 fix render depth bug + add warmup to serve + no realize default (#15144) 
* fix render depth bug + add warmup to serve

* make realize not the default
 2026-03-05 11:21:16 +08:00
George Hotz
ac1847cbf7 fully symbolic llm (#15097) 
* work

* llm symbolic (almost)

* work

* revert that

* llm sym

* works

* cleanups

* cache tokens with the kv cache

* cleanups

* cleanups
 2026-03-05 10:22:11 +08:00
qazal
33a1970045 sqtt: simplify inst mapping, validate JUMP processing in CI (#15139) 
* jump cleanup

* assert there's a JUMP

* new example for JUMP

* regenerate examples

* rdna4 work

* new packets

* work

* less for branch handling

* less verbose

* fix err message
 2026-03-05 09:53:12 +09:00
chenyu
04da527a7a minor div_and_mod_symbolic cleanups (#15138) 2026-03-04 19:05:44 -05:00
chenyu
34594bcaaf Revert "bug in metal: offset is stored as uint32, overflow (#15129)" (#15136) 
This reverts commit 9c58db16fa.
 2026-03-04 16:54:42 -05:00
Roelof van Dijk
9c58db16fa bug in metal: offset is stored as uint32, overflow (#15129) 
* metal uint32 icb offset overflow

* fix: diff

* supports_exec_item

* GraphRunner.supports_exec_item

* tests

* fix: can't import on non-metal
 2026-03-04 22:52:12 +03:00
chenyu
4cce283790 relax test_tqdm_perf (#15134) 2026-03-04 12:58:47 -05:00
chenyu
fae400d300 update assign tests to also test the expected behavior (#15132) 2026-03-04 11:34:43 -05:00
chenyu
1f96cc2b51 update non-contiguous buffer error message [pr] (#15131) 
* update non-contiguous buffer error message [pr]

also cleaned up the tests

* order
 2026-03-04 11:13:26 -05:00
nimlgen
563d5c3211 more graph tests (#15130) 2026-03-04 19:01:12 +03:00
Christopher Milan
592f9bf6c6 set OPENPILOT_HACKS=1 to enable replace assign (#15123) 2026-03-04 05:26:04 -05:00
wozeparrot
759c7fc81c failing test for allreduce memory usage (#15106) 2026-03-03 23:38:38 -08:00
George Hotz
2d72a4a90c fix copying padded const (#15116) 
* fix const padding cpu

* remove comment
 2026-03-04 10:39:45 +08:00
nimlgen
4b42bb54aa am: reset sdma to start from 0 (#15109) 2026-03-03 18:14:46 +03:00
George Hotz
01ddb4c267 add precompile to call (#15099) 
* add precompile to call

* put get back

* something

* after structure

* alt

* keep it call

* resolve call

* resolve linear call

* precompile works with llm

* revert rangeify

* color for debugging

* getenv PRECOMPILE

* clean up deco pattern

* fully recursive sink scheduling

* revert llama

* fix SPEC=2
 2026-03-03 22:32:42 +08:00
qazal
c7f908b788 sqtt: fix rdna4 structs (#15111) 
* work

* DEBUG=2
 2026-03-03 23:32:14 +09:00
qazal
8dd691761d sqtt: remove old files (#15108) 2026-03-03 22:43:24 +09:00
wozeparrot
529318259c fix: fix null tests to actually use null device (#15104) 2026-03-03 02:05:47 -08:00
wozeparrot
92c16810ac feat: per device mem_used (#15100) 2026-03-03 01:31:28 -08:00
b1tg
a9ea36de79 assembly/amd: v_cmp_lg_f32 is ordered not-equal (#14982) 2026-03-03 15:37:48 +08:00
wozeparrot
c35de9bd68 asm_gemm: support more sharding (#15002) 2026-03-02 23:16:37 -08:00
chenyu
5dcf29b1a0 use clone in test_swap_slices (#15096) 2026-03-02 22:05:12 -05:00
Christopher Milan
c70e8af068 move IMAGE FLOAT16 logic to allocations (#15095) 
* FLOAT16 logic in allocations

* cleanup

* separate that

* only apply when IMAGE == 1

* test passing now

* create image buffers earlier
 2026-03-02 22:00:05 -05:00
George Hotz
d483e4153a buffer view is like buffer (#15082) 
* buffer view is like buffer

* fix

* swap_reshape_shrink

* contiguous on gguf, fix overlap

* revert that

* _device_supports_view

* this

* fix that test

* 0 buffers

* that test was wrong

* this

* check correct size

* contig BUFFER_VIEW

* this

* fix tests

* buffer view tests

* om

* fix torch

* no MOCKGPU

* skip
 2026-03-03 09:52:33 +08:00
chenyu
14d1c5fdfd assign fusion tests on detach and contiguous_backward (#15092) 2026-03-02 15:21:51 -05:00
qazal
f7aeff6061 viz: cli.py cleanups, do not require PYTHONPATH (#15085) 
* cleanup the print

* sys.exit

* equal check

* cleanup unpacker

* cli doesn't need PYTHONPATH

* no semicolons

* %s/PYTHONPATH=. //g
 2026-03-02 19:24:38 +09:00
Christopher Milan
977c270774 IMAGE=1 kernel count failing tests (#15083) 2026-03-02 04:35:26 -05:00
George Hotz
3539693555 Support triu variable on diagonal + SDPA symbolic (#15081) 
* triu variable

* fails

* dumbbb

* no commutative in reshape

* real fix

* revert that

* sdpa symbolic tests
 2026-03-02 12:19:48 +08:00
Nick
8e8e9f6ff6 assert removal for _tri() + tests (#15073) 
* assert removal for _tri() and tests

* removed import

* tests triu/tril like in prefill

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2026-03-02 10:34:28 +08:00
nimlgen
ccbbca05ef beam: add dev_timeout for am (#15063) 
* beam: add dev_timeout for am

* all covered

* fk

* x

* fuzz

* reset

* f
 2026-03-01 16:57:29 +03:00
chenyu
103ea16ec0 add contiguous back to svd (#15074) 
can cause infinite loop
 2026-02-28 16:49:26 -05:00
chenyu
fe0fa8333b Revert "improve Tensor.sort indices (#15070)" (#15072) 
This reverts commit e3003631f2.
 2026-02-28 14:40:30 -05:00
chenyu
e3003631f2 improve Tensor.sort indices (#15070) 
* improve Tensor.sort indices

instead of N^2 match at the end, have an arange to start and go through the same N(logN)^2 path

* contiguous
 2026-02-28 14:16:16 -05:00
chenyu
76170d035a relax atol for test_xlm_roberta_large (#15066) 2026-02-28 11:22:35 -05:00
nimlgen
9b3450c9da test gpu crash on cdna (#15062) 2026-02-28 13:17:59 +03:00
George Hotz
bb84e389cf functions for llama trainer (#15045) 
* functions for llama trainer

* function there

* axis match

* fix multi

* lil cleaner

* there's a bug with HK_FLASH_ATTENTION

* training functions

* for commit
 2026-02-28 12:15:18 +08:00
chenyu
151608aa90 update test_multiple_to_single_device (#15056) 
follow up to #14482, add SCACHE=0 to the test
 2026-02-27 21:44:33 -05:00
chenyu
5fd06f4f02 differentiable setitem (#15054) 
* differentiable setitem

go through the where path for bw

* no return
 2026-02-27 17:25:15 -05:00
chenyu
db6b3e1edc fix mixed setitem with both basic and tensor indexing (#15050) 2026-02-27 15:35:48 -05:00
chenyu
c9f6d8751b don't remove_bufferize for Invalid (#15053) 
* don't remove_bufferize for Invalid

* replaced
 2026-02-27 15:16:09 -05:00
qazal
b8a55d5f68 sqtt: new packet types, add discovery script (#14960) 2026-02-28 04:27:27 +09:00
chenyu
1406d49eef failed test cases for advanced setitem (#15048) 2026-02-27 10:50:18 -05:00
qazal
ad99b77f6d assembly/amd: add gfx12_asm_vflat llvm tests, disasm fixes (#15046) 
* add gfx12_asm_vflat.s

* work
 2026-02-27 20:20:31 +09:00
George Hotz
010d2790ce fix multi minimal (#15044) 2026-02-27 14:31:58 +08:00
George Hotz
d23b79530e remove disk from GGUF GEMV test (#15041) 
* remove disk from GGUF GEMV test

* keep copy
 2026-02-27 12:03:00 +08:00
chenyu
d345f7f5dc remove _pending_assigns (#15040) 2026-02-26 22:38:10 -05:00
George Hotz
37e31e7da4 gguf gemv test (#15039) 
* add gemv tests

* gguf big

* skip

* make realize optional
 2026-02-27 10:54:43 +08:00
chenyu
0f94a4bb73 failed test case for early fixup const copy (#15038) 
* failed test case for early fixup const copy

wrong with PAD

* test no copy
 2026-02-26 19:09:33 -05:00