github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-29 03:00:14 -04:00
Code Issues Packages Projects Releases Wiki Activity
12,536 Commits 248 Branches 14 Tags
82f7734501d7f2beff5548fa080e879c9c388277
Commit Graph

12536 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
chenyu
82f7734501 use backward_slice in reduce_mul_chain [pr] (#15186) 2026-03-08 21:44:53 -04:00
qazal
25e82a9aca viz: exclude redundant traceback from SDMA (#15185) 
* viz: exclude redundant traceback from SDMA

* ctx

* cpu_profile
 2026-03-09 05:12:14 +09:00
nimlgen
6ac99fd4c9 memplanner opt copy bufs (#15110) 
* mtp

* x

* tests

* ss

* simp

* less slop

* x

* cleaner

* rm

* m

* c

* x

* f
 2026-03-08 22:28:01 +03:00
nimlgen
633264feae am: flush sdma pipeline (#15184) 
* am: flush sdma pipeline

* f

* f

* fix
 2026-03-08 20:27:56 +03:00
b1tg
891a73befc llm: fix chunked prefill (#15182) 
* llm: fix chunked prefill

* less lines

---------

Co-authored-by: b1tg <b1tg@users.noreply.github.com>
 2026-03-07 22:08:31 +08:00
chenyu
5d58b1c396 don't use intermediate dict in onnx parse (#15181) 
also don't parse fields that are never used
 2026-03-07 00:08:03 -05:00
nimlgen
086081e35b tbgpu: add stapler to the script (#15180) 2026-03-07 00:07:27 +03:00
qazal
a03f512147 viz: clean up old / unused paths in sidebar rendering (#15179) 
* src is unused

* less
 2026-03-07 05:36:10 +09:00
chenyu
605b37c03f use backward_slice in count_divmod [pr] (#15178) 2026-03-06 14:03:53 -05:00
Ananta Ranganathan
5bdad8ee41 update mxfp4 tests to use the same patterns as the others (#15177) 
* update mxfp4 tests to use the same patterns as the others

* fix typo in test call not sure how it committed
 2026-03-06 13:21:40 -05:00
qazal
d85109f9f7 viz: walk PROGRAM UOp back to source and binary only (#15174) 
* work

* simpler
 2026-03-07 01:39:07 +09:00
Ananta Ranganathan
5c50035e0d avoid using arithmetic for mxfp4 (#15172) 
* avoid using arithmetic for mxfp4

* update tests to use assert equal

* no longer todo
 2026-03-06 11:17:56 -05:00
qazal
f064db0ac6 viz: later tooltip rendering (#15170) 2026-03-06 23:00:15 +09:00
Roelof van Dijk
4ed8bb7445 tie break for divmod (#15169) 2026-03-06 08:05:38 -05:00
qazal
83f1faa142 sqtt: update CDNA wave packet field, start unskipping tests (#15168) 
* correct field names

* packet types

* packet 5 is regc

* test skips
 2026-03-06 21:37:44 +09:00
Christopher Milan
7810be8d3c compile QCOM without opening device (#15165) 
Co-authored-by: Comma Device <device@comma.ai>
 2026-03-06 06:24:27 -05:00
George Hotz
6fd18ef875 rename CAT to VCAT (#15167) 2026-03-06 18:46:28 +08:00
Roelof van Dijk
059c6326c0 metal uint32 icb offset overflow (#15156) 
* metal uint32 icb offset overflow

fix: diff

supports_exec_item

GraphRunner.supports_exec_item

tests

fix: can't import on non-metal

stricter

* also test the non-metal buffer case

* imports on non-mac
 2026-03-06 00:54:39 +03:00
chenyu
da61088ca4 more divmod recombine (#15162) 2026-03-05 12:53:22 -05:00
chenyu
167a1d56a6 improve divmod folding (#15148) 
canonicalize to div than mod which enables more simplifcation
 2026-03-05 10:07:36 -05:00
Christopher Milan
b824579e4d simplify image_conv2d pitch alignment hacks (#15158) 2026-03-05 07:17:34 -05:00
qazal
5bf542469d viz: python traceback for USER device (#15160) 
* start

* ux

* unittests
 2026-03-05 20:22:09 +09:00
Roelof van Dijk
d65923bda5 tensor.py: add normalize function (#15159) 
* tensor.py: add normalize function

* p==0 should match torch
 2026-03-05 18:55:53 +08:00
wozeparrot
4544da1c54 llama3 fixes part3 (#15152) 2026-03-05 01:17:54 -08:00
Roelof van Dijk
fc0534910c q5k is like q4k (#15155) 2026-03-05 17:02:49 +08:00
Ananta Ranganathan
8ef656324e FIXED TEST Q5_K GGUF dequant (#15147) 
* q5_k gguf support as separate pr

* fix the problematic gemv test for q5_k

* add assert to make sure the gemv test cant fail with warning instead of error
 2026-03-05 16:32:36 +08:00
George Hotz
e97922a57c LLM speedup with two jits, prefill/rollout (#15153) 
* START_TIME

* print cleanup

* fix tests
 2026-03-05 16:21:09 +08:00
wozeparrot
be23772d43 llama3 fixes part2 (#15150) 2026-03-04 23:43:50 -08:00
wozeparrot
0c769289eb llama3: more scripts (#15107) 2026-03-04 22:18:03 -08:00
George Hotz
fb43b415f9 fix symbolic shape call + chunked prefill (#15149) 
* fix precompile for symbolic shape

* chunked prefill

* cleaner

* test that
 2026-03-05 14:02:26 +08:00
George Hotz
8a82b26522 llm: print the prefill cache size (#15146) 
* print the llm prefill cache size

* mock that too
 2026-03-05 12:13:28 +08:00
chenyu
b5370fd52d use copy_multi in alu_multi [pr] (#15143) 
* use copy_multi in alu_multi [pr]

* copy to anything
 2026-03-04 22:53:00 -05:00
George Hotz
72a9ed6e23 fix render depth bug + add warmup to serve + no realize default (#15144) 
* fix render depth bug + add warmup to serve

* make realize not the default
 2026-03-05 11:21:16 +08:00
George Hotz
ac1847cbf7 fully symbolic llm (#15097) 
* work

* llm symbolic (almost)

* work

* revert that

* llm sym

* works

* cleanups

* cache tokens with the kv cache

* cleanups

* cleanups
 2026-03-05 10:22:11 +08:00
qazal
33a1970045 sqtt: simplify inst mapping, validate JUMP processing in CI (#15139) 
* jump cleanup

* assert there's a JUMP

* new example for JUMP

* regenerate examples

* rdna4 work

* new packets

* work

* less for branch handling

* less verbose

* fix err message
 2026-03-05 09:53:12 +09:00
chenyu
04da527a7a minor div_and_mod_symbolic cleanups (#15138) 2026-03-04 19:05:44 -05:00
chenyu
106d18b792 use UOp methods in allreduce.py [pr] (#15137) 
except the one line with Ops.BUFFER and Ops.NOOP, not sure what that's for
 2026-03-04 17:15:33 -05:00
chenyu
34594bcaaf Revert "bug in metal: offset is stored as uint32, overflow (#15129)" (#15136) 
This reverts commit 9c58db16fa.
 2026-03-04 16:54:42 -05:00
Roelof van Dijk
9c58db16fa bug in metal: offset is stored as uint32, overflow (#15129) 
* metal uint32 icb offset overflow

* fix: diff

* supports_exec_item

* GraphRunner.supports_exec_item

* tests

* fix: can't import on non-metal
 2026-03-04 22:52:12 +03:00
chenyu
4cce283790 relax test_tqdm_perf (#15134) 2026-03-04 12:58:47 -05:00
chenyu
fae400d300 update assign tests to also test the expected behavior (#15132) 2026-03-04 11:34:43 -05:00
chenyu
1f96cc2b51 update non-contiguous buffer error message [pr] (#15131) 
* update non-contiguous buffer error message [pr]

also cleaned up the tests

* order
 2026-03-04 11:13:26 -05:00
nimlgen
563d5c3211 more graph tests (#15130) 2026-03-04 19:01:12 +03:00
nimlgen
cdc48da9cd hevc: assert and speed (#15122) 
* hevc: assert and speed

* simpler
 2026-03-04 19:01:02 +03:00
wozeparrot
4e9b85ecfd fa: pull inputs out of call (#15127) 2026-03-04 03:15:49 -08:00
George Hotz
47faa2d7b4 hotfix: llm kv cache uses clone instead of realize to avoid many realize 2026-03-04 19:07:03 +08:00
George Hotz
8ebd24637b fix fa forward building with clang 22 (#15124) 
* fix fa forward building with clang 22

* fix: override rocm path

---------

Co-authored-by: Woze Parrot <wozeparrot@gmail.com>
 2026-03-04 02:32:25 -08:00
Christopher Milan
592f9bf6c6 set OPENPILOT_HACKS=1 to enable replace assign (#15123) 2026-03-04 05:26:04 -05:00
wozeparrot
df23057984 fa: change bwd grid dim + unshuffle using mops (#15068) 2026-03-04 01:23:40 -08:00
Christopher Milan
5623cea7b1 move openpilot contiguous hacks to schedule (#15120) 2026-03-04 03:04:06 -05:00