github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-29 03:00:14 -04:00
Code Issues Packages Projects Releases Wiki Activity
12,523 Commits 248 Branches 14 Tags
4ed8bb7445fb34ac0fd13a8ea22263c30acbef79
Commit Graph

12523 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Roelof van Dijk
4ed8bb7445 tie break for divmod (#15169) 2026-03-06 08:05:38 -05:00
qazal
83f1faa142 sqtt: update CDNA wave packet field, start unskipping tests (#15168) 
* correct field names

* packet types

* packet 5 is regc

* test skips
 2026-03-06 21:37:44 +09:00
Christopher Milan
7810be8d3c compile QCOM without opening device (#15165) 
Co-authored-by: Comma Device <device@comma.ai>
 2026-03-06 06:24:27 -05:00
George Hotz
6fd18ef875 rename CAT to VCAT (#15167) 2026-03-06 18:46:28 +08:00
Roelof van Dijk
059c6326c0 metal uint32 icb offset overflow (#15156) 
* metal uint32 icb offset overflow

fix: diff

supports_exec_item

GraphRunner.supports_exec_item

tests

fix: can't import on non-metal

stricter

* also test the non-metal buffer case

* imports on non-mac
 2026-03-06 00:54:39 +03:00
chenyu
da61088ca4 more divmod recombine (#15162) 2026-03-05 12:53:22 -05:00
chenyu
167a1d56a6 improve divmod folding (#15148) 
canonicalize to div than mod which enables more simplifcation
 2026-03-05 10:07:36 -05:00
Christopher Milan
b824579e4d simplify image_conv2d pitch alignment hacks (#15158) 2026-03-05 07:17:34 -05:00
qazal
5bf542469d viz: python traceback for USER device (#15160) 
* start

* ux

* unittests
 2026-03-05 20:22:09 +09:00
Roelof van Dijk
d65923bda5 tensor.py: add normalize function (#15159) 
* tensor.py: add normalize function

* p==0 should match torch
 2026-03-05 18:55:53 +08:00
wozeparrot
4544da1c54 llama3 fixes part3 (#15152) 2026-03-05 01:17:54 -08:00
Roelof van Dijk
fc0534910c q5k is like q4k (#15155) 2026-03-05 17:02:49 +08:00
Ananta Ranganathan
8ef656324e FIXED TEST Q5_K GGUF dequant (#15147) 
* q5_k gguf support as separate pr

* fix the problematic gemv test for q5_k

* add assert to make sure the gemv test cant fail with warning instead of error
 2026-03-05 16:32:36 +08:00
George Hotz
e97922a57c LLM speedup with two jits, prefill/rollout (#15153) 
* START_TIME

* print cleanup

* fix tests
 2026-03-05 16:21:09 +08:00
wozeparrot
be23772d43 llama3 fixes part2 (#15150) 2026-03-04 23:43:50 -08:00
wozeparrot
0c769289eb llama3: more scripts (#15107) 2026-03-04 22:18:03 -08:00
George Hotz
fb43b415f9 fix symbolic shape call + chunked prefill (#15149) 
* fix precompile for symbolic shape

* chunked prefill

* cleaner

* test that
 2026-03-05 14:02:26 +08:00
George Hotz
8a82b26522 llm: print the prefill cache size (#15146) 
* print the llm prefill cache size

* mock that too
 2026-03-05 12:13:28 +08:00
chenyu
b5370fd52d use copy_multi in alu_multi [pr] (#15143) 
* use copy_multi in alu_multi [pr]

* copy to anything
 2026-03-04 22:53:00 -05:00
George Hotz
72a9ed6e23 fix render depth bug + add warmup to serve + no realize default (#15144) 
* fix render depth bug + add warmup to serve

* make realize not the default
 2026-03-05 11:21:16 +08:00
George Hotz
ac1847cbf7 fully symbolic llm (#15097) 
* work

* llm symbolic (almost)

* work

* revert that

* llm sym

* works

* cleanups

* cache tokens with the kv cache

* cleanups

* cleanups
 2026-03-05 10:22:11 +08:00
qazal
33a1970045 sqtt: simplify inst mapping, validate JUMP processing in CI (#15139) 
* jump cleanup

* assert there's a JUMP

* new example for JUMP

* regenerate examples

* rdna4 work

* new packets

* work

* less for branch handling

* less verbose

* fix err message
 2026-03-05 09:53:12 +09:00
chenyu
04da527a7a minor div_and_mod_symbolic cleanups (#15138) 2026-03-04 19:05:44 -05:00
chenyu
106d18b792 use UOp methods in allreduce.py [pr] (#15137) 
except the one line with Ops.BUFFER and Ops.NOOP, not sure what that's for
 2026-03-04 17:15:33 -05:00
chenyu
34594bcaaf Revert "bug in metal: offset is stored as uint32, overflow (#15129)" (#15136) 
This reverts commit 9c58db16fa.
 2026-03-04 16:54:42 -05:00
Roelof van Dijk
9c58db16fa bug in metal: offset is stored as uint32, overflow (#15129) 
* metal uint32 icb offset overflow

* fix: diff

* supports_exec_item

* GraphRunner.supports_exec_item

* tests

* fix: can't import on non-metal
 2026-03-04 22:52:12 +03:00
chenyu
4cce283790 relax test_tqdm_perf (#15134) 2026-03-04 12:58:47 -05:00
chenyu
fae400d300 update assign tests to also test the expected behavior (#15132) 2026-03-04 11:34:43 -05:00
chenyu
1f96cc2b51 update non-contiguous buffer error message [pr] (#15131) 
* update non-contiguous buffer error message [pr]

also cleaned up the tests

* order
 2026-03-04 11:13:26 -05:00
nimlgen
563d5c3211 more graph tests (#15130) 2026-03-04 19:01:12 +03:00
nimlgen
cdc48da9cd hevc: assert and speed (#15122) 
* hevc: assert and speed

* simpler
 2026-03-04 19:01:02 +03:00
wozeparrot
4e9b85ecfd fa: pull inputs out of call (#15127) 2026-03-04 03:15:49 -08:00
George Hotz
47faa2d7b4 hotfix: llm kv cache uses clone instead of realize to avoid many realize 2026-03-04 19:07:03 +08:00
George Hotz
8ebd24637b fix fa forward building with clang 22 (#15124) 
* fix fa forward building with clang 22

* fix: override rocm path

---------

Co-authored-by: Woze Parrot <wozeparrot@gmail.com>
 2026-03-04 02:32:25 -08:00
Christopher Milan
592f9bf6c6 set OPENPILOT_HACKS=1 to enable replace assign (#15123) 2026-03-04 05:26:04 -05:00
wozeparrot
df23057984 fa: change bwd grid dim + unshuffle using mops (#15068) 2026-03-04 01:23:40 -08:00
Christopher Milan
5623cea7b1 move openpilot contiguous hacks to schedule (#15120) 2026-03-04 03:04:06 -05:00
wozeparrot
759c7fc81c failing test for allreduce memory usage (#15106) 2026-03-03 23:38:38 -08:00
George Hotz
5ecfe549e7 allreduce is a function with LATE_ALLREDUCE=1 (#15119) 
* allreduce as a function

* allreduce function

* support allreduce function

* LATE_ALLREDUCE
 2026-03-04 15:17:58 +08:00
Christopher Milan
e7e70a3c95 simplify idx before counting backward_slice (#15117) 2026-03-03 23:53:50 -05:00
George Hotz
2d72a4a90c fix copying padded const (#15116) 
* fix const padding cpu

* remove comment
 2026-03-04 10:39:45 +08:00
chenyu
b5ebb4d06d contiguous_view_offset returns only offset [pr] (#15113) 
size is always input.size
 2026-03-03 15:23:39 -05:00
nimlgen
abd830b260 am: setup_rinf returns only doorbell (#15112) 2026-03-03 19:27:41 +03:00
nimlgen
4b42bb54aa am: reset sdma to start from 0 (#15109) 2026-03-03 18:14:46 +03:00
George Hotz
01ddb4c267 add precompile to call (#15099) 
* add precompile to call

* put get back

* something

* after structure

* alt

* keep it call

* resolve call

* resolve linear call

* precompile works with llm

* revert rangeify

* color for debugging

* getenv PRECOMPILE

* clean up deco pattern

* fully recursive sink scheduling

* revert llama

* fix SPEC=2
 2026-03-03 22:32:42 +08:00
qazal
c7f908b788 sqtt: fix rdna4 structs (#15111) 
* work

* DEBUG=2
 2026-03-03 23:32:14 +09:00
qazal
8dd691761d sqtt: remove old files (#15108) 2026-03-03 22:43:24 +09:00
Christopher Milan
de043226ba benchmark comma usbgpu driving_vision step and load time (#15103) 
Co-authored-by: Comma Device <device@comma.ai>
 2026-03-03 06:08:03 -05:00
Christopher Milan
5f6b610da1 FLOAT16 logic for IMAGE==1 goes back to image_conv2d (#15105) 2026-03-03 05:37:57 -05:00
wozeparrot
529318259c fix: fix null tests to actually use null device (#15104) 2026-03-03 02:05:47 -08:00