github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-15 01:48:23 -05:00
Code Issues Packages Projects Releases Wiki Activity
10,808 Commits 204 Branches 14 Tags
replace_if_with_range
Commit Graph

4581 Commits

Author SHA1 Message Date
George Hotz
bb7aa19d67 Merge branch 'master' into replace_if_with_range 2025-10-28 23:02:15 +08:00
George Hotz
5e01cc299b zero len ranges fail (#12974) 
* zero len ranges fail

* fix Python backend

* fix llvm

* fix ptx

* yolo fix nir

* this works...

* always store...

* always store...

* Revert "always store..."

This reverts commit 0816cf344d.
 2025-10-28 22:49:55 +08:00
George Hotz
d0de209ad0 don't brick on that 2025-10-28 18:49:00 +08:00
George Hotz
f5a3b33d33 add fun with nhwc convs 2025-10-28 17:12:22 +08:00
George Hotz
907499b02c clean up GROUP/SINK (#12969) 
* clean up GROUP/SINK

* fix end

* range_str color
 2025-10-28 16:08:10 +08:00
Sieds Lykles
e22c5e7e73 process_replay uses opts argument for KernelInfo.opts_to_apply (#12946) 
* opts_to_apply is opts

* skip beamed kernels

* simpler change

* fix the tensor cores tests for process replay

* use opts
 2025-10-28 09:00:28 +01:00
George Hotz
b0da173f2f add unique to const, fix longstanding bug (#12965) 
* add unique to const, fix longstanding bug

* _force_unique=True

* fix tests

* fix more tests
 2025-10-28 15:11:37 +08:00
Sieds Lykles
e110f4632a split cat (on cpu) (#12864) 
* split ranges but only on cpu

* except KernelOptError for threads

* use GROUP and END

* no more flatten_range needed

* remove noop end

* always process replay for openpilot

* update test

* skip test

* fix in outs calculation

With the new linearizer the toposort is a problem, this matches the spec
now

* undo that
 2025-10-28 07:55:19 +01:00
George Hotz
4d817a289e simplify spec (#12958) 
* simplify spec

* more
 2025-10-28 09:52:32 +08:00
chenyu
a79832b01f control_flow.py -> linearizer.py [pr] (#12948) 2025-10-27 12:38:13 -04:00
George Hotz
25c2da1579 check SPEC=2 in CI (#12945) 
* check SPEC=2 in CI

* split SPEC=2

* fast enough
 2025-10-27 21:53:57 +08:00
George Hotz
701a632907 move VECTORIZE/CONST (#12942) 2025-10-27 17:37:13 +08:00
George Hotz
804133cffd rename RECIP to RECIPROCAL (#12939) 2025-10-27 16:53:13 +08:00
chenyu
e18922f111 limit AND const min max to ints [pr] (#12918) 2025-10-25 16:07:52 -04:00
George Hotz
b4f6a2c7a3 add kernel spec (#12911) 
* add kernel spec

* fix kernel spec
 2025-10-25 11:49:20 +08:00
George Hotz
8a941d95a4 SPEC=2 is full spec, SPEC=1 is default (#12910) 
* SPEC=1 passes all tests

* just use SPEC, not __debug__
 2025-10-25 11:10:43 +08:00
chenyu
4b7329001d clean up test_avg_pool3d (#12905) 2025-10-24 14:31:36 -04:00
George Hotz
6b35467f53 stores don't end ranges (#12902) 
* early endrange

* bugfixes
 2025-10-24 23:05:03 +08:00
Sieds Lykles
e1f8c82938 Onnx Layer/Group/RMS/Batch-Norm ReduceL2 fp32 intermediates for fp16 (#12109) 
* match onnx spec

* use least_upper_dtype

* promote the square

* just cast before the square
 2025-10-24 12:26:11 +02:00
George Hotz
0bde87d8d7 cleanups from flash attention branch (#12897) 2025-10-24 14:14:56 +08:00
wozeparrot
9dac505565 variable bs keccak (#10731) 2025-10-23 14:10:21 -07:00
Sieds Lykles
c1db62ff7c move reduce collapse to rangeify (#12845) 2025-10-23 15:44:17 +02:00
George Hotz
ff68a6263b move locals into codegen (dedup works) (#12885) 
* move locals into codegen (dedup works)

* move in optimize
 2025-10-23 17:07:39 +08:00
George Hotz
ddb53d1d48 PCONTIG=3 both saves ram and flops (#12884) 
* PCONTIG=3 both saves ram and flops

* group

* gate locals

* should be correct
 2025-10-23 16:37:26 +08:00
George Hotz
e85cee0aad flip Ops.END srcs (#12882) 
* flip Ops.END srcs

* backward

* late end split
 2025-10-23 12:47:50 +08:00
George Hotz
74b4cfe44b Ops.GROUP + range check (#12880) 
* simpler

* fix that

* Ops.GROUP + range check

* fix bugs

* fix linter

* fix test
 2025-10-23 12:05:21 +08:00
George Hotz
7762b3558b clean up the spec (#12868) 
* tighten up the spec

* move validate into a different file

* that moved to validate

* after(barr)
 2025-10-22 19:50:42 +08:00
George Hotz
726988fa4b late ifs try 2 (#12865) 
* late ifs try 2

* fix image

* fix that test

* panic

* ptx fixups

* preserve toposort

* those pass locally

* Revert "those pass locally"

This reverts commit 063409f828.

* no ls

* make that explicit
 2025-10-22 18:49:27 +08:00
Sieds Lykles
8d0256c46b Move gate to load for loaded index (#12861) 
* change condition

* change test to better represent how the uop looks irl
 2025-10-22 09:53:07 +02:00
George Hotz
92778c7a8b rename opts to ren, add store ranges back (#12856) 
* rename opts to ren

* fix docs and bring store back
 2025-10-22 09:15:38 +08:00
b1tg
60d7e232f2 cuda fp8 (#12782) 
* cuda fp8

* tensor core

* tc test

* clean

* clean pm
 2025-10-21 15:05:25 -04:00
chenyu
8baa61bd67 use torch 2.9 and its Muon in test (#12773) 
* use torch 2.9 and its Muon in test

* relax and disable
 2025-10-21 13:35:17 -04:00
chenyu
f51f9aaa16 muon ns_params -> ns_coefficients (#12850) 
match the official torch one
 2025-10-21 12:35:52 -04:00
wozeparrot
62e7b8b870 feat: just use compile3 (#12849) 2025-10-21 07:56:50 -07:00
George Hotz
8960ac54f3 remove RewriteStep premature optimization (#12840) 
* remove RewriteStep premature optimization

* fix ebs

* core line count
 2025-10-21 21:45:20 +08:00
Sieds Lykles
7f798a9630 Cleanup const buffers (#12829) 
* split pm_cleanups

* update test_schedule

* shrink when we remove bufferize

* dont do shrink if shape is empty

* update tests

* remove *1 from metadata

* deal with the noop bufferize

* only noop on cvar

* cleanup

* fix if

* rename
 2025-10-21 14:53:49 +02:00
George Hotz
20a232f1c5 bugfixes from multioutput + PCONTIG=3 for fa bw memory fix (#12837) 
* bugfixes from multioutput

* PCONTIG=3 fixes fa memory usage

* that's base
 2025-10-21 19:21:02 +08:00
George Hotz
7d9551ce2e move to late/control_flow.py (#12835) 2025-10-21 18:15:06 +08:00
George Hotz
d711a4b933 delete old linearizer (#12834) 
* new linearizer with early endrange

* cleanups

* second stage removal

* not store

* do that later

* end cleanup

* fix globals

* end

* multi end

* fix ends earlier

* work

* do_merge_ends

* mini change

* range_gate

* fix cpu

* test fixups

* ranges on index

* not for ptx

* delete linearizer

* remove more junk

* delete that test

* we insert endif

* all ends
 2025-10-21 17:52:18 +08:00
George Hotz
c780cd9abb new linearizer with early endrange (#12823) 
* new linearizer with early endrange

* cleanups

* second stage removal

* not store

* do that later

* end cleanup

* fix globals

* end

* multi end

* fix ends earlier

* work

* do_merge_ends

* mini change

* range_gate

* fix cpu

* test fixups

* ranges on index

* not for ptx
 2025-10-21 17:37:48 +08:00
George Hotz
d59d4cdbe4 lil less is okay 2025-10-21 17:09:44 +08:00
qazal
32af1ff84b viz graph drawing small cleanups (#12830) 
* viz graph drawing small cleanups

* str literal
 2025-10-21 15:51:32 +08:00
George Hotz
a71a41f6d1 rename Ops.ENDRANGE -> Ops.END (#12824) 2025-10-21 11:32:18 +08:00
George Hotz
203a93363c Revert "after clean up of locals (#12813)" (#12814) 
This reverts commit 5d0d3d7aac.
 2025-10-20 19:33:35 +08:00
George Hotz
5d0d3d7aac after clean up of locals (#12813) 2025-10-20 19:24:24 +08:00
Sieds Lykles
a8e4614436 remove REAL_SUBSTITUTE=0 and make it fast (#12809) 
* fast REAL_substitute

* remove REAL_SUBSTITUTE=0
 2025-10-20 12:44:20 +02:00
George Hotz
2e9082e0bc after op (#12801) 
* after op

* fix tests
 2025-10-20 12:27:56 +08:00
George Hotz
ba593f7b98 don't render index (#12796) 
* don't render index

* update to ignore_indexing

---------

Co-authored-by: qazal <qazal.software@gmail.com>
 2025-10-20 09:48:36 +08:00
chenyu
63a23dfe80 test step 0 in TestTrainingOnnxOps (#12790) 
and tighter rtol
 2025-10-19 09:15:49 -04:00
chenyu
e8158afd4b update test_qlinear_add_round_half_to_even (#12789) 
this does not pass locally
 2025-10-19 08:47:27 -04:00