github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-02-02 18:54:58 -05:00
Code Issues Packages Projects Releases Wiki Activity
10,417 Commits 212 Branches 14 Tags
reprocess_node_experiments
Commit Graph

10417 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
qazal
ee5fe12630 disallow some uops at different levels [run_process_replay] (#6186) 
* assert intermediate ones

* assert low-level uops
 2024-08-19 21:23:44 +03:00
samm393
5d742f7fe3 Missing features from rearrange (#6184) 
* fixes and tests

* typo in test
 2024-08-19 11:19:07 -07:00
qazal
2242ff84be type verify intermediate UOps [run_process_replay] (#6140) 
* type verify intermediate UOps [run_process_replay]

* merge asserts

* variable const
 2024-08-19 20:59:01 +03:00
qazal
478145cb8e lowering error in diff_schedule is fine [run_process_replay] (#6185) 2024-08-19 20:51:12 +03:00
chenyu
00578a021b re:6125 switch real_size to use uops [run_process_replay] (#6138) 
* switch real_size to use uops [run_process_replay]

* enough to pass

---------

Co-authored-by: George Hotz <geohot@gmail.com>
 2024-08-19 13:20:24 -04:00
qazal
e28d29641f more scheduler process replay tooling [run_process_replay] (#6178) 2024-08-19 15:35:51 +03:00
chenyu
b36a7273c6 RUF018 assignment-in-assert [run_process_replay] (#6172) 
assertion should not have side effect or `-O` breaks.

initially just wanted to fix the one in rearrange, but it also made some long lines less long
 2024-08-19 00:34:52 -04:00
chenyu
9c60a27ece lower float64 sin fuzzer threshold (#6173) 
139216373.71875 failed
https://github.com/tinygrad/tinygrad/actions/runs/10446960642/job/28925156240
 2024-08-19 00:25:42 -04:00
samm393
fd7c84c1c8 Rearrange (#6106) 
* rearrange and tests

* tidy

* whitespace

* remove line

* -5 lines

* test fix

* static -> instance

* fix () & add more tests

* remove flags

* -1 line

* match einops

* whitespace

* repeated names
 2024-08-18 20:22:28 -07:00
chenyu
2de174677a threefry touchup [run_process_replay] (#6169) 
also why is test_gc testing _rng_counter is allocated??
 2024-08-18 23:01:24 -04:00
David González Martínez
724e408736 add support for retain_graph in backward (#6145) 
* add support for retain_graph in backward

* fix: dont accumulate grad on non-leaf tensors

* fix order

* fix: do not delete grad on leafs

* fix linter

* fix: can't exactly match torch behaviour internally

* allow numerical room for test

* refactor
 2024-08-18 16:08:31 -07:00
wozeparrot
0c5189de25 threefry half (#6154) 2024-08-18 15:23:12 -07:00
qazal
fad1818530 move graph rewrite to ops [run_proess_replay] (#6159) 
* move graph rewrite to ops [run_proess_replay]

* better place
 2024-08-18 20:02:28 +03:00
Timmy
e3d14d1ccc Lowerer Multireduce Grouping (#6097) 
* grouping changes to codegen

* linters + tests

* fix identical store issue on PTX

* comment in grouping multireduce tests

* cleaning up diff

* cleaning up diff

* comments

* linters

* hotfix: dont change kernels

---------

Co-authored-by: qazal <qazal.software@gmail.com>
 2024-08-18 19:57:51 +03:00
qazal
1ba83cc7fa split test_sgd_4convs_fuse [run_process_replay] (#6158) 2024-08-18 18:35:42 +03:00
qazal
be6dda4093 hotfix: more lazyop rename to uop [run_process_replay] (#6157) 2024-08-18 17:28:44 +03:00
George Hotz
17a043edad tensor inference (#6156) 
* tensor inference

* test is even better name
 2024-08-18 00:19:28 -07:00
chenyu
9db2d0d5c6 fix some type error in onnx [run_process_replay] (#6153) 2024-08-17 19:54:20 -04:00
chenyu
7c9c8ce22f use TensorProto enum in onnx dtype mapping [run_process_replay] (#6151) 2024-08-17 17:58:40 -04:00
chenyu
f7950fc2b6 add E275 missing-whitespace-after-keyword linting rule (#6149) 
requires space after keywords like `assert`, `not`, `return`, `else`
 2024-08-17 16:44:34 -04:00
chenyu
da4fa77e92 move import cProfile and pstats inside Profiling class (#6148) 2024-08-17 16:08:53 -04:00
George Hotz
88edc2902d axis_is_masked with graph_rewrite [run_process_replay] (#6144) 2024-08-17 10:28:49 -07:00
chenyu
039163e664 more tqdm touchup (#6143) 
* more tqdm touchup

don't default iterable to None, and more text cleanups

* oh iterable can be None
 2024-08-17 13:06:05 -04:00
qazal
5a266d5d0c type verify ImageDType and PtrDType [run_process_replay] (#6137) 
* type verify ImageDType and PtrDType [run_process_replay]

* fix tests
 2024-08-17 16:37:07 +03:00
qazal
d1d41130cd use membufs in ImageDType checks [run_process_replay] (#6136) 
* use membufs in ImageDType checks

* set by key [run_process_replay]
 2024-08-17 16:17:46 +03:00
qazal
41ac8bdd63 verify_ast prep refactor for intermediate uops type spec (#6135) 
* refactor to ops

* refactor to two functions

* the uop's shape become local_reduce
 2024-08-17 15:34:18 +03:00
qazal
d9ce664350 add test_verify_ast [run_process_replay] (#6134) 2024-08-17 14:14:30 +03:00
qazal
151a62ad32 hotfix: store dtype for ImageDType (#6133) 2024-08-17 13:44:53 +03:00
George Hotz
d0513087e1 hotfix: revert axis_is_masked for stable diffusion speed 2024-08-17 00:22:08 -07:00
George Hotz
4df4845b47 cache is_int [run_process_replay] (#6131) 
* cache is_int [run_process_replay]

* functools.cached_property is pretty slow
 2024-08-17 00:19:03 -07:00
George Hotz
3a2d724cb2 extra matcher from renderer [run_process_replay] (#6130) 
* extra matcher from renderer

* cache_pm [run_process_replay]
 2024-08-16 23:53:11 -07:00
George Hotz
9bc81c6db4 UOps.SHAPETRACKER (#6129) 
* UOps.SHAPETRACKER [run_process_replay]

* no process replay
 2024-08-16 23:26:34 -07:00
George Hotz
5048066e79 st_arg, never -1 [run_process_replay] (#6128) 2024-08-16 22:46:56 -07:00
George Hotz
9e6ad4b40f hotfix: free minor speedup 2024-08-16 21:08:03 -07:00
George Hotz
d9cb45af09 only axis is masked [run_process_replay] (#6123) 2024-08-16 21:01:17 -07:00
George Hotz
94aa5f11b5 Revert "use vmax for real_size [run_process_replay] (#6120)" (#6122) 
This reverts commit a6e3211444.
 2024-08-16 20:33:19 -07:00
George Hotz
a6e3211444 use vmax for real_size [run_process_replay] (#6120) 
* use vmax for real_size [run_process_replay]

* axis is masked
 2024-08-16 20:17:23 -07:00
George Hotz
912f01ed4b UOpGraph -> linearize_uop [run_process_replay] (#6119) 2024-08-16 19:48:39 -07:00
George Hotz
7cae152aa2 move uop logic into shapetracker [run_process_replay] (#6118) 2024-08-16 17:47:15 -07:00
George Hotz
89c7989659 no shapetracker in ops [run_process_replay] (#6117) 2024-08-16 17:23:27 -07:00
George Hotz
74ee9febec remove iter from uopgraph (#6110) 
* remove iter from uopgraph

* linearize returns uops

* fix tests

* linearize in linearize

* tests fix

* touchup

* test failures
 2024-08-16 15:58:29 -07:00
qazal
28c75bf2a6 merge uops with ops (#6111) 
Co-authored-by: chenyu <chenyu@fastmail.com>
 2024-08-16 18:17:57 -04:00
chenyu
379d080e74 tqdm touchup (#6113) 
more precise names and don't repeat set_description
 2024-08-16 17:34:21 -04:00
nimlgen
5f1554b574 amd fix uaf in program (#6114) 
* amd fix uaf in program

* keep it align

* sync before free
 2024-08-17 00:22:46 +03:00
qazal
d5e3217076 hotfix: scheduler differ (#6115) 
* hotfix: scheduler differ

* add the test back

* track keys
 2024-08-16 23:34:49 +03:00
qazal
c23d44c779 AST is UOp (#6030) 
* most of the work from the uops2 branch

* schedule

* realize

* kernel

* lowerer

* search

* green

* merge uops with ops

* Revert "merge uops with ops"

This reverts commit 1408a59f12.

* fix benchmark

* remove extra dedup
 2024-08-16 22:09:00 +03:00
George Hotz
d6f64c0c1f do better image indexing [run_process_replay] (#6109) 
* do better image indexing [run_process_replay]

* fix tests
 2024-08-16 09:55:22 -07:00
CaltropHungerton
38fb1e14a2 Intel XMX Tensor Core Support (#5622) 
* fixed xmx demo

* i think i'm invoking the DPAS but it's slow

* compiler build arg to stop register spilling, indicated where to fix flop counter

* don't mind this

* do NOT mind me

* do not mind me

* do not view

* i will add bf16 later

* in process of figuring out tc fields

* we figured out the fields!!!

* added check for cl device vendor, added seperate IntelRenderer

* remove tc thread_local_aliases

* cleaning debris before draft pr

* edits for linter

* deduping and checking device extensions

* i will find more line reductions in other places

* before merge upstream

* double grf size in compiler to fix register spilling (bandaid), device checking changes

* tc python emulation

* fixed emulation

* tests for emulated intel tensor core

* TC=0, 1 working on upstream, fixed perf

* test

* debris

* check for specialized cl device when we canonicalize device

* bf16 support, tc=3 test added

* address tests

* revert half2 loads on intel tc, cleanup

* linter

* fold_expanded revert

* lint, whitespace fix

* cuda bf16 (only one with bf16) is skipped in test tensor cores, so i will skip for intel bf16 too

* make line shorter, no need for noqa E501

* removed device intel

* fix python emulation

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2024-08-16 09:19:21 -07:00
George Hotz
f82ecd8802 remove uop symobilc rendering [run_process_replay] (#6108) 2024-08-16 09:02:15 -07:00
George Hotz
e8ae9af962 bump line count to 9000. we should be here a while 2024-08-16 08:46:36 -07:00