github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-23 22:08:08 -05:00
Code Issues Packages Projects Releases Wiki Activity
5,680 Commits 205 Branches 14 Tags
074cf780dd766dd371bb26ca3a8f01bce87bf3c8
Commit Graph

5680 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
qazal
074cf780dd add option to only benchmark schedule [run_process_replay] (#6204) 2024-08-20 16:51:27 +03:00
Francis Lata
8fd8b970b0 update URL to eval cases from recent MLPerf file movements (#6201) 2024-08-20 08:43:13 -04:00
gswangg
0e6f057eae migrate test_linearizer.py to UOP AST (pt. 1) (#6150) 
* migrate test_multioutput to UOP AST

* inline buf declarations

* migrate test_multireduce to UOp AST

* update test_mid_dim_multireduce to UOp AST

* update test_triple_multireduce with UOp AST

* make global definitions more concise

* update test_double_reduce_multireduce with UOp AST

* update test_multireduce_with_parallel with UOp AST

* update test_multiout_multireduce to UOp AST

* make gidx style consistent across updated tests

---------

Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
 2024-08-20 10:02:20 +03:00
chenyu
10330a41c7 add CMPNE tests in test_uops (#6196) 
fixed the output_dtype for CMPNE and match the tests for CMPLT
 2024-08-19 19:41:21 -04:00
chenyu
21d6739237 remove UnaryOps.NEG from lazy.py (#6193) 
* remove UnaryOps.NEG from lazy.py

* neg is no longer unary
 2024-08-19 18:41:28 -04:00
chenyu
4d1b5781b5 remove UnaryOps.NEG from function.py (#6187) 
* remove function.Neg

prep to remove UnaryOps.NEG

* replace all NEG in function.py
 2024-08-19 17:39:15 -04:00
nimlgen
bc44e6501b _gpu_alloc -> allocator.alloc (#6189) 
* _gpu_alloc -> allocator.alloc

* not needed this import

* pylint
 2024-08-19 23:34:22 +03:00
chenyu
96d502d8b7 update function.Max backward (#6190) 
instead of `(1-(x!=max))`, use `(x!=max)!=True`.

prep to remove Unary.NEG, also this can be instruction fused later more easily
 2024-08-19 16:06:14 -04:00
Gabe Caldwell
bdd6325f31 default num_classes value for one_hot (#6182) 
* num_classes=-1

If num_classes set to -1, the number of classes will be inferred as one greater than the largest class value in the input tensor.

* num_classes desc

comment to explain num_classes default and what that means.

* replacing ' with `
 2024-08-19 12:07:14 -07:00
Alessandro Benetti
9328248610 support for std_mean and cross_entropy (#6181) 
* support for std_mean and cross_entropy (#3)

* Cross entropy and std mean support

* remove extra examples
 2024-08-19 12:06:44 -07:00
Max-We
53b20afa3f Write tar_extract (#6180) 
* Add tar_extract

* Add tar_extract tests

* Fix dtype for initialization from path

* Tests for path initialization

* rm print

---------

Co-authored-by: Maximilian Weichart <maximilian.weichart@icloud.com>
 2024-08-19 12:06:17 -07:00
Eitan Turok
8556d0c642 Support gunzip in fetch (#6176) 
* init

* update

* clean

* add type

* clean

* fix import order

* shorten variable names
 2024-08-19 12:04:40 -07:00
chenyu
705b8066ab function.Div -> function.IDiv [run_process_replay] (#6188) 
float div is equivalent to mul a reciprocal
 2024-08-19 14:59:41 -04:00
qazal
ee5fe12630 disallow some uops at different levels [run_process_replay] (#6186) 
* assert intermediate ones

* assert low-level uops
 2024-08-19 21:23:44 +03:00
samm393
5d742f7fe3 Missing features from rearrange (#6184) 
* fixes and tests

* typo in test
 2024-08-19 11:19:07 -07:00
qazal
2242ff84be type verify intermediate UOps [run_process_replay] (#6140) 
* type verify intermediate UOps [run_process_replay]

* merge asserts

* variable const
 2024-08-19 20:59:01 +03:00
qazal
478145cb8e lowering error in diff_schedule is fine [run_process_replay] (#6185) 2024-08-19 20:51:12 +03:00
chenyu
00578a021b re:6125 switch real_size to use uops [run_process_replay] (#6138) 
* switch real_size to use uops [run_process_replay]

* enough to pass

---------

Co-authored-by: George Hotz <geohot@gmail.com>
 2024-08-19 13:20:24 -04:00
qazal
e28d29641f more scheduler process replay tooling [run_process_replay] (#6178) 2024-08-19 15:35:51 +03:00
chenyu
b36a7273c6 RUF018 assignment-in-assert [run_process_replay] (#6172) 
assertion should not have side effect or `-O` breaks.

initially just wanted to fix the one in rearrange, but it also made some long lines less long
 2024-08-19 00:34:52 -04:00
chenyu
9c60a27ece lower float64 sin fuzzer threshold (#6173) 
139216373.71875 failed
https://github.com/tinygrad/tinygrad/actions/runs/10446960642/job/28925156240
 2024-08-19 00:25:42 -04:00
samm393
fd7c84c1c8 Rearrange (#6106) 
* rearrange and tests

* tidy

* whitespace

* remove line

* -5 lines

* test fix

* static -> instance

* fix () & add more tests

* remove flags

* -1 line

* match einops

* whitespace

* repeated names
 2024-08-18 20:22:28 -07:00
chenyu
2de174677a threefry touchup [run_process_replay] (#6169) 
also why is test_gc testing _rng_counter is allocated??
 2024-08-18 23:01:24 -04:00
David González Martínez
724e408736 add support for retain_graph in backward (#6145) 
* add support for retain_graph in backward

* fix: dont accumulate grad on non-leaf tensors

* fix order

* fix: do not delete grad on leafs

* fix linter

* fix: can't exactly match torch behaviour internally

* allow numerical room for test

* refactor
 2024-08-18 16:08:31 -07:00
wozeparrot
0c5189de25 threefry half (#6154) 2024-08-18 15:23:12 -07:00
qazal
fad1818530 move graph rewrite to ops [run_proess_replay] (#6159) 
* move graph rewrite to ops [run_proess_replay]

* better place
 2024-08-18 20:02:28 +03:00
Timmy
e3d14d1ccc Lowerer Multireduce Grouping (#6097) 
* grouping changes to codegen

* linters + tests

* fix identical store issue on PTX

* comment in grouping multireduce tests

* cleaning up diff

* cleaning up diff

* comments

* linters

* hotfix: dont change kernels

---------

Co-authored-by: qazal <qazal.software@gmail.com>
 2024-08-18 19:57:51 +03:00
qazal
1ba83cc7fa split test_sgd_4convs_fuse [run_process_replay] (#6158) 2024-08-18 18:35:42 +03:00
qazal
be6dda4093 hotfix: more lazyop rename to uop [run_process_replay] (#6157) 2024-08-18 17:28:44 +03:00
George Hotz
17a043edad tensor inference (#6156) 
* tensor inference

* test is even better name
 2024-08-18 00:19:28 -07:00
chenyu
9db2d0d5c6 fix some type error in onnx [run_process_replay] (#6153) 2024-08-17 19:54:20 -04:00
chenyu
7c9c8ce22f use TensorProto enum in onnx dtype mapping [run_process_replay] (#6151) 2024-08-17 17:58:40 -04:00
chenyu
f7950fc2b6 add E275 missing-whitespace-after-keyword linting rule (#6149) 
requires space after keywords like `assert`, `not`, `return`, `else`
 2024-08-17 16:44:34 -04:00
chenyu
da4fa77e92 move import cProfile and pstats inside Profiling class (#6148) 2024-08-17 16:08:53 -04:00
George Hotz
88edc2902d axis_is_masked with graph_rewrite [run_process_replay] (#6144) 2024-08-17 10:28:49 -07:00
chenyu
039163e664 more tqdm touchup (#6143) 
* more tqdm touchup

don't default iterable to None, and more text cleanups

* oh iterable can be None
 2024-08-17 13:06:05 -04:00
qazal
5a266d5d0c type verify ImageDType and PtrDType [run_process_replay] (#6137) 
* type verify ImageDType and PtrDType [run_process_replay]

* fix tests
 2024-08-17 16:37:07 +03:00
qazal
d1d41130cd use membufs in ImageDType checks [run_process_replay] (#6136) 
* use membufs in ImageDType checks

* set by key [run_process_replay]
 2024-08-17 16:17:46 +03:00
qazal
41ac8bdd63 verify_ast prep refactor for intermediate uops type spec (#6135) 
* refactor to ops

* refactor to two functions

* the uop's shape become local_reduce
 2024-08-17 15:34:18 +03:00
qazal
d9ce664350 add test_verify_ast [run_process_replay] (#6134) 2024-08-17 14:14:30 +03:00
qazal
151a62ad32 hotfix: store dtype for ImageDType (#6133) 2024-08-17 13:44:53 +03:00
George Hotz
d0513087e1 hotfix: revert axis_is_masked for stable diffusion speed 2024-08-17 00:22:08 -07:00
George Hotz
4df4845b47 cache is_int [run_process_replay] (#6131) 
* cache is_int [run_process_replay]

* functools.cached_property is pretty slow
 2024-08-17 00:19:03 -07:00
George Hotz
3a2d724cb2 extra matcher from renderer [run_process_replay] (#6130) 
* extra matcher from renderer

* cache_pm [run_process_replay]
 2024-08-16 23:53:11 -07:00
George Hotz
9bc81c6db4 UOps.SHAPETRACKER (#6129) 
* UOps.SHAPETRACKER [run_process_replay]

* no process replay
 2024-08-16 23:26:34 -07:00
George Hotz
5048066e79 st_arg, never -1 [run_process_replay] (#6128) 2024-08-16 22:46:56 -07:00
George Hotz
9e6ad4b40f hotfix: free minor speedup 2024-08-16 21:08:03 -07:00
George Hotz
d9cb45af09 only axis is masked [run_process_replay] (#6123) 2024-08-16 21:01:17 -07:00
George Hotz
94aa5f11b5 Revert "use vmax for real_size [run_process_replay] (#6120)" (#6122) 
This reverts commit a6e3211444.
 2024-08-16 20:33:19 -07:00
George Hotz
a6e3211444 use vmax for real_size [run_process_replay] (#6120) 
* use vmax for real_size [run_process_replay]

* axis is masked
 2024-08-16 20:17:23 -07:00