github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-25 06:48:22 -05:00
Code Issues Packages Projects Releases Wiki Activity
7,584 Commits 205 Branches 14 Tags
d6bf1feaab0d62ffb33d71663faa9088f47d45fa
Commit Graph

72 Commits

Author SHA1 Message Date
chenyu
b7397c1322 more typing cleanups [pr] (#8376) 
List, Tuple, DefaultDict
 2024-12-22 05:21:03 -05:00
chenyu
18dca3c3d7 isolate train_gpt2 slow kernels [pr] (#8358) 
also fixed run_linearizer with var_vals=None
 2024-12-20 17:59:01 -05:00
qazal
9828277c03 view doesn't have buffer, fix the tests [pr] (#7841) 
* view doesn't have buffer, fix the tests [pr]

* need assigns
 2024-11-22 20:41:55 +08:00
George Hotz
eb0bb7dc0b final dname to device [pr] (#7806) 
* final dname to device [pr]

* oops, fix nv
 2024-11-20 20:20:28 +08:00
ignaciosica
597a239e28 Remove UnaryOps, BinaryOps, TernaryOps, MetaOps [pr] (#7725) 
* remove unaryops

* remove ternaryops

* remove metaops

* hotfix

* remove binaryops

* hotfix: test_pattern_matcher

---------

Co-authored-by: qazal <77887910+Qazalin@users.noreply.github.com>
 2024-11-16 20:56:56 +08:00
nimlgen
4d81b7952a qcom match texture/sampler descriptors to OpenCL (#7622) 
* qcom ioctl compare more regs

* bug fix
 2024-11-11 21:56:51 +03:00
George Hotz
205befa788 move is_dtype_supported to device [pr] (#7575) 2024-11-07 20:38:03 +08:00
George Hotz
99bd4372a5 Ops.ALU is no more, the arg is just an op (#7525) 
* op arg alu [pr]

* more

* more passing

* fix more tests

* more tests passing

* fix single failing test

* so much cleaner

* noop to not have process replay trigger

* fix ptx
 2024-11-05 00:22:22 +08:00
George Hotz
c8bf09b7d4 s/UOps/Ops (#7500) 
* s/UOps/Ops [pr]

* fix
 2024-11-03 11:26:10 +08:00
George Hotz
4e2895f8d2 safe changes from new dtype branch [pr] (#7397) 
* safe changes from new dtype branch [pr]

* only image test on GPU
 2024-10-30 17:18:48 +08:00
nimlgen
293714610a capture beam log runtime errors (#7311) 2024-10-26 13:59:45 +03:00
chenyu
ea016b55d1 don't throw in fuzz_linearizer (#7148) 
already broken on master and needs fix. don't throw to not block other pr
 2024-10-18 09:28:30 -04:00
nimlgen
45db7d9045 fuzz qcom vs opencl (#7130) 
* fuzz qcom vs opencl

* fix nv

* bettre?

* typo

* open both devs
 2024-10-17 18:49:08 +03:00
nimlgen
39ab67e9ef beam capture and replay in fuzz (#7099) 
* beam capture and reply in fuzz

* clean a bit
 2024-10-16 20:26:58 +03:00
nimlgen
b025495e5c fuzz nv vs cuda (#7066) 
* fuzz nv vs cuda

* fixes

* smth

* um

* cmp the same

* dnrt

* correct gpfifo scan

* fix
 2024-10-15 22:22:40 +03:00
chenyu
fbaab30fe3 add timing to fuzz_linearizer (#7056) 
and applied smaller FUZZ_MAX_SIZE. this is getting quite slow in CI
 2024-10-14 11:57:41 -04:00
chenyu
c4c806a210 generate new kernel dataset (#7034) 
* generate new kernel dataset

pre req to remove NumNode
```
extra/optimization/generate_dataset.sh
gzip -k /tmp/sops
mv /tmp/sops.gz extra/datasets/
```

* fix var range in fuzz_linearizer
 2024-10-13 16:19:41 -04:00
George Hotz
d726eb6f48 uop resolve [run_process_replay] (#6826) 
* uop bool and int and stuff [run_process_replay]

* add ne support

* can't even be None anymore

* BinaryOps.AND support

* less compare
 2024-10-01 13:11:42 +08:00
George Hotz
74ee9febec remove iter from uopgraph (#6110) 
* remove iter from uopgraph

* linearize returns uops

* fix tests

* linearize in linearize

* tests fix

* touchup

* test failures
 2024-08-16 15:58:29 -07:00
qazal
28c75bf2a6 merge uops with ops (#6111) 
Co-authored-by: chenyu <chenyu@fastmail.com>
 2024-08-16 18:17:57 -04:00
qazal
c23d44c779 AST is UOp (#6030) 
* most of the work from the uops2 branch

* schedule

* realize

* kernel

* lowerer

* search

* green

* merge uops with ops

* Revert "merge uops with ops"

This reverts commit 1408a59f12.

* fix benchmark

* remove extra dedup
 2024-08-16 22:09:00 +03:00
kormann
2c4add6844 pretty print lazy op per default (#5505) 
* pretty lop

* min diff

* walrus

* fix

* min diff

* simplify

* pretty helper function

* ws

* pretty uop upat

* tests

* stricter tests

* test passes

* ws

* stronger upat test

* delete print_tree

* min diff

* stricter exp test

* fix merge

* stronger uops eval test

* +readable and deep upat test

* +readable and deep upat test

* sort inv fix

* fix

* revert allowed_len
 2024-07-18 09:34:08 -07:00
Francis Lam
2d53abb04a test/external/fuzz_linearizer: fix for new AST changes (#5519) 
* test/external/fuzz_linearizer: fix for new AST changes

also add beautiful_mnist failures

* add CLANG and LLVM to test_failure_35 failed_platforms

* fix test_linearizer_failure names
 2024-07-17 00:08:07 -04:00
chenyu
28972418c4 s/get_linearizer/get_kernel [run_process_replay] (#5467) 2024-07-13 20:32:22 -04:00
George Hotz
03c2dc8bd7 lowerer is kernel [run_process_replay] (#5437) 2024-07-12 18:50:55 -07:00
George Hotz
870dc8c350 s/Linearizer/Lowerer [run_process_replay] (#5428) 2024-07-12 15:54:07 -07:00
George Hotz
94599c0637 fixup ast in kernel to be MetaOps.SINK [run_process_replay] (#5424) 
* fixup ast in kernel to be MetaOps.SINK [run_process_replay]

* fix tests

* fix more tests
 2024-07-12 14:01:03 -07:00
George Hotz
6f6b3b10c9 import from uops, not linearizer (#5064) 2024-06-20 08:08:44 -07:00
kormann
7c3b877216 rename uop [run_process_replay] (#5031) 
* rename

* fix unittests

* rename vin

* fix test

* fix type [run_process_replay]

* rm pre commit hook change
 2024-06-18 21:34:05 +03:00
chenyu
67e8df4969 remove numpy from dtype (#4969) 
replaced all dtype.np with _to_np_dtype defined in tensor.py.

after this, the only numpy usages are (1) Tensor(np.ndarray), (2) construct .numpy() output, (3) numpy random buffer
 2024-06-14 15:38:45 -04:00
chenyu
fdbb4305cb skip unsupported dtype in fuzz_linearizer (#4917) 
resolve issues in #4887. dataset generated from ubuntu but metal does not support double
 2024-06-11 18:18:21 -04:00
George Hotz
ff64bcab69 move graph/search to engine (#4596) 2024-05-14 23:12:59 -07:00
George Hotz
2f970a4fc2 all realize 2 (#4527) 
* all realize 2

* tests fixup

* fix more tests

* fix openpilot

* fix tests

* unneeded
 2024-05-10 22:43:09 -07:00
George Hotz
1e843d495e cleaning up search with Program (#4500) 
* cleaning up search

* fix tests

* test fix

* minor compiler cleanup
 2024-05-09 19:01:53 -07:00
Francis Lam
7da1b41f38 fuzz_linearizer: add FUZZ_REQUIRE_TC option to require TC in opts (#4468) 
useful for checking late opts after TC such as GROUP, etc.
 2024-05-07 17:14:21 -04:00
Francis Lam
18c61ce077 test/fuzz_linearizer: add --atol/rtol and change half distribution (#4352) 2024-04-29 15:53:59 -04:00
George Hotz
b9570d6100 clean up update stats (#4226) 
* WIP: clean up update stats

* line savings now

* fix graphs

* fix tests

* tighter prints

* remove extra jit=false

* debug=2 means wait

* that won't update stats

* still wait
 2024-04-19 15:41:30 +04:00
chenyu
d9ff636cf5 use is to compare with enum (#3993) 
* use is to compare with enum

currently it's mixed between `==` and `is`, moved all to `is`

* more
 2024-03-29 13:02:56 -04:00
George Hotz
42b9d999ea Buffer isn't always allocated (#3974) 
* buffer alloc

* allocate

* missing allocates

* last one
 2024-03-28 13:33:47 -07:00
Francis Lam
5530b0cbed fuzz_linearizer: reduce debug verbosity and make easier for CI usage (#3942) 
* fuzz_linearizer: reduce debug verbosity and make easier for CI usage

* rename FUZZ_BEAM to FUZZ_ALL_ACTIONS (not choosing a subset)
* skip simple ASTs (easier to use with LOGOPS output)
* don't fuzz a previously seen AST
* add options to allow non-zero --expected-failures

* clean up naming and use set
 2024-03-26 16:25:24 -04:00
chenyu
a2b2597fc2 replace dtype.name str with render_dtype (#3903) 
fixed some bf16 cast issue since it does not have `.name`.
also more robust if there are lang specific type override
 2024-03-23 19:25:48 -04:00
Francis Lam
5587594a00 fuzz_linearizer: add --ast and --file params to read kernels (#3877) 
also fix up ast_str_to_str to support the new tuple of LazyOps
 2024-03-22 14:27:40 -04:00
Francis Lam
3c0478bfab fuzz_linearizer: add additional DEBUG info for comparison errors (#3866) 2024-03-21 18:58:10 -04:00
chenyu
e50b7abe4f diversed buf inputs based on dtype in fuzz_linearizer (#3863) 2024-03-21 16:23:11 -04:00
chenyu
30fa03243e reuse fuzz_linearizer.compare_linearizer in test_linearizer_failures (#3861) 2024-03-21 14:12:27 -04:00
chenyu
6bf0b82267 alloc new output in fuzz_linearizer between baseline and real one (#3859) 
if the kernel is an assign `a += 1`, the rawbufs[0] is updated twice and gives false compare_error
 2024-03-21 11:36:05 -04:00
Francis Lam
6d5dec2fef log optimized kernels and a script to compare with non-optimized ones (#3829) 
* search: add BEAM_VERIFY option to validate search results

refactor fuzz_linearizer comparison to allow it to be used in for
BEAM_VERIFY in device.py

* search: fix to verify the beam_search result and not the fastest

* search: fix typing and clean up

* device: remove imports from test and add LOGKERN options

LOGKERN output can be used with test/external/verify_kernel.py
to validate correctness

* fix example in verify_kernel.py

* cleanup fixes

* fix to use f-strings
 2024-03-20 19:22:08 -04:00
qazal
e3e89c244b multioutput uoping infra (#3706) 
* linearize multioutput

* add vars to copy
 2024-03-15 21:56:59 -07:00
nimlgen
08064a0e29 add SEED env to fuzz_linearizer (#3713) 
* add SEED env to test/external/fuzz_linearizer.py

* found some

* more platforms
 2024-03-13 18:08:42 +03:00
chenyu
e25879d50e don't get new var_val for the same ast in fuzz_linearizer (#3657) 
fixed result comparison for kernels with variables
 2024-03-08 09:49:24 -05:00