github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-27 07:48:07 -05:00
Code Issues Packages Projects Releases Wiki Activity
5,429 Commits 207 Branches 14 Tags
2777784b911a19ee9b5793004ff172b4e1049a67
Commit Graph

5429 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
nimlgen
2777784b91 add dependency viewer to hcq profiler (#5874) 
* hcq profiler support deps

* clean up

* cleaner

* cleanup

* revert this

* linter

* mypy

* add test

* sync is strange, need to take the end

* linter + test
 2024-08-02 22:07:01 +03:00
George Hotz
23e8c39288 get program fields in __post_init__ [run_process_replay] (#5878) 
* get program fields in __post_init__ [run_process_replay]

* remove print
 2024-08-02 09:57:12 -07:00
qazal
8611fa6c99 apply opts.extra_matcher in process replay [run_process_replay] (#5877) 2024-08-02 18:07:58 +03:00
qazal
2a791f7924 fuzz uops is simpler with List[UOp] [run_process_replay] (#5875) 
* remove from fuzz_uops

* update fuzz_uops.py

* add to realize.py
 2024-08-02 17:28:15 +03:00
George Hotz
3995f1ddf1 move ops lds estimate to Program [run_process_replay] (#5872) 2024-08-01 19:12:07 -07:00
George Hotz
877e0b4ba0 define global only has the index [run_process_replay] (#5869) 
* define global only has the index [run_process_replay]

* fix that linearizer test

* fix ptx

* stupid ptx fix
 2024-08-01 19:01:15 -07:00
chenyu
f27f949a5d Revert "revert some UOp IDIV bound (#5863)" (#5871) 
This reverts commit 0c8d202348.
 2024-08-01 21:38:31 -04:00
chenyu
df138bc558 Revert "revert a mod pattern (#5864)" (#5870) 
This reverts commit 5c8de2d044.
 2024-08-01 20:44:26 -04:00
chenyu
1b0314d9ef Revert "remove one more UOp mod pattern (#5865)" (#5868) 
This reverts commit b03b8e18c2.
 2024-08-01 20:28:35 -04:00
George Hotz
d73bc85ba9 UOpGraph not in renderer or Program [run_process_replay] (#5867) 
* UOpGraph not in renderer or Program [run_process_replay]

* fix some tests

* fix ptx
 2024-08-01 16:20:30 -07:00
chenyu
b392b8edc3 increase atol and rtol test_gemm_fp16 (#5866) 
* increase atol and rtol test_gemm_fp16

made it pass with NOOPT which has larger accumulated error

* revert that
 2024-08-01 19:09:58 -04:00
chenyu
b03b8e18c2 remove one more UOp mod pattern (#5865) 
fixed UOP_IS_SYMBOLIC=1 test_failure_40
 2024-08-01 18:29:04 -04:00
chenyu
5c8de2d044 revert a mod pattern (#5864) 
fixed UOP_IS_SYMBOLIC=1 linearizer failure 47
 2024-08-01 17:24:26 -04:00
nimlgen
34168a64e3 optimize nv profiler (#5856) 
* nv profiler fix

* cleanup hcq a bit

* fixes

* fix

* typo

* all signals put timestamp

* a bit cleaner

* merge fields

* type

* import

* tiny fix
 2024-08-01 23:57:45 +03:00
George Hotz
2d3c7e4d4e some TestPickleJIT tests (#5860) 
* some TestPickleJIT tests

* hotfix: print which opencl device we are using
 2024-08-01 12:39:59 -07:00
George Hotz
e347f10d33 hotfix: print which opencl device we are using 2024-08-01 12:39:46 -07:00
chenyu
0c8d202348 revert some UOp IDIV bound (#5863) 
* revert some UOp IDIV bound

breaks conv with UOP_IS_SYMBOLIC, added some conv tests in CI

* those are correct

* skip slow ones
 2024-08-01 15:09:06 -04:00
George Hotz
53fcac9e80 hotfix: increase time on flaky NV test 2024-08-01 10:20:07 -07:00
qazal
cedf459843 infra for multi view reduce_info [run_process_replay] (#5861) 2024-08-01 19:46:55 +03:00
qazal
26d0265d66 test schedule of LazyBuffers [run_process_replay] (#5859) 2024-08-01 19:06:29 +03:00
George Hotz
0e34d83777 hotfix: don't include the old input_rawbuffers in all_resources 2024-08-01 09:00:11 -07:00
chenyu
d609206a4a move UOp patterns around [run_process_replay] (#5857) 
group lt / div / mod together and minor cleanups
 2024-08-01 11:32:08 -04:00
qazal
3e95e2bb0b mutate reduceop shapes pre ast creation [run_process_replay] (#5855) 2024-08-01 15:00:05 +03:00
qazal
ba0a0008aa early update the reduceop axis [run_process_replay] (#5854) 2024-08-01 14:08:40 +03:00
David Hou
eb91423cb4 MLB support reshape for uneven shards (#5804) 
* cleaner uneven reshape

* update test
 2024-08-01 02:36:03 -07:00
David González Martínez
0f09b94c43 add failing test for second order derivatives (#5772) 
* add failing test

* fix lint

* fix bad merge

* fix again

* fix test

* more minimal
 2024-08-01 02:34:47 -07:00
George Hotz
9d05dfb6f4 move JIT graphing into CapturedJit (#5852) 
* move JIT graphing into CapturedJit

* better

* _jit_cache

* clear inputs cleanup

* test_pickle_jit with graph + cleanup

* 0 is fine to start

* support None in bufs

* alloc real buffers

* cleaner
 2024-07-31 20:48:17 -07:00
chenyu
0ec732b494 test lin fail 47 for UOP_IS_SYMBOLIC (#5853) 
failed arange example with UOP_IS_SYMBOLIC
 2024-07-31 23:09:22 -04:00
George Hotz
c6a8395f1b CapturedJit is fun to pickle [run_process_replay] (#5851) 
* CapturedJit is fun to pickle

* export input replace
 2024-07-31 17:23:01 -07:00
George Hotz
5ff3e46718 diff symbolic with uops [run_process_replay] (#5841) 
* diff symbolic with uops

* mergable symbolic diff
 2024-07-31 15:15:01 -07:00
George Hotz
72621d9e7c count the specials in uops [run_process_replay] (#5848) 
* count the specials in uops [run_process_replay]

* cleanups
 2024-07-31 14:53:18 -07:00
chenyu
c2ffcf6887 remove the wrong mod UOp pattern (#5847) 
don't think we are hitting it because the stride construction, and it's wrong and not needed
 2024-07-31 16:24:25 -04:00
qazal
8174c438a3 pad test_failure_45 (#5846) 2024-07-31 23:08:48 +03:00
George Hotz
8672a9db3f add test to validate lazyops dims (#5845) 2024-07-31 12:59:38 -07:00
chenyu
4fe5b95568 fix UOp ALU bound (#5844) 
* fix UOp ALU bound

root cause of resnet bug, the ALU bound is only correct for scalar, not vectorized

* it can be nan...
 2024-07-31 15:19:31 -04:00
George Hotz
5eedd9e3ad raise the line ceiling to 8600. USE LINES CAREFULLY 2024-07-31 09:56:39 -07:00
nimlgen
f768935be8 add RING_ALLREDUCE_THRESHOLD (#5835) 
* add RING_ALLREDUCE_THRESHOLD

* becnhmark

* fixes

* fix n_gpus

* unused import

* remove debug=2
 2024-07-31 16:13:09 +03:00
nimlgen
431749dc21 hcq fix timestamp around kernel (#5837) 2024-07-31 16:12:27 +03:00
chenyu
2e087ca8e4 UOp bound for div negative number (#5808) 2024-07-31 02:10:23 -04:00
qazal
bcbd925001 hcopts failing test for fused arange kernel (#5815) 
* add failure_43

* n 45
 2024-07-31 09:02:44 +03:00
chenyu
93c5989c84 add UOp bound for BinaryOps.CMPLT (#5833) 
and remove the redundant lt folding rule
 2024-07-31 01:46:48 -04:00
chenyu
5560bda509 remove redundant mod 1 pattern [run_process_replay] (#5832) 
it's folded because min==max
 2024-07-31 01:12:05 -04:00
qazal
ed556c260e UOps.IF rules more tests (#5831) 
* init tests

* split tests

* assert multiple gates simplicity
 2024-07-31 00:11:02 -04:00
Vyacheslav Pachkov
610e454132 fix opencl_ioctl on comma (#5814) 
- remove unused code
- add CP_REG_TO_MEM opcode
- fixed parse_cmd_buf for more than 1 command object by correcting
an offset
- fixed memory mappings for cases when memory was allocated with
KGSL_MEMFLAGS_USE_CPU_MAP.
KGSL_MEMFLAGS_USE_CPU_MAP: If set on call and return, the returned GPU
address will be 0. Calling mmap() will set the GPU address.
So there are no IOCTL_KGSL_GPUOBJ_INFO ioctls for that type of memory
and it resulted to crash right after get_mem.
 2024-07-30 20:44:06 -07:00
David Hou
9a485f36e4 shard kvcache (#5830) 2024-07-30 20:29:54 -07:00
David Hou
492a696d14 allow specify splits in shard, handle multiple different splits in MLB.e (#5599) 
* allow specify splits in shard, handle multiple different splits in MLB.e

* line width

* linter

* don't use Device in docstring

* specify size of shards instead of boundaries

* adjust docstring for specify size of shards instead of boundaries

* don't allow splits on symbolic axis?

* just allow sint in splits_to_bounds

* add message for assert

* bounds instead of splits to save lines

* fix types

* reduce diff

* fix

* tuple

* golf :(

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
 2024-07-30 19:33:04 -07:00
George Hotz
3f6a43ba12 less lines [run_process_replay] (#5829) 2024-07-30 19:32:54 -07:00
chenyu
c3da458bc3 UOp if min==max folds to CONST (#5828) 
* UOp if min==max folds to CONST

* fix test
 2024-07-30 22:14:22 -04:00
George Hotz
4e89d45513 hotfix: put contiguous back in llama 2024-07-30 18:43:48 -07:00
George Hotz
21c5e8e1b7 extreme llama speed, 57.34 tok/s (#5827) 
* extreme llama speed

* mergable
 2024-07-30 18:32:09 -07:00