github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-02-08 21:55:14 -05:00
Code Issues Packages Projects Releases Wiki Activity
4,065 Commits 215 Branches 14 Tags
dafa42e864d043e1ae37e20d083f388efa20293f
Commit Graph

28 Commits

Author SHA1 Message Date
chenyu
e3c0ac9fbf remove old envvar "OPT" (#4060) 2024-04-03 14:55:21 -04:00
George Hotz
7425a0c646 CommandQueue is the future (#3950) 
* start of command queue

* cq work

* runs

* cleanup

* outs set

* read is gone

* future buffer work

* command queue is better

* command queue works

* loadops

* delete unneeded

* command queue works

* upd

* fix tests

* use CommandQueue in compile

* delay sync
 2024-04-01 17:35:48 -07:00
chenyu
c71627fee6 move GlobalCounter to helpers (#4002) 
break circular import between ops and buffer
 2024-03-30 00:30:30 -04:00
George Hotz
9eef44521b ScheduleItem uses Buffer (#3995) 
* schedule Buffer

* update

* update tests

* master

* works

* remove LoadOps.WAIT

* fix compile2

* bad test

* rename and note
 2024-03-29 20:50:27 -07:00
George Hotz
68ca4d4276 split to schedule.py (#3949) 
* split to schedule.py

* split
 2024-03-26 21:02:46 -07:00
George Hotz
150ea2eb76 create engine folder and move code (#3948) 
* retry

* older tf

* that
 2024-03-26 20:38:03 -07:00
qazal
337cd53444 multioutput ScheduleItem (#3699) 
* refactor realize.py

* update docs

* update test_sched

* update runners and devices

* update openpilot and unit tests

* cleanup runner lowering

* update more tests
 2024-03-13 08:59:38 -07:00
George Hotz
2e60012bcf move create schedule and delete old API (#3377) 
* move create schedule and delete old API

* fix test multitensor
 2024-02-12 18:10:45 +01:00
George Hotz
1f9aee8b6f remove numpy from device (#3123) 
* remove numpy from device

* fix tests

* np item

* cleanups

* simplify with as_buffer

* no toCPU

* tinygradic

* cast to scalar
 2024-01-14 19:36:05 -08:00
George Hotz
a280cfe169 move dtypes to dtype.py (#2964) 
* move dtypes to dtype.py

* fix urllib
 2024-01-01 14:58:48 -08:00
George Hotz
c81ce9643d move globalcounters to ops (#2960) 
* move globalcounters to ops

* missed a few

* sick of that failing
 2024-01-01 14:21:02 -08:00
chenyu
50927defad s/lazydata.realized/lazydata.base.realized/g (#2914) 
* s/lazydata.realized/lazydata.base.realized/g

* not that
 2023-12-22 14:45:13 -05:00
George Hotz
877c78b4ce lazy tests (#2796) 
* tests

* mini sd is very mini
 2023-12-16 08:24:21 -08:00
George Hotz
c6eb618013 tests from new lazy branch (#2774) 
* tests from new lazy branch

* fix lin 11

* that was needed

* doesn't fail

* mark

* meant that

* llvm passes
 2023-12-14 23:06:39 -08:00
George Hotz
27481b9206 Switch ops_gpu -> gpuctypes (#2532) 
* ops_gpu is go

* fix size 0

* fix image, and add more tests

* nerf openpilot test, doesn't test thneed

* run the schedule

* better

* oops, new inputs

* delete pyopencl

* Update ops_gpu.py
 2023-12-01 22:30:21 -08:00
George Hotz
bfdce1f0e7 hotfix: make openpilot test deterministic 2023-12-01 15:37:23 -08:00
George Hotz
2c363b5f0b new style device (#2530) 
* cpu tests pass

* torch works

* works

* metal works

* fix ops_disk

* metal jit works

* fix openpilot

* llvm and clang work

* fix webgpu

* docs are rly broken

* LRU works on metal

* delete comment

* revert name to ._buf. LRU only on Compiled

* changes

* allocator

* allocator, getting closer

* lru alloc

* LRUAllocator

* all pass

* metal

* cuda

* test examples

* linearizer

* test fixes

* fix custom + clean realize

* fix hip

* skip tests

* fix tests

* fix size=0

* fix MOCKHIP

* fix thneed

* copy better

* simple

* old style metal copy

* fix thneed

* np reshape

* give cuda a device
 2023-11-30 17:07:16 -08:00
George Hotz
889acefe85 Support weird loads in Image (#2498) 
* image support weird loads

* umm, that was always wrong

* openpilot compile fails with a weird error

* image test passes

* we have valids now

* clean that up

* no more required opts

* add fastvits test, fix bug

* minor cleanups
 2023-11-29 08:30:46 -08:00
George Hotz
d87a246439 move to new cached fetch (#2493) 
* move to new cached fetch

* extra.utils is over

* loads

* bump download cache

* bump timeout
 2023-11-28 17:36:55 -08:00
George Hotz
9e07824542 move device to device.py (#2466) 
* move device to device.py

* pylint test --disable R,C,W,E --enable E0611

* fix tests
 2023-11-27 11:34:37 -08:00
George Hotz
8e9cdef61f clean up the buffers (#2447) 
* clean up the buffers

* remove allocate_output

* functools.lru_cache is methodcache

* add TestShapeTrackerSize

* cache_clear

* no 0 sz buffer, add _ on functions that shouldn't be imported

* fix size

* if -> while
 2023-11-26 11:02:29 -08:00
George Hotz
8656eebb42 jit doesn't use named tensors (#2393) 
* jit doesn't use named tensors

* move to compile2

* remove broken single root junk

* explicit float32

* skip slow test
 2023-11-23 00:13:18 -08:00
George Hotz
5aaa8a0cc1 fix shape 2023-10-31 11:36:19 -07:00
George Hotz
a27c9f9de5 openpilot compile2 (#2189) 
* try compile2

* pass to thneed

* fix tanh onnx
 2023-10-31 11:08:58 -07:00
George Hotz
881fd7c141 add mops to graph, refactor IMAGE (#2100) 
* add mops to graph, refactor IMAGE

* no reshape pushing

* add todo

* fix openpilot model alt

* push reshapes reduces kernels in new op

* IMAGE=2 is a first class citizen now
 2023-10-17 21:27:51 -07:00
George Hotz
5a4a62ecae Disable logging in early compile2 and lower kernel counts (#2090) 
* Revert "Revert "openpilot kernel fix from 209 to 207 (#2006)" (#2065)"

This reverts commit 924ecc4d6a.

* gate behind OPT >= 4

* disable_logging in schedule

* simple

* from master

* more images

* revert that

* 206 kernels
 2023-10-16 20:15:24 -07:00
George Hotz
a7b18ac325 try beam search on device (#2085) 
* try beam search on device

* fix beam with nolocals

* ops too

---------

Co-authored-by: Comma Device <device@comma.ai>
 2023-10-16 12:52:42 -07:00
George Hotz
5472a14544 openpilot compile2 (#1977) 
* start compile2

* tweak

* why are there two more kernels?

* minor cleanups

* don't break onnx tests

* add __metadata__ support to safetensors

* no early realize in onnx

* cleanups

* bugfix

* clean up image type, add optimize

* opt to match old

* try that

* opt work

* run compile2

* optimizer

* prt more

* prerealize

* imp

* NOLOCALS works

* no locals means no locals

* support fractional globals

* all locals welcome

* int that

* cleanups

* show gemv regression

* clean up diff

* use idx for the cond

* nolocals

---------

Co-authored-by: Comma Device <device@comma.ai>
 2023-10-15 20:39:46 -07:00