github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-01-29 08:48:15 -05:00
Code Issues Packages Projects Releases Wiki Activity
10,417 Commits 209 Branches 14 Tags
reprocess_node_experiments
Commit Graph

10417 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
George Hotz
4764a4c172 Revert "TIP 3 - Tensor realization spec tests (#8288)" (#8289) 
This reverts commit c0d4346b5a.
 2024-12-17 08:36:11 -08:00
qazal
c0d4346b5a TIP 3 - Tensor realization spec tests (#8288) 2024-12-18 00:04:50 +08:00
qazal
f16188b8c0 viz simplify tracked rewrites [pr] (#8285) 2024-12-17 23:18:08 +08:00
qazal
fd23738d9d start viz better typing, unsupport bottom_up=True [pr] (#8284) 
* start viz refactor

* delete bottom_up tracking

* more cleanup

* early continue
 2024-12-17 19:52:30 +08:00
qazal
856c068172 make viz work with uop mutability (#8283) 
* make viz work with uop mutability

* keep pickle_buffers local
 2024-12-17 19:17:41 +08:00
qazal
775746fa08 swizzle / const notes, new asserts [pr] (#8281) 2024-12-17 17:02:38 +08:00
chenyu
df7ba102c3 minor changes to views add [pr] (#8279) 
naming / style / comments before logic change
 2024-12-16 23:53:59 -05:00
George Hotz
e3731766c9 add a test for UOp representation as Tensor [pr] (#8278) 2024-12-16 19:41:29 -08:00
chenyu
3195bd0d12 more test examples to merge views [pr] (#8277) 
these have masks in self and masks in the merged views
 2024-12-16 20:44:35 -05:00
chenyu
6e2e56c0ff unit test for view add when self has a mask [pr] (#8276) 2024-12-16 20:07:35 -05:00
George Hotz
cda34ccadf hotfix: time.time -> time.perf_counter 2024-12-16 11:32:49 -08:00
chenyu
2bb298f38d add a missing unittest.main() [pr] (#8274) 2024-12-16 14:28:10 -05:00
leopf
befa8641c8 [pr] GroupOp.Associative (#8239) 
* [pr] GroupOp.Associative

* two_stage_associative_folding as lambda
 2024-12-16 08:42:26 -08:00
nimlgen
a2a4ff30dc hcq better timout haandling (#8269) 2024-12-16 13:44:55 +03:00
chenyu
f05fd118a2 few minor code cleanups [pr] (#8267) 2024-12-15 23:44:51 -05:00
chenyu
9789a83064 hotfix DEBUG in speed_v_theoretical.py conv (#8266) 
infinite loop with manual DEBUG set `DEBUG=2 python test/external/speed_v_theoretical.py -k conv`

```
  File "/Users/chenyu/code/tinygrad/tinygrad/helpers.py", line 95, in __ge__
    def __ge__(self, x): return self.value >= x
                                ^^^^^^^^^^^^^^^
  [Previous line repeated 4984 more times]
RecursionError: maximum recursion depth exceeded in comparison
```
 2024-12-15 19:44:45 -05:00
uuuvn
da2245a458 Fix double => half cast on clang (#8265) 2024-12-15 11:24:05 -08:00
qazal
1d21651823 free toposort cache after it goes out of scope [pr] (#8264) 2024-12-15 19:50:42 +02:00
George Hotz
53603c4ec1 simple ignore mop noops [pr] (#8263) 2024-12-15 09:32:42 -08:00
qazal
e1518f1e38 minimal failing test for UOp.toposort gc [pr] (#8261) 2024-12-15 19:30:56 +02:00
qazal
67e66ac1ab hotfix: schedule_uop in process replay (#8260) 
* hotfix: schedule_uop in process replay

* notes
 2024-12-15 21:24:54 +08:00
qazal
58b224a40f schedule_uop api refactor [pr] (#8259) 2024-12-15 19:50:00 +08:00
qazal
ef1346ab39 simplify to_uop more, toward deleting early bufferize (#8254) 2024-12-15 17:41:31 +08:00
qazal
d05e21cb69 replace lazy srcs with the new uop api [pr] (#8255) 
* buf_uop_view function

* srcs shouldn't exist

* fix TestTensorMetadata

---------

Co-authored-by: George Hotz <geohot@gmail.com>
 2024-12-15 17:09:54 +08:00
qazal
e0aeb2e9f4 unwrap existing buffer from assign src [pr] (#8252) 
* unwrap existing buffer from assign src [pr]

* this is a upat
 2024-12-15 03:29:51 +02:00
qazal
ace654a7e4 keep realized passthrough [pr] (#8248) 
* keep realized passthrough [pr]

* more pruning
 2024-12-15 02:23:15 +02:00
qazal
d78e75f710 hotfix: use ubuntu-22.04 ci from 8249 (#8251) 2024-12-15 02:23:00 +02:00
chenyu
16c1b2379d remove an if in reshape [pr] (#8246) 
not needed, likely a hack to work around pre-resolve?
 2024-12-14 16:05:50 -05:00
chenyu
4c1733440d failed test case for stable sigmoid (#8245) 
it should also work if implemented differently
 2024-12-14 15:19:41 -05:00
chenyu
3eb952f537 fix some sigmoid extreme (#8238) 
* fix some sigmoid extreme

quite brittle... the problem is it has 3 terms and mul might have bad order

* test_tanh_extreme

* just sigmoid gradient
 2024-12-14 14:37:06 -05:00
George Hotz
bcd7ea60f0 hotfix: a few more grad tests 2024-12-13 21:03:02 -08:00
George Hotz
734f2c5344 compute gradient [pr] (#8237) 
* compute gradient [pr]

* schedule_step_with_grads

* second deriv works
 2024-12-13 20:46:01 -08:00
chenyu
0708a169dd more comments and tests to reshape [pr] (#8236) 2024-12-13 23:21:51 -05:00
George Hotz
8396d90f91 non controversial changes from optim branch [pr] (#8234) 2024-12-13 19:24:16 -08:00
George Hotz
37fa38d272 Revert "switch beautiful_mnist to use new optimizer [pr] (#8231)" (#8233) 
This reverts commit e9ee39df22.
 2024-12-13 19:07:09 -08:00
George Hotz
e9ee39df22 switch beautiful_mnist to use new optimizer [pr] (#8231) 
* switch beautiful_mnist to use new optimizer [pr]

* fix abstractions3 + docs

* fix OptimizerGroup with schedule_step api
 2024-12-13 18:27:16 -08:00
chenyu
e0956c518c move some ifs from merge_dims to reshape [pr] (#8229) 
the third return value is only used in reshape
 2024-12-13 19:56:15 -05:00
George Hotz
e2f87ecf36 start work on new gradient (#7838) 
* start work on new gradient

* more correct

* working tests

* more tests

* work

* add (faliing) gradient test

* add view and reduce gradient

* test_add works, many failing test_ops

* add max and reduce max

* add max and reduce max

* 129 failing

* 108 failed

* better view drawing

* 101 failed

* i got 99 failures

* 94 failures

* it's tons of terrible code, but only 50 tests fail

* only 19 failures

* same 19 but shorter

* minimal doesn't matter

* shorter

* lil simpler

* simpler

* simpler

* simpler

* 13 test failures

* nine tests fail

* all ops tests pass

* add contiguous gradient + fix sched tests

* faster by removing toposort calls

* missed one

* add jax to testing
 2024-12-13 16:45:53 -08:00
chenyu
e371a23c45 more comments and tests to reshape [pr] (#8228) 2024-12-13 18:50:13 -05:00
George Hotz
6d83a96440 retry: use movement ops [pr] (#8225) 
* Revert "Revert "use movement ops [pr] (#8222)" (#8224)"

This reverts commit da19c37f0a.

* fix cast before view
 2024-12-13 15:14:26 -08:00
George Hotz
4679f9fb44 add detach to graph [pr] (#8221) 
* add detach to graph [pr]

* accept failure
 2024-12-13 14:21:32 -08:00
chenyu
62e19649c0 lower test_conv_3x3_256_32_32_256_256 (#8226) 
tiny7 is slow
 2024-12-13 17:15:53 -05:00
George Hotz
da19c37f0a Revert "use movement ops [pr] (#8222)" (#8224) 
This reverts commit 0d26c970ba.
 2024-12-13 14:10:47 -08:00
George Hotz
0d26c970ba use movement ops [pr] (#8222) 
* use movement ops [pr]

* test indexing
 2024-12-13 14:06:01 -08:00
chenyu
eb0e5a14fd reorder and comments to reshape [pr] (#8223) 
something feels wrong... contructing a counter example next
 2024-12-13 17:02:27 -05:00
pkotzbach
c1b79c118f add unit tests for to_dtype (#8217) 
* add unit test for to_dtype

* add unit test for to_dtype

---------

Co-authored-by: pkotzbach <pawkotz@gmail.com>
 2024-12-13 16:21:02 -05:00
George Hotz
8a50868264 touchup function.py [pr] (#8220) 
* touchup function.py [pr]

* remove ALLOWED_READ_IMAGE

* eh, keep it, just change it
 2024-12-13 13:07:00 -08:00
George Hotz
aff112f8ab add new uops to prep for gradient (#8219) 2024-12-13 11:54:26 -08:00
George Hotz
dbe549e462 rename expand to unroll [pr] (#8218) 2024-12-13 11:41:52 -08:00
ignaciosica
0a00187dce add real AMX tests to benchmark (#8216) 
* add real amx to benchmark

* add debug=2 to check tc are triggered
 2024-12-13 14:03:41 -05:00