github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-02-10 22:54:59 -05:00
Code Issues Packages Projects Releases Wiki Activity
2,603 Commits 219 Branches 14 Tags
8d6cecb25c7f1e228494bc1fb2c786512b82334f
Commit Graph

2603 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
geohotstan
8d6cecb25c Torch eq fix (#1562) 
* init

* Revert "init"

This reverts commit 682bf2073a.

* kids dont do drugs

* one way to fix

* resolve merge conflict

* no more or

* clean up
 2023-10-11 12:57:11 -07:00
George Hotz
41bfeb2c1e start work on auto opt (#2034) 
* start work on auto opt

* lin failure

* not beating hcopt

* greedy

* timing is fast

* codegen.search

* greedy search in handcode_opt

* track running gflops

* clean up those files

* no failure
 2023-10-11 12:54:53 -07:00
chenyu
1c980517c5 s/var_vals_from_ast/vars_from_ast (#2038) 2023-10-10 20:21:55 -07:00
Francis Lam
81c7d750db test: fix test_linearizer.test_tensor_core test (#2036) 
must use apply_tensor_core instead of hand_coded_optimizations
 2023-10-10 14:48:28 -07:00
chenyu
e2b83f1b42 Variable.bind newer (#2017) 
* Variable.bind attempt 2

* ShapeTracker.unbind

* fix llama

* fix types

* test case

* View.vars cleanup

* include mask in symbolic source

* mask can be sint

* st.unbind in bufferops

* assert ast contain free Variable only

* cleanup

* conservative unbinding reduce op arg

* move reduceop unbind

* fix llama JIT arg behavior
 2023-10-10 10:03:01 -07:00
qazal
71d93ffd79 Refactor GPU and Metal langauges in their own separate renderers (#2033) 
* Refactor GPU and Metal langauges in their own separate renderers

* remove CStyleLanguage imports

* move renderers too
 2023-10-10 07:46:41 -07:00
George Hotz
f139060103 Rewrite hand coded opt with action space (#2030) 
* tests passing

* hand coded opt with new abstractions

* simpler opts

* split out tensor cores
 2023-10-10 07:38:38 -07:00
Ahmed Harmouche
e27fedfc7b Fix stable diffusion output error on WebGPU (#2032) 
* Fix stable diffusion on WebGPU

* Remove hack, numpy cast only on webgpu

* No-copy numpy cast
 2023-10-10 06:40:51 -07:00
qazal
e40f141203 Refactor and add more unit tests for disktensors (#2022) 
* testing with the test_ops pattern

* add assign test

* flake8 complaining about single line fn

* slice 2d and minor cleanup

* make assign_slice a one-liner

* we dont need to repeat the same lambda twice, default tinygrad_fxn to be np_fxn

* back assign fn for np array

* implement __setitem__ in tensor.py

* dont re-slice the ret tesnsor

* one liner assign

* drop the permute test
 2023-10-09 18:46:29 -07:00
chenyu
45f0891a8f use "<" instead of "<=" in codegen for loop (#2027) 2023-10-09 17:26:36 -07:00
chenyu
25555c836f llama default to JIT only if device supports JIT (#2028) 2023-10-09 17:26:02 -07:00
George Hotz
16ca8410f8 op logger + replay (#2021) 
* logops

* fix dtype printing

* needs inf

* ops dataset

* minor improvements

* 12k kernels

* opt can compile

* graph flops
 2023-10-08 15:10:18 -07:00
calledit
46f354b49f Fix comment to describe code (#2023) 2023-10-08 14:28:14 -07:00
qazal
0e2e041faf CI for using tinygrad as an external pkg (#2019) 
* create workflow

* unify with test.yml
 2023-10-08 10:50:48 -07:00
George Hotz
8db92bd060 fix tvm gemm example 2023-10-08 05:57:41 -07:00
mmmkkaaayy
af6e2f31ca whisper: cast model output token to int32 (#2013) 
Co-authored-by: mmmkkaaayy <mmmkkaaayy@users.noreply.github.com>
 2023-10-08 05:56:22 -07:00
Luca Sciarpa
e93e240a6c adapting test/external/external_osx_profiling.py to the new code base (#2002) 
* adapting external osx profiling

* fixing dtype

* fixing buffer size
 2023-10-08 05:55:00 -07:00
wozeparrot
c4e8ea73bd feat: add tinygrad.features to setup.py (#2016) 2023-10-07 21:55:50 -07:00
Francis Lam
dece9958f8 wmma: clean up to make WMMA arg order consistent (#2014) 
also add cache defeat to extra/gemm/simple_matmul.py
 2023-10-07 17:45:40 -07:00
George Hotz
cea4cbfc7a move image+kopt to features (#2015) 
* move image+kopt to features

* fix tests

* debug prints (unrelated)
 2023-10-07 15:41:08 -07:00
George Hotz
44ed94ef5c use the device abstraction in handcode_resnet50_opt 2023-10-07 13:22:20 -07:00
George Hotz
6ee9cae44f don't extract CIFAR every time / use the cache 2023-10-07 12:33:50 -07:00
nimlgen
d07ac379f9 add var_vals to kopt with symbolic (#2008) 
* add var_vals to kopt with symbolic again

* no copies
 2023-10-07 09:34:21 -07:00
George Hotz
121f7aa8c5 Schedule item (#2012) 
* ScheduleItem

* put var_vals in the schedule

* fix tests, wow that proliferated quickly

* not ready to be in the schedule
 2023-10-07 08:59:25 -07:00
George Hotz
f1f64bc88d remove val_vars from the linearizer (#2009) 
* remove val_vars from the linearizer

* no need to store var vals
 2023-10-07 07:47:28 -07:00
George Hotz
dea8bb0938 triton isn't tested, and allows this refactor (#2007) 
* triton isn't tested

* cuda buffer
 2023-10-07 07:29:59 -07:00
George Hotz
23de1db727 strip whitespace 2023-10-07 06:06:27 -07:00
Roelof van Dijk
26fcc8dff6 fix: remove runtime imports (#1982) 
fix: import what is used

probably monkeypatched

fix: import

revert selective import
 2023-10-07 05:23:08 -07:00
George Hotz
f54959e5cd move print tree into graph (#2003) 
* move print tree into graph

* add winograd profiling test

* change pre-commit to run ruff first
 2023-10-07 04:39:21 -07:00
Ahmed Harmouche
2114dc13d1 Allow multi-input model export (#1995) 
* Allow multi-input model export

* Add model export unit test

* Fix efficientnet compilation

* Only run model export test on JIT supported devices

* Skip export model test if not EXPORT_SUPPORTED_DEVICE
 2023-10-07 04:13:34 -07:00
George Hotz
ffa33d743a good changes from openpilot_compile2 (#2000) 
* good changed from openpilot_compile2

* float32 image type was wrong

* cleaner way to write that + a test
 2023-10-06 13:33:24 -07:00
chenyu
05be57f57f Fix llama with empty prompt (#1997) 
* fix llama with one token prompt

* llama is all_jitted
 2023-10-06 06:48:07 -07:00
George Hotz
7a68060422 Revert "allow local + grouped reduce in hand_coded (#1996)" (#1998) 
This reverts commit 219a1f7063.
 2023-10-06 06:43:28 -07:00
nimlgen
219a1f7063 allow local + grouped reduce in hand_coded (#1996) 
* allow local + grouped reduce in hand_coded

* allowed loop size based on global_dims

* fix const

* fix const one more time

* better divisor

* a bit fix

* can take 2, why not

* fix linter

* better comments

* start with 2

* not always pick group reduce

* fix images

* better images

* better
 2023-10-06 06:11:28 -07:00
George Hotz
fa9945dac0 remove stale tests 2023-10-06 02:14:56 -07:00
Vidhan Bhatt
94b21c41a7 ci: use mypy.ini (#1993) 2023-10-06 01:45:28 -07:00
George Hotz
e43d8977f8 Revert "chore: add py.typed marker. (#1991)" (#1994) 
This reverts commit 6d581e8911.
 2023-10-06 01:44:34 -07:00
Vidhan Bhatt
6d581e8911 chore: add py.typed marker. (#1991) 
* chore: add `py.typed` marker.

* fix: add comma
 2023-10-05 16:27:33 -07:00
chenyu
da2b3e55f4 simpler llama - don't shrink twice (#1981) 2023-10-05 14:31:46 -07:00
Roelof van Dijk
972d9ea215 fix: PRUNEGRAPH is unused (#1985) 2023-10-05 14:28:43 -07:00
George Hotz
21a2c5df73 fix up contiguous (#1978) 2023-10-05 07:22:05 -07:00
chenyu
c99fa58dd2 simplify gpt2 example (#1973) 
* simplify gpt2 example

* kernel_jitted_count and jit tests

* Revert "kernel_jitted_count and jit tests"

This reverts commit 31a3c26dd0.

* all_jitted test in test_real_world
 2023-10-05 07:09:29 -07:00
George Hotz
2d0c1037b1 Fix up latest openpilot model (#1976) 
* fix gemv triggering for gemm

* fixup_openpilot

* external test issues
 2023-10-05 05:24:28 -07:00
George Hotz
1862e14a4f fix gemv triggering for gemm (#1975) 2023-10-05 05:23:00 -07:00
Francis Lam
0ba75c4370 optimizer: add matvec optimizations (#1972) 
* optimizer: add matvec optimizations

* renderer: fix alignment of shared memory in opencl
 2023-10-04 14:16:27 -07:00
George Hotz
3d5127038c don't create linearizer if we are in the method cache (#1969) 
* don't create linearizer if we are in the method cache

* remove unchecked properties

* that key isn't used

* fix default type is sticky
 2023-10-04 12:42:58 -07:00
George Hotz
de5d603ec1 corealize + remove realize from lazybuffer (#1968) 
* corealize + remove realize from lazybuffer

* fix multigpu

* fix graph
 2023-10-04 10:59:31 -07:00
George Hotz
88b6ed6945 disable broken optim_conv2d 2023-10-04 07:33:50 -07:00
George Hotz
d449b3bef1 think about removing realize from lazybuffer (#1965) 
* remove realize from lazybuffer

* okay fine, back that off

* fix tests maybe

* fix test
 2023-10-04 07:18:58 -07:00
nimlgen
2ea1dd3e87 no process() in Linearizer (#1966) 
* no process() in Linearizer

* more process() clean up
 2023-10-04 07:18:42 -07:00