19 Commits

Author	SHA1	Message	Date
George Hotz	49dafe6d43	add gc tests [pr] (#9718) ... * add gc tests [pr] * del * more gc tests * add NullGraph	2025-04-03 14:08:32 +08:00
George Hotz	5c7b549eab	use functools.cache instead of lru_cache(None) [pr] (#9714) ... * use functools.cache instead of lru_cache(None) [pr] * more cache	2025-04-03 11:47:13 +08:00
Sieds Lykles	990c240b82	Stable pow gradient (#9226) ... * Stable gradient * More efficient * Fix and test for +-inf * cleaner * skip webgpu test --------- Co-authored-by: chenyu <chenyu@fastmail.com>	2025-02-24 20:54:26 -05:00
chenyu	73af42aeab	fix pow backward when base is 0 (#9075)	2025-02-13 21:06:01 -05:00
chenyu	9307572fe3	Ops.POW and transcendental (#8911)	2025-02-05 15:15:59 -05:00
Ankit Avinash	7647cd8428	[bounty] Stride is flip (#8792) ... * replace stride with flip * Complete replacing stride with flip clean flip function in view.py fix tests * fix tests for multi shapetracker * fix tests for fuzz shapetracker * fix tests for fuzz shapetracker * debug * debug * fix * fix * fix --------- Co-authored-by: George Hotz <geohot@gmail.com> Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>	2025-01-31 11:34:10 +09:00
George Hotz	b4bf6a7dea	switch backward to use gradient [pr] (#8235) ... * switch backward to use gradient [pr] * set device correctly, dedup * why does that fail? * add noop cast * simple backward * fix beautiful_mnist * touchups * set in compute_gradient * uop_count * uop_count was wrong * collections * no note * skip that test * update sched kernel counts * train mnist is 65 * fix metadata and gc * fixes * materialize_grads * no pathlib stuff * add contiguous_backward, fix bugs * add some realize * fix multi	2025-01-26 09:12:16 +09:00
George Hotz	cb0978b377	add Ops.CONTIGUOUS_BACKWARD (#8743)	2025-01-25 07:28:43 +09:00
George Hotz	e82ba1454b	MultiLazyBuffer is UOp [pr] (#8662) ... * MultiLazyBuffer is UOp [pr] * this is new mlb * this is the idea * progress * multitensor works * more movement ops * this * MultiLazyBuffer is UOp * cleanups * multi axis * fix more tests * work * not that * add multi grad and move shard to ops * mops not views * no double contig * sweet, all mt tests passing * port old logic * remove lbs * fix realized * whitespace * assign tweak * test_assign_kv_cache_multi passes * fix is_realized * fix JIT for multi * just a few more lines i'll pay them back soon i swear please bro just a few more * no split reduceop for multi	2025-01-24 13:28:55 +09:00
qazal	611208cd8a	Revert "Revert "move subbuffer to a rewrite rule in the scheduler (#8639)" (…" (#8643) ... This reverts commit 82ef956cb8.	2025-01-16 04:30:11 -05:00
qazal	82ef956cb8	Revert "move subbuffer to a rewrite rule in the scheduler (#8639)" (#8641) ... This reverts commit d5c90da286.	2025-01-16 03:29:07 -05:00
qazal	d5c90da286	move subbuffer to a rewrite rule in the scheduler (#8639) ... * delete buffer_view from tensor * add to the scheduler * move buffer_view to the scheduler * gradient doesn't care. * for/with	2025-01-16 03:14:28 +02:00
George Hotz	e1f7c90459	gradient is a set [pr] (#8626) ... * gradient is a set [pr] * typing for deepwalk	2025-01-14 20:48:23 -08:00
George Hotz	f29d6f54b8	support multilb gradient [pr] (#8624)	2025-01-14 18:33:33 -08:00
George Hotz	734f2c5344	compute gradient [pr] (#8237) ... * compute gradient [pr] * schedule_step_with_grads * second deriv works	2024-12-13 20:46:01 -08:00
George Hotz	8396d90f91	non controversial changes from optim branch [pr] (#8234)	2024-12-13 19:24:16 -08:00
George Hotz	37fa38d272	Revert "switch beautiful_mnist to use new optimizer [pr] (#8231)" (#8233) ... This reverts commit e9ee39df22.	2024-12-13 19:07:09 -08:00
George Hotz	e9ee39df22	switch beautiful_mnist to use new optimizer [pr] (#8231) ... * switch beautiful_mnist to use new optimizer [pr] * fix abstractions3 + docs * fix OptimizerGroup with schedule_step api	2024-12-13 18:27:16 -08:00
George Hotz	e2f87ecf36	start work on new gradient (#7838) ... * start work on new gradient * more correct * working tests * more tests * work * add (faliing) gradient test * add view and reduce gradient * test_add works, many failing test_ops * add max and reduce max * add max and reduce max * 129 failing * 108 failed * better view drawing * 101 failed * i got 99 failures * 94 failures * it's tons of terrible code, but only 50 tests fail * only 19 failures * same 19 but shorter * minimal doesn't matter * shorter * lil simpler * simpler * simpler * simpler * 13 test failures * nine tests fail * all ops tests pass * add contiguous gradient + fix sched tests * faster by removing toposort calls * missed one * add jax to testing	2024-12-13 16:45:53 -08:00