159 Commits

Author	SHA1	Message	Date
George Hotz	03b38864db	fix batchnorm at training (#753) ... * e2e testing * min failure * no affine on bn, still fails * why did i think i could detach that? * allow more kernels for bn * some test issue i don't understand	2023-04-19 08:01:04 -07:00
George Hotz	30b795874a	remove RMSprop, nobody uses it anymore	2023-03-20 12:31:34 -07:00
George Hotz	623fb1ef28	do test_conv_with_bn test	2023-03-19 23:53:56 -07:00
George Hotz	305b9f2d21	multistep optim tests passing	2023-03-11 17:49:53 -08:00
George Hotz	b14d31d6db	ConvNeXt + extras (#657) ... * simple convnext implementation * shorter function names * need to realize the random functions now * creating an optimizer realizes all params * assign contiguous * fix lazy lazy * why was i doing that...add convnext to tests * LazyNumpyArray * enable assert + comment * no two tiny	2023-03-06 22:10:56 -08:00
George Hotz	7dbcc26582	fix up external tests	2023-03-06 06:52:28 -08:00
George Hotz	9bd2cdee08	skip broken bn training test for speed	2023-03-03 06:52:11 -08:00
George Hotz	999b44c274	fix external test + speed	2023-03-03 06:46:16 -08:00
George Hotz	8919ca8163	test cleanups	2023-03-03 06:36:06 -08:00