10417 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
George Hotz	2a10116bfa	support drawing graphs	2022-01-16 10:45:58 -08:00
George Hotz	6a5cb6842e	make profiler work for backward pass too	2022-01-16 09:35:10 -08:00
George Hotz	2cae2dfa07	don't crash the dataloader for imagenet	2022-01-16 08:41:26 -08:00
George Hotz	907ff7dbb6	imagenet is training	2022-01-15 23:27:31 -08:00
George Hotz	d1e082e0ef	add imagenet training support	2022-01-15 23:16:38 -08:00
George Hotz	ade2af7ac0	data doesn't require grad	2022-01-15 22:41:27 -08:00
George Hotz	0973e54eb0	fix DEBUG for GPU	2022-01-15 22:14:28 -08:00
George Hotz	d844ecee27	track running stats by default, and detach	2022-01-15 21:46:54 -08:00
George Hotz	d541e2a8e5	move assert, remove comment	2022-01-15 21:36:58 -08:00
George Hotz	845bb1fc34	bs 4 -> 2 in training test	2022-01-15 21:34:21 -08:00
George Hotz	c0d1254003	don't run unneeded grads	2022-01-15 21:32:13 -08:00
George Hotz	ecc0903451	Revert "faster deepwalk" ... This reverts commit 931500a098.	2022-01-15 21:02:18 -08:00
George Hotz	931500a098	faster deepwalk	2022-01-15 20:57:57 -08:00
cjg91	7025c9bbeb	Transfer learning for ResNet (#295) ... * Transfer learning for ResNet * moved ResNet depth specifics into the class	2022-01-15 23:22:10 -05:00
George Hotz	55d792b065	Revert "fixup resnet" ... This reverts commit 4eabe677ed.	2022-01-15 20:22:01 -08:00
George Hotz	4eabe677ed	fixup resnet	2022-01-15 20:21:02 -08:00
George Hotz	e0bef0bd01	training is False by default	2022-01-15 19:57:41 -08:00
George Hotz	8ba3d1f803	fix bn test, affine is True	2022-01-15 19:52:15 -08:00
George Hotz	8ec2341cca	fix bn training	2022-01-15 19:47:01 -08:00
George Hotz	0e6832a8ea	support torch GPU, only autoinit cuda in the buffer	2022-01-15 19:15:12 -08:00
George Hotz	d8d19ed468	wikimedia wasn't returning 200	2022-01-15 19:09:29 -08:00
George Hotz	52918fbf78	cuda stub	2022-01-15 19:02:17 -08:00
Jacky Lee	81664baf64	Fix OpenCL installation (#301)	2022-01-06 10:35:48 -05:00
George Hotz	b0511f9392	Revert "does pybind fix CI?" ... This reverts commit d128e4fcae.	2021-12-30 14:13:58 -05:00
George Hotz	d128e4fcae	does pybind fix CI?	2021-12-30 14:11:39 -05:00
George Hotz	5efb6653c4	a bit of work on metal	2021-12-30 13:53:08 -05:00
George Hotz	c0c2c0b041	support larger ViT models	2021-12-12 10:45:10 -08:00
George Hotz	785fe8ead7	unify torch Slice	2021-11-30 16:25:37 -05:00
George Hotz	e59381d0da	cleanups, remove np	2021-11-30 16:22:00 -05:00
George Hotz	e28cdfb0cf	clean up resnet	2021-11-30 16:14:54 -05:00
George Hotz	8f5779eeaa	very minor change	2021-11-30 15:54:03 -05:00
George Hotz	d31ef0ae48	make vit names match pytorch	2021-11-30 11:34:14 -05:00
George Hotz	4b7c31b5b7	break vit into it's own file	2021-11-30 11:19:22 -05:00
George Hotz	46bbbcf7f0	model touchups	2021-11-30 11:13:34 -05:00
George Hotz	7d7e2b690d	clean up Conv2d	2021-11-30 11:02:55 -05:00
George Hotz	835869974c	clean up vit code	2021-11-30 10:58:03 -05:00
George Hotz	6884add850	save two lines	2021-11-30 01:16:48 -05:00
George Hotz	9b538629bb	cosmetic	2021-11-30 01:01:39 -05:00
George Hotz	38dccb3a2e	same simpler sum and max for gpu	2021-11-30 00:59:05 -05:00
George Hotz	5d60df2b10	simpler sum and max	2021-11-30 00:53:27 -05:00
George Hotz	c39824bc62	oops, forgot some stars	2021-11-30 00:46:14 -05:00
George Hotz	908db3bdea	support bias in conv like linear	2021-11-30 00:44:59 -05:00
George Hotz	bd21304e3c	linear takes in weight and bias	2021-11-30 00:38:47 -05:00
George Hotz	535f02cc64	use sequential	2021-11-30 00:25:39 -05:00
George Hotz	de938c2d9d	vit is now tested	2021-11-30 00:23:06 -05:00
George Hotz	aff810e722	unify transformer block	2021-11-29 18:58:15 -05:00
George Hotz	58ed46963e	fix broadcastdot	2021-11-29 18:54:57 -05:00
George Hotz	033b04494a	resnet pretrained is broken	2021-11-29 18:13:52 -05:00
George Hotz	125e74293f	promote layernorm to tensor op	2021-11-29 18:08:21 -05:00
George Hotz	dca076dbf1	remove dumb nn ops	2021-11-29 18:05:31 -05:00