Commit Graph

171 Commits

Author SHA1 Message Date
George Hotz
682dc64430 works at work 2022-09-06 08:06:11 -07:00
George Hotz
d6f499fd69 improve opencl, why is it OOMing 2022-09-05 20:14:31 -07:00
George Hotz
0ba6179de7 stable diffusion in readme 2022-09-05 18:51:56 -07:00
George Hotz
c1d5af8b0c stable diffusion cleanups 2022-09-05 18:34:13 -07:00
George Hotz
3728ef6d02 better alphas 2022-09-05 16:48:26 -07:00
George Hotz
0fda854b3e other prompt example 2022-09-05 16:14:16 -07:00
George Hotz
16cb4290c4 cat horse winning 2022-09-05 16:05:14 -07:00
George Hotz
1043fa067a it renders something 2022-09-05 15:52:14 -07:00
George Hotz
5a685b93ac brown img 2022-09-05 15:20:18 -07:00
George Hotz
98d6264987 all models match 2022-09-05 12:27:54 -07:00
George Hotz
b8bd34b5d2 fix last bug in unet probz 2022-09-05 11:32:44 -07:00
George Hotz
3df67aa0af fix transformer bugs 2022-09-05 11:26:32 -07:00
George Hotz
2ed3bb6223 clip model is running 2022-09-05 11:26:32 -07:00
George Hotz
1a54ea2417 runs on torch cpu 2022-09-04 12:06:42 -07:00
George Hotz
9590d92750 stable diffusion compiles (add no_init) 2022-09-04 11:40:50 -07:00
George Hotz
172683c314 work 2022-09-04 11:21:09 -07:00
George Hotz
c2a030fe55 one liner that's more clear 2022-09-03 16:08:48 -07:00
George Hotz
4a3ed58edb more readable actually 2022-09-03 16:00:35 -07:00
George Hotz
633f31dc73 easier to read 2022-09-03 15:53:58 -07:00
George Hotz
6578e08919 cleanups for Mid 2022-09-03 15:50:33 -07:00
George Hotz
852de7c66c remove ugly parens 2022-09-03 15:41:37 -07:00
George Hotz
6b190c2fa5 stable diffusion works 2022-09-03 13:55:36 -07:00
George Hotz
947e10dab0 yolo 2022-09-03 12:39:48 -07:00
George Hotz
033a3ecccf found tinygrad bug 2022-09-03 12:32:43 -07:00
George Hotz
114728d363 torch bs 2022-09-03 11:57:23 -07:00
George Hotz
356732515b stable_diffusion: add attn and layernorm 2022-09-03 11:02:27 -07:00
George Hotz
4dadd95e3c fix tests hopefully, more stable diffusion 2022-09-03 10:38:31 -07:00
George Hotz
c01a8c5c2d stable diffusion start 2022-09-03 10:08:42 -07:00
George Hotz
b132de677d tinygrad.nn (#367)
* tinygrad.nn

* flake8

* working on pylint

* more pylint

* more pylint

* pylint passes

* networkx

* mypy can't infer that type

* junk
2022-08-18 07:41:00 -07:00
George Hotz
acbeaf0ba9 adam in benchmark_train_efficientnet 2022-07-19 09:33:07 -07:00
George Hotz
d985217fa4 skip reduce noops 2022-07-16 07:47:43 -07:00
George Hotz
5e46561f7e no_grad = NOT backward 2022-07-10 20:54:57 -07:00
George Hotz
d5d9cffe7c training param for batchnorm 2022-07-04 13:28:03 -07:00
George Hotz
34f43ea10e LAZY and CLCACHE are defaults 2022-07-04 13:09:15 -07:00
George Hotz
b7afd83267 track cl mem used 2022-07-04 12:19:00 -07:00
George Hotz
d5de8452c6 dashed loadops 2022-07-04 09:50:56 -07:00
George Hotz
7276f8d6bf improve constant folding, detach before moving tensor 2022-07-02 15:29:40 -07:00
George Hotz
0cb99d72e9 NUM=-1 is a small efficientnet for small people 2022-07-02 15:11:51 -07:00
George Hotz
8cf1aed0f4 don't track_running_stats, parameters must require_grad 2022-07-02 14:38:45 -07:00
George Hotz
f607f18006 fix backward 2022-06-25 00:00:53 -07:00
George Hotz
ec30f0402f improve benchmark_train_efficientnet 2022-06-24 23:46:38 -07:00
George Hotz
d748353ce5 err, okay, a bit more off 2022-06-24 22:44:57 -07:00
George Hotz
bdde95f16e CACHE_LAZYBUFFERS options + benchmark. only a couple x from torch 2022-06-24 22:33:53 -07:00
Edward Betts
a6203b5ecd Correct spelling mistakes (#314) 2022-04-05 05:22:18 -07:00
Ildar Kashaev
d065040df0 Fix yolo param name (#306) 2022-02-10 01:40:24 -07:00
George Hotz
2a10116bfa support drawing graphs 2022-01-16 10:45:58 -08:00
George Hotz
2cae2dfa07 don't crash the dataloader for imagenet 2022-01-16 08:41:26 -08:00
George Hotz
907ff7dbb6 imagenet is training 2022-01-15 23:27:31 -08:00
George Hotz
d1e082e0ef add imagenet training support 2022-01-15 23:16:38 -08:00
George Hotz
ade2af7ac0 data doesn't require grad 2022-01-15 22:41:27 -08:00