Commit Graph

1179 Commits

Author SHA1 Message Date
George Hotz
801ecd4a07 cleanup clip tokenizer 2022-09-12 09:20:12 -07:00
Fernand Pajot
ff0da4c802 Added standalone CLIP tokenizer (#382)
* Added standalone CLIP tokenizer.

* Fixed empty phrase.

* Truncating long prompts.

* Keeping two slots for the start and end token.

* Fixed empty phrase.

* Using tokenizer for empty phrase.

* Typo.
2022-09-12 09:12:55 -07:00
David Redmon
a1810c8617 update serious_mnist.py (#380) 2022-09-11 13:37:40 -07:00
George Hotz
ecc1a0470d add Linear to tinygrad.nn 2022-09-07 07:40:48 -07:00
George Hotz
896f9f74a9 hmm, need this with broadcast change 2022-09-06 16:54:01 -07:00
George Hotz
a18a6a0773 fix sd with TORCH=1 2022-09-06 16:51:16 -07:00
George Hotz
0516359af8 fix stupid OPENCL=1 OOM 2022-09-06 14:29:23 -07:00
George Hotz
f215534a64 1100 lines, but sane linter rules 2022-09-06 13:47:45 -07:00
George Hotz
682dc64430 works at work 2022-09-06 08:06:11 -07:00
George Hotz
d6f499fd69 improve opencl, why is it OOMing 2022-09-05 20:14:31 -07:00
George Hotz
0ba6179de7 stable diffusion in readme 2022-09-05 18:51:56 -07:00
George Hotz
c1d5af8b0c stable diffusion cleanups 2022-09-05 18:34:13 -07:00
George Hotz
3728ef6d02 better alphas 2022-09-05 16:48:26 -07:00
George Hotz
0fda854b3e other prompt example 2022-09-05 16:14:16 -07:00
George Hotz
16cb4290c4 cat horse winning 2022-09-05 16:05:14 -07:00
George Hotz
1043fa067a it renders something 2022-09-05 15:52:14 -07:00
George Hotz
5a685b93ac brown img 2022-09-05 15:20:18 -07:00
George Hotz
98d6264987 all models match 2022-09-05 12:27:54 -07:00
George Hotz
b8bd34b5d2 fix last bug in unet probz 2022-09-05 11:32:44 -07:00
George Hotz
3df67aa0af fix transformer bugs 2022-09-05 11:26:32 -07:00
George Hotz
2ed3bb6223 clip model is running 2022-09-05 11:26:32 -07:00
George Hotz
1a54ea2417 runs on torch cpu 2022-09-04 12:06:42 -07:00
George Hotz
9590d92750 stable diffusion compiles (add no_init) 2022-09-04 11:40:50 -07:00
George Hotz
172683c314 work 2022-09-04 11:21:09 -07:00
George Hotz
c2a030fe55 one liner that's more clear 2022-09-03 16:08:48 -07:00
George Hotz
4a3ed58edb more readable actually 2022-09-03 16:00:35 -07:00
George Hotz
633f31dc73 easier to read 2022-09-03 15:53:58 -07:00
George Hotz
6578e08919 cleanups for Mid 2022-09-03 15:50:33 -07:00
George Hotz
852de7c66c remove ugly parens 2022-09-03 15:41:37 -07:00
George Hotz
6b190c2fa5 stable diffusion works 2022-09-03 13:55:36 -07:00
George Hotz
947e10dab0 yolo 2022-09-03 12:39:48 -07:00
George Hotz
033a3ecccf found tinygrad bug 2022-09-03 12:32:43 -07:00
George Hotz
114728d363 torch bs 2022-09-03 11:57:23 -07:00
George Hotz
356732515b stable_diffusion: add attn and layernorm 2022-09-03 11:02:27 -07:00
George Hotz
4dadd95e3c fix tests hopefully, more stable diffusion 2022-09-03 10:38:31 -07:00
George Hotz
c01a8c5c2d stable diffusion start 2022-09-03 10:08:42 -07:00
George Hotz
b132de677d tinygrad.nn (#367)
* tinygrad.nn

* flake8

* working on pylint

* more pylint

* more pylint

* pylint passes

* networkx

* mypy can't infer that type

* junk
2022-08-18 07:41:00 -07:00
George Hotz
acbeaf0ba9 adam in benchmark_train_efficientnet 2022-07-19 09:33:07 -07:00
George Hotz
d985217fa4 skip reduce noops 2022-07-16 07:47:43 -07:00
George Hotz
5e46561f7e no_grad = NOT backward 2022-07-10 20:54:57 -07:00
George Hotz
d5d9cffe7c training param for batchnorm 2022-07-04 13:28:03 -07:00
George Hotz
34f43ea10e LAZY and CLCACHE are defaults 2022-07-04 13:09:15 -07:00
George Hotz
b7afd83267 track cl mem used 2022-07-04 12:19:00 -07:00
George Hotz
d5de8452c6 dashed loadops 2022-07-04 09:50:56 -07:00
George Hotz
7276f8d6bf improve constant folding, detach before moving tensor 2022-07-02 15:29:40 -07:00
George Hotz
0cb99d72e9 NUM=-1 is a small efficientnet for small people 2022-07-02 15:11:51 -07:00
George Hotz
8cf1aed0f4 don't track_running_stats, parameters must require_grad 2022-07-02 14:38:45 -07:00
George Hotz
f607f18006 fix backward 2022-06-25 00:00:53 -07:00
George Hotz
ec30f0402f improve benchmark_train_efficientnet 2022-06-24 23:46:38 -07:00
George Hotz
d748353ce5 err, okay, a bit more off 2022-06-24 22:44:57 -07:00