George Hotz
801ecd4a07
cleanup clip tokenizer
2022-09-12 09:20:12 -07:00
Fernand Pajot
ff0da4c802
Added standalone CLIP tokenizer ( #382 )
...
* Added standalone CLIP tokenizer.
* Fixed empty phrase.
* Truncating long prompts.
* Keeping two slots for the start and end token.
* Fixed empty phrase.
* Using tokenizer for empty phrase.
* Typo.
2022-09-12 09:12:55 -07:00
David Redmon
a1810c8617
update serious_mnist.py ( #380 )
2022-09-11 13:37:40 -07:00
George Hotz
ecc1a0470d
add Linear to tinygrad.nn
2022-09-07 07:40:48 -07:00
George Hotz
896f9f74a9
hmm, need this with broadcast change
2022-09-06 16:54:01 -07:00
George Hotz
a18a6a0773
fix sd with TORCH=1
2022-09-06 16:51:16 -07:00
George Hotz
0516359af8
fix stupid OPENCL=1 OOM
2022-09-06 14:29:23 -07:00
George Hotz
f215534a64
1100 lines, but sane linter rules
2022-09-06 13:47:45 -07:00
George Hotz
682dc64430
works at work
2022-09-06 08:06:11 -07:00
George Hotz
d6f499fd69
improve opencl, why is it OOMing
2022-09-05 20:14:31 -07:00
George Hotz
0ba6179de7
stable diffusion in readme
2022-09-05 18:51:56 -07:00
George Hotz
c1d5af8b0c
stable diffusion cleanups
2022-09-05 18:34:13 -07:00
George Hotz
3728ef6d02
better alphas
2022-09-05 16:48:26 -07:00
George Hotz
0fda854b3e
other prompt example
2022-09-05 16:14:16 -07:00
George Hotz
16cb4290c4
cat horse winning ❗
2022-09-05 16:05:14 -07:00
George Hotz
1043fa067a
it renders something
2022-09-05 15:52:14 -07:00
George Hotz
5a685b93ac
brown img
2022-09-05 15:20:18 -07:00
George Hotz
98d6264987
all models match
2022-09-05 12:27:54 -07:00
George Hotz
b8bd34b5d2
fix last bug in unet probz
2022-09-05 11:32:44 -07:00
George Hotz
3df67aa0af
fix transformer bugs
2022-09-05 11:26:32 -07:00
George Hotz
2ed3bb6223
clip model is running
2022-09-05 11:26:32 -07:00
George Hotz
1a54ea2417
runs on torch cpu
2022-09-04 12:06:42 -07:00
George Hotz
9590d92750
stable diffusion compiles (add no_init)
2022-09-04 11:40:50 -07:00
George Hotz
172683c314
work
2022-09-04 11:21:09 -07:00
George Hotz
c2a030fe55
one liner that's more clear
2022-09-03 16:08:48 -07:00
George Hotz
4a3ed58edb
more readable actually
2022-09-03 16:00:35 -07:00
George Hotz
633f31dc73
easier to read
2022-09-03 15:53:58 -07:00
George Hotz
6578e08919
cleanups for Mid
2022-09-03 15:50:33 -07:00
George Hotz
852de7c66c
remove ugly parens
2022-09-03 15:41:37 -07:00
George Hotz
6b190c2fa5
stable diffusion works
2022-09-03 13:55:36 -07:00
George Hotz
947e10dab0
yolo
2022-09-03 12:39:48 -07:00
George Hotz
033a3ecccf
found tinygrad bug
2022-09-03 12:32:43 -07:00
George Hotz
114728d363
torch bs
2022-09-03 11:57:23 -07:00
George Hotz
356732515b
stable_diffusion: add attn and layernorm
2022-09-03 11:02:27 -07:00
George Hotz
4dadd95e3c
fix tests hopefully, more stable diffusion
2022-09-03 10:38:31 -07:00
George Hotz
c01a8c5c2d
stable diffusion start
2022-09-03 10:08:42 -07:00
George Hotz
b132de677d
tinygrad.nn ( #367 )
...
* tinygrad.nn
* flake8
* working on pylint
* more pylint
* more pylint
* pylint passes
* networkx
* mypy can't infer that type
* junk
2022-08-18 07:41:00 -07:00
George Hotz
acbeaf0ba9
adam in benchmark_train_efficientnet
2022-07-19 09:33:07 -07:00
George Hotz
d985217fa4
skip reduce noops
2022-07-16 07:47:43 -07:00
George Hotz
5e46561f7e
no_grad = NOT backward
2022-07-10 20:54:57 -07:00
George Hotz
d5d9cffe7c
training param for batchnorm
2022-07-04 13:28:03 -07:00
George Hotz
34f43ea10e
LAZY and CLCACHE are defaults
2022-07-04 13:09:15 -07:00
George Hotz
b7afd83267
track cl mem used
2022-07-04 12:19:00 -07:00
George Hotz
d5de8452c6
dashed loadops
2022-07-04 09:50:56 -07:00
George Hotz
7276f8d6bf
improve constant folding, detach before moving tensor
2022-07-02 15:29:40 -07:00
George Hotz
0cb99d72e9
NUM=-1 is a small efficientnet for small people
2022-07-02 15:11:51 -07:00
George Hotz
8cf1aed0f4
don't track_running_stats, parameters must require_grad
2022-07-02 14:38:45 -07:00
George Hotz
f607f18006
fix backward
2022-06-25 00:00:53 -07:00
George Hotz
ec30f0402f
improve benchmark_train_efficientnet
2022-06-24 23:46:38 -07:00
George Hotz
d748353ce5
err, okay, a bit more off
2022-06-24 22:44:57 -07:00