github/SHARK-Studio
1
1
Fork 0
mirror of https://github.com/nod-ai/SHARK-Studio.git synced 2026-05-12 03:00:11 -04:00
Code Issues Packages Projects Releases Wiki Activity
773 Commits 66 Branches 705 Tags
20221222.404
Commit Graph

86 Commits

Author SHA1 Message Date
powderluv
37262a2479 Remove spurious characters 2022-12-21 19:23:54 -08:00
Gaurav Shukla
de6e304959 [SD] Fix the resource location in shark_sd.spec (#706) 2022-12-21 14:41:56 -08:00
Quinn Dawkins
234475bbc7 Add base_vae entries for variant models (#705) 2022-12-21 14:35:08 -08:00
Quinn Dawkins
abbd9f7cfc [SD] Set unet flags for cuda (#704) 2022-12-21 13:22:04 -08:00
Gaurav Shukla
dfd6ba67b3 [SD] Update SD CLI to use model_db.json 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-22 02:13:04 +05:30
Gaurav Shukla
726c062327 [SD] Update spec files 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-21 14:16:04 +05:30
Gaurav Shukla
9083672de3 [SD][web] Tuned models only for stablediffusion/fp16 and rdna3 cards 
Currently tuned models are only available for stablediffusion/fp16 and
rdna3 cards.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-21 14:15:39 +05:30
Quinn Dawkins
cdbaf880af [SD] [web] Add model variants to web 2022-12-21 13:42:22 +05:30
Gaurav Shukla
0d5173833d [SD] Add a json file for model names information. (#687) 
This commit simplifies the code to identify the model name for a
particular set of flags. This is achieved by introducing a json file
that stores the model names information. The models are uploaded in
gcloud with these names.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>

Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-20 11:47:31 -08:00
yzhang93
abcd3fa94a [SD] Set model max length 64 as default (#681) 2022-12-19 21:13:04 -08:00
Quinn Dawkins
62aa1614b6 [SD] Add --use_base_vae flag to do conversion to pixel space on cpu (#682) 2022-12-19 21:09:39 -08:00
yzhang93
5ebe13a13d Add Unet len 64 tuned model (#679) 2022-12-19 16:24:08 -08:00
Gaurav Shukla
c3bed9a2b7 [SD][web] Add flag to disable the progress bar animation 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-20 02:50:04 +05:30
yzhang93
f865222882 Update VAE 19dec tuned model (#676) 2022-12-19 12:42:28 -08:00
Gaurav Shukla
097d0f27bb [SD][web] Add 64 max_length support in SD web 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-20 00:00:58 +05:30
Gaurav Shukla
7986b9b20b [SD][WEB] Update VAE model and wrapper 
This commit updates VAE model which significantly improves performance
by an order of ~300ms.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-19 22:32:05 +05:30
Gaurav Shukla
b2b3a0a62b [SD] Move initial latent generation out of inference time 
The initial random latent generation is not taken into account
for total SD inference time.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-19 22:32:05 +05:30
Gaurav Shukla
9d716d70d6 [SD][web] Fix performance issues on shark scheduler 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-19 17:44:37 +05:30
Quinn Dawkins
7d0cbd8d90 [SD][web] Set default tuned unet to v2 (#663) 2022-12-19 11:50:08 +07:00
Quinn Dawkins
59358361f9 [SD] Make clip batch 2 for positive and negative prompts (#662) 
Combines the forward passes for each input prompt type into a single batched clip pass.
 2022-12-18 23:46:21 -05:00
Quinn Dawkins
7fea2d3b68 [SD] update default large heap size for web as well (#661) 2022-12-18 21:50:26 -05:00
Stella Laurenzo
523e63f5c1 Fix NoneType exception if vulkan tuning flags not detected. (#659) 
(This goes on to produce compilation errors, but one step at a time)
 2022-12-18 16:40:56 -08:00
Quinn Dawkins
2bc6de650d [SD] Add support for a compiled version of the discrete Euler scheduler (#657) 
* Add Shark version of euler scheduler

* Add Shark version of euler scheduler to web ui
 2022-12-17 19:25:43 -08:00
Gaurav Shukla
10160a066a [SD][WEB] Add vae tuned model in the SD web (#653) 
1. Add tuned vae model in the SD web.
2. Use tuned models in case of rdna3 cards.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>

Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-16 15:29:48 -08:00
Anush Elangovan
72976a2ece Import env vars first 2022-12-16 15:12:28 -08:00
Gaurav Shukla
72648aa9f2 Revert "[SD][WEB] Deduce vulkan-target-triple in the presence of multiple cards" 
This reverts commit 35e623deaf.
 2022-12-17 04:28:18 +05:30
Gaurav Shukla
35e623deaf [SD][WEB] Deduce vulkan-target-triple in the presence of multiple cards 
1. Get the correct vulkan-target-triple for a specified device in the
   presence of multiple cards.
2. Use tuned unet model for rdna3 cards.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-17 03:04:47 +05:30
Anush Elangovan
535d012ded Fix lint 2022-12-16 13:24:51 -08:00
Anush Elangovan
30fdc99f37 Set to enable llpc 
Use an env var to enable llpc
 2022-12-16 12:57:30 -08:00
Gaurav Shukla
bba06d0142 [SD][WEB] Avoid passing args to utils APIs 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-17 01:41:33 +05:30
Gaurav Shukla
e7e763551a [WEB][SD] Make unet tuned model default for rdna3 devices (#642) 2022-12-15 12:02:03 -08:00
Gaurav Shukla
a15cb140ae [WEB] Display the 512x512 image size 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 22:43:03 +05:30
Gaurav Shukla
e67ea31ee2 [SHARK][SD] Add --local_tank_cache flag in the stable diffusion 
This flag can be used to set local shark_tank cache directory.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 20:00:25 +05:30
Gaurav Shukla
986c126a5c [SHARK][SD] Add support for negative prompts 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 18:20:09 +05:30
Gaurav Shukla
0eee7616b9 [WEB] Launch only one SD version at a time 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 17:30:24 +05:30
Gaurav Shukla
d913453e57 [WEB] Update models to 8dec and also default values (#620) 
1. Update the models to 8 dec.
2. precision is default to `fp16` in CLI.
3. version is default to `v2.1base` in CLI as well as web.
4. The default scheduler is set to `EulerDiscrete` now.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>

Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-13 13:08:33 -08:00
Gaurav Shukla
5f5e0766dd [WEB] Add SD2.1 web support 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-13 21:36:01 +05:30
Gaurav Shukla
b62ee3fcb9 [WEB] Add schedulers in the web UI (#594) 
1. Add schedulers option in web UI.
2. Remove random seed checkbox as the same functionality can be achieved
   by passing -1(or any negative number) to the seed.

Signed-Off-by: Gaurav Shukla

Signed-off-by: Gaurav Shukla
 2022-12-08 13:53:20 -08:00
Ean Garvey
0225292a44 Remove print statements from compile utils (#593) 2022-12-08 13:40:47 -08:00
Quinn Dawkins
b3a42cd0b1 Don't do nchw-to-nhwc transpose for stable diffusion models (#592) 2022-12-08 12:19:23 -05:00
Gaurav Shukla
e3e1ca7cc6 [WEB] Fix seed when out of uint32 range 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-08 22:46:33 +05:30
Gaurav Shukla
57e417d174 [WEB] Fix web performance 
Set the iree flags before compilation.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-08 19:57:20 +05:30
Quinn Dawkins
dab9403b8f Fix slow conversion to image in SD web gui (#586) 2022-12-08 00:35:51 -05:00
Gaurav Shukla
e9e138c757 [WEB] Add random seed checkbox 
When True, it will not use user specified seed, instead will generate a
random seed.

Signed-Off-by: Gaurav Shukla
 2022-12-06 21:44:22 +05:30
Gaurav Shukla
29cc478525 [WEB] Add command line args to shark web 
1. Now the server can be launched with command line args.
2. The `precision` and `scheduler` parameters are now part of command
   line args instead of UI.
3. Add vae encode model wrapper.

Signed-Off-by: Gaurav Shukla
 2022-12-06 17:21:05 +05:30
Anush Elangovan
27b34f3929 Add gcs instead of gsutil 
Test .exe on AMD hardware.
 2022-12-05 22:17:58 -08:00
Daniel Garvey
8859853b41 Revert "Revert "find gsutil on linux (#557)" (#560)" (#561) 
This reverts commit 3c46021102.
 2022-12-05 20:27:43 -08:00
Daniel Garvey
3c46021102 Revert "find gsutil on linux (#557)" (#560) 
This reverts commit bba8646669.
 2022-12-05 21:53:47 -06:00
Daniel Garvey
bba8646669 find gsutil on linux (#557) 
* find gsutil on linux

* cleaned up downloader and ditched gsutil

Co-authored-by: dan <dan@nod-labs.com>
 2022-12-05 19:03:48 -08:00
Anush Elangovan
56109fe09b Add one click installer 
Build with pyinstaller web\shark_sd.spec
 2022-12-02 14:07:10 -08:00