github/SHARK-Studio
1
1
Fork 0
mirror of https://github.com/nod-ai/SHARK-Studio.git synced 2026-04-20 03:00:34 -04:00
Code Issues Packages Projects Releases Wiki Activity
807 Commits 66 Branches 705 Tags
20230106.430
Commit Graph

102 Commits

Author SHA1 Message Date
Gaurav Shukla
b604f36881 [SD][web] Add flags for global URL and server port 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2023-01-05 15:30:30 +05:30
Abhishek Varma
e60b4568c6 [SharkInference] Make SharkInference compile the entire module (#708) 
* [SharkInference] Make SharkInference compile the entire module

-- Previously SharkInference was compiling and providing run APIs
   for a harcoded function with function name "forward".
-- This commit makes the compiling functionality generic and now
   any function being defined within the module can be run.
-- It also creates an API to fetch all the function names defined
   within the compiled module.
-- This commit updates both web and command-line execution of Stable
   Diffusion to use new API of  SharkInference.

Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
 2023-01-03 23:25:23 +05:30
jinchen62
f6064a2b84 Add a prototype of the model compilation configs for SD (#734) 2022-12-28 15:14:36 -08:00
Quinn Dawkins
2e90cb7b95 Set default warmup count to 0 (#736) 2022-12-28 12:27:43 -06:00
Gaurav Shukla
45af40fd14 [SD][web] Add openjourney and dreamlike in SD web UI 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-26 01:59:36 +05:30
Gaurav Shukla
c3c1e3b055 [SD] Add bucket info in the model_db.json 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-25 20:38:33 +05:30
Gaurav Shukla
7c5e3b1d99 [SD] Fix flags for cuda devices 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-25 19:03:02 +05:30
Gaurav Shukla
ed6cec71e7 [SD] Fix clip inference time 
Fix clip inference time by adding default warmup_count to 5.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-25 18:16:53 +05:30
Tobby "GTD-Carthage" Ong
d6bcdd069c - Added missing double linebreak from linting 2022-12-25 12:07:43 +05:30
Tobby "GTD-Carthage" Ong
a26347826d - Revised code to also use get_schedulers function instead 2022-12-25 12:07:43 +05:30
Tobby "GTD-Carthage" Ong
5d1c099b31 [SD] Add Euler Ancestral scheduler as option to WebUI 2022-12-25 12:07:43 +05:30
Gaurav Shukla
220bee1365 [SD][web] Add device support in the SD web UI 
1. Now device selection is available through UI.
2. Models reloading will only happen when there will be a change in the
   settings(variant + device).

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-25 01:45:07 +05:30
Stanley Winata
136021424c [SD] Change default VMA large heap block size for windows perf. (#715) 
Windows perform can boost from 2.67s/image to 2.4523s/image.
While Linux stays the same.
 2022-12-24 01:40:58 +07:00
Gaurav Shukla
a5b70335d4 [SD][web] Add variant support in the web UI 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-23 23:18:27 +05:30
Daniel Garvey
b01f29f10d add support for clear_all (#691) 2022-12-22 11:25:03 -06:00
Gaurav Shukla
7eeb7f0715 [SD] Update all the utilities to make web and CLI codebase closer (#707) 
At this point, all the utilities of SD web and CLI are exactly same.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>

Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-22 02:49:48 -08:00
powderluv
37262a2479 Remove spurious characters 2022-12-21 19:23:54 -08:00
Gaurav Shukla
de6e304959 [SD] Fix the resource location in shark_sd.spec (#706) 2022-12-21 14:41:56 -08:00
Quinn Dawkins
234475bbc7 Add base_vae entries for variant models (#705) 2022-12-21 14:35:08 -08:00
Quinn Dawkins
abbd9f7cfc [SD] Set unet flags for cuda (#704) 2022-12-21 13:22:04 -08:00
Gaurav Shukla
dfd6ba67b3 [SD] Update SD CLI to use model_db.json 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-22 02:13:04 +05:30
Gaurav Shukla
726c062327 [SD] Update spec files 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-21 14:16:04 +05:30
Gaurav Shukla
9083672de3 [SD][web] Tuned models only for stablediffusion/fp16 and rdna3 cards 
Currently tuned models are only available for stablediffusion/fp16 and
rdna3 cards.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-21 14:15:39 +05:30
Quinn Dawkins
cdbaf880af [SD] [web] Add model variants to web 2022-12-21 13:42:22 +05:30
Gaurav Shukla
0d5173833d [SD] Add a json file for model names information. (#687) 
This commit simplifies the code to identify the model name for a
particular set of flags. This is achieved by introducing a json file
that stores the model names information. The models are uploaded in
gcloud with these names.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>

Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-20 11:47:31 -08:00
yzhang93
abcd3fa94a [SD] Set model max length 64 as default (#681) 2022-12-19 21:13:04 -08:00
Quinn Dawkins
62aa1614b6 [SD] Add --use_base_vae flag to do conversion to pixel space on cpu (#682) 2022-12-19 21:09:39 -08:00
yzhang93
5ebe13a13d Add Unet len 64 tuned model (#679) 2022-12-19 16:24:08 -08:00
Gaurav Shukla
c3bed9a2b7 [SD][web] Add flag to disable the progress bar animation 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-20 02:50:04 +05:30
yzhang93
f865222882 Update VAE 19dec tuned model (#676) 2022-12-19 12:42:28 -08:00
Gaurav Shukla
097d0f27bb [SD][web] Add 64 max_length support in SD web 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-20 00:00:58 +05:30
Gaurav Shukla
7986b9b20b [SD][WEB] Update VAE model and wrapper 
This commit updates VAE model which significantly improves performance
by an order of ~300ms.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-19 22:32:05 +05:30
Gaurav Shukla
b2b3a0a62b [SD] Move initial latent generation out of inference time 
The initial random latent generation is not taken into account
for total SD inference time.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-19 22:32:05 +05:30
Gaurav Shukla
9d716d70d6 [SD][web] Fix performance issues on shark scheduler 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-19 17:44:37 +05:30
Quinn Dawkins
7d0cbd8d90 [SD][web] Set default tuned unet to v2 (#663) 2022-12-19 11:50:08 +07:00
Quinn Dawkins
59358361f9 [SD] Make clip batch 2 for positive and negative prompts (#662) 
Combines the forward passes for each input prompt type into a single batched clip pass.
 2022-12-18 23:46:21 -05:00
Quinn Dawkins
7fea2d3b68 [SD] update default large heap size for web as well (#661) 2022-12-18 21:50:26 -05:00
Stella Laurenzo
523e63f5c1 Fix NoneType exception if vulkan tuning flags not detected. (#659) 
(This goes on to produce compilation errors, but one step at a time)
 2022-12-18 16:40:56 -08:00
Quinn Dawkins
2bc6de650d [SD] Add support for a compiled version of the discrete Euler scheduler (#657) 
* Add Shark version of euler scheduler

* Add Shark version of euler scheduler to web ui
 2022-12-17 19:25:43 -08:00
Gaurav Shukla
10160a066a [SD][WEB] Add vae tuned model in the SD web (#653) 
1. Add tuned vae model in the SD web.
2. Use tuned models in case of rdna3 cards.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>

Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-16 15:29:48 -08:00
Anush Elangovan
72976a2ece Import env vars first 2022-12-16 15:12:28 -08:00
Gaurav Shukla
72648aa9f2 Revert "[SD][WEB] Deduce vulkan-target-triple in the presence of multiple cards" 
This reverts commit 35e623deaf.
 2022-12-17 04:28:18 +05:30
Gaurav Shukla
35e623deaf [SD][WEB] Deduce vulkan-target-triple in the presence of multiple cards 
1. Get the correct vulkan-target-triple for a specified device in the
   presence of multiple cards.
2. Use tuned unet model for rdna3 cards.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-17 03:04:47 +05:30
Anush Elangovan
535d012ded Fix lint 2022-12-16 13:24:51 -08:00
Anush Elangovan
30fdc99f37 Set to enable llpc 
Use an env var to enable llpc
 2022-12-16 12:57:30 -08:00
Gaurav Shukla
bba06d0142 [SD][WEB] Avoid passing args to utils APIs 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-17 01:41:33 +05:30
Gaurav Shukla
e7e763551a [WEB][SD] Make unet tuned model default for rdna3 devices (#642) 2022-12-15 12:02:03 -08:00
Gaurav Shukla
a15cb140ae [WEB] Display the 512x512 image size 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 22:43:03 +05:30
Gaurav Shukla
e67ea31ee2 [SHARK][SD] Add --local_tank_cache flag in the stable diffusion 
This flag can be used to set local shark_tank cache directory.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 20:00:25 +05:30
Gaurav Shukla
986c126a5c [SHARK][SD] Add support for negative prompts 
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
 2022-12-14 18:20:09 +05:30