Anush Elangovan
6d6a9dcae8
Revert "Revert "Enable --device_allocator=caching""
...
This reverts commit 41ee65b377 .
2023-02-09 23:00:32 -08:00
Anush Elangovan
41ee65b377
Revert "Enable --device_allocator=caching"
...
This reverts commit 83fe477066 .
2023-02-09 23:00:06 -08:00
Anush Elangovan
83fe477066
Enable --device_allocator=caching
2023-02-09 22:58:46 -08:00
Ean Garvey
c28cc4c919
Fix local_tank_cache handling in shark_downloader. ( #981 )
2023-02-09 14:52:03 -06:00
Prashant Kumar
3595b4aaff
Incorporate latest changes in the shark_dynamo backend.
2023-02-08 20:37:30 +05:30
Ean Garvey
1eb9436836
Fix generate_sharktank args.
2023-02-07 14:06:07 +05:30
Ean Garvey
9604d9ce81
make --update_tank update only if hash mismatch
2023-02-07 14:06:07 +05:30
Ean Garvey
481d0553d8
Remove unnecessary repro_dir / shark_tmp usage
2023-02-07 14:06:07 +05:30
yzhang93
7cf31a6ae4
Fix iree-benchmark flag names ( #952 )
2023-02-04 22:24:18 -08:00
Quinn Dawkins
fbd6224b04
Revert "Revert pipelines ( #948 )" ( #951 )
...
This reverts commit 8115b26079 .
Additionally fixes img2col by adding detach elementwise from named op
passes.
2023-02-04 22:44:08 -05:00
powderluv
8115b26079
Revert pipelines ( #948 )
...
* Revert "[SD] Modify the flags to use --iree-preprocessing-pass-pipeline (#914 )"
This reverts commit a783c089a9 .
* Revert "Fix iree flags due to the change in shark-runtime (#944 )"
This reverts commit 1d38d49162 .
2023-02-04 07:09:51 -08:00
yzhang93
1d38d49162
Fix iree flags due to the change in shark-runtime ( #944 )
2023-02-03 21:34:02 -08:00
Ean Garvey
ba07e94a5e
disable Torch Inductor autotuner in benchmarks ( #919 )
2023-02-02 13:25:43 -06:00
aldesilv
b3fc0f29cc
enable additional flags for tank test models ( #866 )
...
Co-authored-by: Alex <alexander@nod-labs.com >
2023-02-02 11:19:33 -08:00
Ean Garvey
a90812133b
Enable pytests on Windows ( #901 )
2023-02-01 18:36:41 -06:00
powderluv
e26a70aa4f
Drop old cli and webui ( #911 )
2023-02-01 13:13:46 -08:00
Daniel Garvey
6a32a4e26c
move ci sd stuff to apps ( #912 )
...
Co-authored-by: dan <dan@nod-labs.com >
Co-authored-by: powderluv <powderluv@users.noreply.github.com >
2023-02-01 12:15:07 -08:00
powderluv
e853abf98b
Update stable_diffusion_amd.md
2023-02-01 11:11:58 -08:00
Daniel Garvey
e374074013
Windows test ( #896 )
...
* add generate_sharktank for stable_diffusion model defaults
* add windows test for sd
---------
Co-authored-by: dan <dan@nod-labs.com >
2023-02-01 12:03:54 -06:00
Evan Guan
8cafe56eb4
Added flags for metadata information. ( #894 )
2023-02-01 05:16:11 -08:00
Eliasj42
3eceeb7b23
fixed a bug that would sometimes cause intel-gpu to appear unsupported ( #899 )
...
Co-authored-by: Elias Joseph <elias@nod-labs.com >
2023-01-31 22:32:05 -08:00
powderluv
1a37675435
Revert "move beta to release ( #898 )" ( #905 )
...
This reverts commit 7edcaf5a06 .
2023-01-31 20:31:41 -08:00
Ean Garvey
a504903dd5
Fix formatting issues. ( #903 )
2023-02-01 09:12:45 +05:30
Daniel Garvey
7edcaf5a06
move beta to release ( #898 )
...
Co-authored-by: dan <dan@nod-labs.com >
2023-01-31 17:14:08 -06:00
Gaurav Shukla
c124b76328
[SD] Reorganize the stable diffusion model. ( #806 )
...
The stable diffusion codebase has been reorganized to make it more
modular so that the same script can be used for web as well as cli,
instead of duplicating the whole codebase.
Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-01-31 14:42:41 -08:00
aldesilv
e9c744ee5d
find rocm arch used in rocminfo ( #893 )
...
Co-authored-by: Alex <alexander@nod-labs.com >
2023-01-31 10:22:31 -08:00
Daniel Garvey
a4634632ba
add generate_sharktank for stable_diffusion model defaults ( #742 )
...
Co-authored-by: dan <dan@nod-labs.com >
Co-authored-by: powderluv <powderluv@users.noreply.github.com >
2023-01-31 09:44:54 -08:00
Abhishek Varma
d17e8dc5ad
[NFC] Rename SD negative_prompts flag
...
-- This commit renames SD `negative-prompts` -> `negative_prompts` flag.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-31 21:38:59 +05:30
Eliasj42
8111f8bf35
added ability to select gpu ( #891 )
...
Co-authored-by: Elias Joseph <elias@nod-labs.com >
2023-01-30 13:39:12 -08:00
Abhishek Varma
fcd62513cf
[SD-CLI] Add support for .safetensors + Use diffusers pipeline to load SD
...
-- This commit uses `load_pipeline_from_original_stable_diffusion_ckpt`
as exposed due to [Diffusers PR](https://github.com/huggingface/diffusers/pull/2019 ).
-- It also adds a support for the end users to use `.safetensors` along
with `.ckpt` file.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-31 00:00:37 +05:30
Abhishek Varma
c3c701e654
Update requirements.txt + README.md of SD
...
-- This commit includes two python modules as part of requirements.txt.
-- It also updates README.md to also inclue `--no-use_tuned` for users to
be able to try `hf_model_id` or `ckpt_loc` without any issue.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-30 14:12:54 +05:30
yzhang93
9644e78545
Fix CUDA tuned model annotation ( #880 )
2023-01-27 11:35:18 -08:00
dymil
c911189ef0
Add note about latest RDNA3 driver support ( #881 )
...
Also tweak other wording
2023-01-27 09:39:19 -08:00
Abhishek Varma
1118b4b651
[SD-CLI] Clean up vmfbs if a retry method fails
...
-- This commit cleans up vmfb files generated as a result of retry method.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-27 21:55:36 +05:30
PhaneeshB
4be75d4418
fix seed values in SD json and filename
2023-01-27 18:40:26 +05:30
yzhang93
fee73b0b63
Add SD model annotation on fly ( #869 )
...
* Add SD model annotation on fly
* Move tuned_compile_through_fx to utils
* Fix SD compilation flags
2023-01-26 11:46:36 -08:00
powderluv
9bbffa519e
Add an option to respect LLPC env var ( #875 )
...
Also add OSX paths
2023-01-25 13:56:55 -08:00
yzhang93
aafe7c4701
Add more cuda devices to use tuned model ( #868 )
2023-01-25 06:36:17 -08:00
Abhishek Varma
9a0b082cf8
[SD-CLI] Add batch_size command-line arg + prompt processing
...
-- This commit adds `batch_size` command-line arg.
-- It also involves replicating the prompt `batch_size` no. of times.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-25 19:21:25 +05:30
powderluv
8265e34a29
Add SHARK SD CLI tool ( #870 )
2023-01-24 23:14:32 -08:00
powderluv
8ef8ae097f
Update to build 469
2023-01-24 22:16:13 -08:00
Abhishek Varma
6ed02f70ec
[SD-CLI] Make using ckpt_loc and hf_model_id easier
...
-- Currently we require users to specify the base model on which the custom
model (.ckpt) is tuned on. Even for running a HuggingFace repo-id, we
require the users to go a tedious way of adding things to variants.json.
-- This commit aims to address the above issues and will be treated as a
starting point for a series of design changes which makes using SHARK's SD
easier.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-24 23:03:46 +05:30
Prashant Kumar
cb78cd8ac0
Add the support for the batch size parameter.
2023-01-24 22:33:13 +05:30
powderluv
6a380a0b48
Add more nvidia cards
2023-01-23 17:07:45 -08:00
powderluv
00e38abbf0
Add 4080 support
2023-01-23 09:56:34 -08:00
Abhishek Varma
e3e4ea5443
Update README.md
...
-- Make usage of `hf_model_id` clearer.
2023-01-23 23:25:23 +05:30
Prashant Kumar
a3e4ea3228
Remove the dependency of the torchvision. ( #858 )
...
Remove the dependency of torchvision library for the conversion
of tensor layout format to what PIL library expects.
2023-01-23 08:49:57 -08:00
powderluv
56f16d6baf
Update SD readme
2023-01-23 06:51:54 -08:00
Abhishek Varma
7a55ab900e
[SD-CLI] Fix CKPT script + add more variants + update README.md
...
-- This commit fixes CKPT script to rely on the previous CKPT to Diffusers
script.
TODO: Let go of the script once the CKPT is included in next release
of diffusers.
-- It also adds many variants as part of `variants.json` and updates
`README.md` to reflect change in default `hf_model_id`.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-01-23 18:34:24 +05:30
Abhishek Varma
137643fe72
[SD-CLI] Update README.md of custom models to include hf_model_id
2023-01-23 11:37:13 +05:30