Ean Garvey
7a7252a8fd
Unpin timm.
2023-10-19 12:41:22 -05:00
Ean Garvey
791553762b
Specify ref for forked torch.hub repos.
2023-10-19 11:02:13 -05:00
Ean Garvey
0b3c4c029d
Add einops to Studio imports.
2023-10-19 10:30:14 -05:00
Ean Garvey
a498ce17bc
Merge branch 'main' into zoedepth
2023-10-19 06:59:43 -07:00
Stefan Kapusniak
71d25ec5d8
SD: Fix repeatable seeds when intial seed is random ( #1893 )
2023-10-14 22:50:42 -07:00
Stefan Kapusniak
a208302bb9
Fix repeatable seeds consistency over batch counts ( #1889 )
...
* Set the input seed for the random number generator when
generating repeatable seeds to exclude any negative numbers
in the parsed seed input. The makes seeds generated for
different batch counts consistent where they have the same
input for the initial seed or set of seeds.
2023-10-12 17:15:19 -05:00
Phaneesh Barwaria
a731eb6ed4
Macos fixes ( #1883 )
...
* fix venv setup for MacOS
* allow stream fuse binding on mac
* clean iree metal args
2023-10-09 23:36:12 -07:00
Ean Garvey
2004d16945
Revert "[SDXL] Add SDXL pipeline to SHARK ( #1731 )" ( #1882 )
...
This reverts commit 9f0a421764 .
2023-10-09 18:01:44 -07:00
Gaurav Shukla
77727d149c
[warning] Fix dropdown warning
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-10-10 05:18:43 +05:30
Abhishek Varma
9f0a421764
[SDXL] Add SDXL pipeline to SHARK ( #1731 )
...
-- This commit adds SDXL pipeline to SHARK.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-10-09 13:01:37 -05:00
Gaurav Shukla
c28682110c
[chatbot] Flag to add system prompt
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-10-09 22:17:39 +05:30
George Petterson
3c66f87a84
Add ZoeDepth
2023-10-08 00:10:13 -04:00
Ean Garvey
caf6cc5d8f
Switch most compile flows to use ireec.compile_file. ( #1863 )
...
* Switch most compile flows to use ireec.compile_file.
* re-add input type to compile_str path.
* Check if mlir_module exists before checking if it's a path or pyobject.
* Fix some save_dir cases
2023-10-06 23:04:43 -05:00
Gaurav Shukla
e54517e967
[UI] Disable config generator, lora train and model manager ( #1858 )
...
Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-10-02 22:34:40 -07:00
Ean Garvey
326327a799
Collect pipeline submodules for diffusers ckpt preprocessing. ( #1859 )
2023-10-03 00:29:28 -04:00
Ean Garvey
785b65c7b0
Add flag for specifying device-local caching allocator heap key. ( #1856 )
2023-10-03 00:28:39 -04:00
Gaurav Shukla
e930ba85b4
[os] Remove os dependency from vmfb naming ( #1854 )
...
Also fixes a small ui issue for chatbot.
Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-09-29 12:38:17 -05:00
Gaurav Shukla
cd732e7a38
[chatbot] split execution time to prefill and decode
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-09-29 13:18:03 +05:30
Gaurav Shukla
8e0f8b3227
[ui] Update chatbot UI
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-09-29 13:18:03 +05:30
Gaurav Shukla
b8210ef796
[chatbot] Re-instantiate the chatbot object if device id changes
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-09-29 13:18:03 +05:30
PhaneeshB
94594542a9
remove use of vulkaninfo
2023-09-28 21:57:00 +05:30
Gaurav Shukla
82f833e87d
[vulkan] Update vmfb naming
...
Update vmfb naming for vulkan devices in order to resolve naming
conflicts in the presence of multiple vulkan devices.
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-09-28 14:52:11 +05:30
Nelson Sharpe
6773278ec2
Fix checkpoint_path unexpected argument ( #1832 )
2023-09-24 14:17:52 -07:00
Abhishek Varma
9a0efffcca
[Llama2] Fix wrong Vulkan device ID + Add Vulkan compile flags
...
-- This commit fixes the wrong Vulkan device being selected during
runtime.
-- It also adds couple of IREE compilation flags to target specific
Vulkan device.
-- It also changes the Vulkan device listing to be more in tune with
lowering control flow.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-09-22 22:24:18 +05:30
zjgarvey
9eceba69b7
local_tank_cache included into clear_all ( #1833 )
2023-09-18 00:27:23 -05:00
Ean Garvey
684943a4a6
(SD) Fix tokenizers imports in pyinstaller builds. ( #1828 )
...
* Fix tokenizers metadata.
* (SD) Disable VAE lowering configs (rdna3) and add versioned tunings.
* Update sd_annotation.py
* (SD) Add cv2 to spec.
* Update stencil pipeline with the new img2img arg.
2023-09-12 12:23:48 -05:00
PhaneeshB
b817bb8455
add roles for llama2
2023-09-12 10:59:28 +05:30
Ean Garvey
780f520f02
Fix vk.target_env extensions and remove redundant SD imports. ( #1826 )
...
* Remove redundant IREE runtime imports.
* Fix vulkan target env extensions.
2023-09-11 13:42:52 -05:00
Abhishek Varma
bde63ee8ae
Add logging feature in WebUI ( #1821 )
2023-09-08 05:48:05 -07:00
Gaurav Shukla
ede6bf83e2
[vicuna] Disabling the IR generation path
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-09-06 20:13:17 +05:30
Gaurav Shukla
d2f64eefa3
[chatbot] Remove few outdated models from list ( #1814 )
2023-09-04 09:26:32 -07:00
jinchen62
4c3d8a0a7f
Enable downloading vmfb/mlir for webui ( #1807 )
2023-08-31 11:05:47 -07:00
Ean Garvey
9c8cbaf498
Add support for ROCM (Windows) in Studio + compile utils ( #1770 )
...
* WIP: MSVC ROCM support for SHARK Studio
* Make get_iree_rocm_args platform-agnostic.
* Update stable_args.py
* Update rocm arg handling in SD utils
* Guard quantization imports.
Co-authored-by: jam https://github.com/jammm
2023-08-25 20:56:05 -07:00
Ean Garvey
9697981004
Pipe through a debug option to iree compile utils. ( #1796 )
...
* Update compile_utils.py
* Pipe through a flag to toggle debug options in compile utils.
* Update SharkLLMBase.py
2023-08-25 07:11:11 -07:00
Ean Garvey
8e3860c9e6
Remove flags that are default in upstream IREE ( #1785 )
...
* Remove index bits flags now set by default
* Update shark_studio_imports.py
2023-08-24 11:57:54 -05:00
xzuyn
e37d6720eb
Add Hires Fix ( #1787 )
...
* improper test hiresfix
* add sliders & use `clear_cache`
* add resample choices & fix step adjustment
* add step adjustment to img2img
* add resample options to img2img
* simplify hiresfix
- import `img2img_inf` from `img2img_ui.py` instead of just copying it into `txt2img_ui.py`
* set `hri` to None after using
* add more resample types, and don't show output until hiresfix is done
* cleaner implementation
* ran black
* ran black again with jupyter dependencies
2023-08-24 09:01:41 -07:00
Abhishek Varma
db990826d3
Add Llama2 13B int4 fp16 support ( #1784 )
...
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com >
2023-08-23 10:00:32 -07:00
gpetters94
7ee3e4ba5d
Add stencil_unet_512 support ( #1778 )
...
This should fix any remaining issues with stencils and long prompts.
2023-08-22 12:23:46 -04:00
gpetters94
82b462de3a
Fix stencils for long prompts ( #1777 )
2023-08-19 00:26:51 -07:00
gpetters94
79bd0b84a1
Fix an issue with diffusers>0.19.3 ( #1775 )
2023-08-18 14:06:06 -04:00
Gaurav Shukla
9ae8bc921e
[chatbot] Fix chatbot cli and webview warning
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-08-17 21:27:10 +05:30
Gaurav Shukla
32eb78f0f9
[chatbot] Fix switching parameters in chatbot
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-08-17 19:14:17 +05:30
Ean Garvey
9dee7ae652
fix tkinter window ( #1766 )
2023-08-15 13:23:09 -07:00
Ean Garvey
343dfd901c
Update SHARK-Runtime links to SRT ( #1765 )
...
* Update nightly.yml
* Update setup_venv.ps1
* Update CMakeLists.txt
* Update shark_iree_profiling.md
* Update setup_venv.sh
* Update README.md
* Update .gitmodules
* Update CMakeLists.txt
* Update README.md
* fix signtool flags
* Update nightly.yml
* Update benchmark_utils.py
* uncomment tkinter launch
2023-08-15 12:40:44 -07:00
Ean Garvey
57260b9c37
(Studio) Add hf-hub to pyinstaller metadata ( #1761 )
2023-08-14 23:01:50 -05:00
Ean Garvey
18e7d2d061
Enable vae tunings for rdna3. ( #1764 )
2023-08-14 21:00:14 -07:00
PhaneeshB
4f61d69d86
add support passing iree flags for LLMs
2023-08-15 00:22:56 +05:30
Gaurav Shukla
4dc9c59611
[chatbot] Add tokens generated per second ( #1753 )
2023-08-13 11:25:41 -07:00
Gaurav Shukla
18801dcabc
[chat] Update chatbot ui
...
Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-08-13 18:39:22 +05:30
Gaurav Shukla
3c577f7168
[vicuna] fix shard config generator script ( #1747 )
...
Signed-off-by: Gaurav Shukla <gaurav@nod-labs.com >
2023-08-10 11:26:03 -07:00