-- This commit adds LoRA inference to SD pipeline.
-- It also modifies txt2img to incorporate the new feature.
img2img, inpaint, outpaint, etc using Unet can also be extended in a
similar way.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
Co-authored-by: Abhishek Varma <abhishek@nod-labs.com>
* [SD] Add Scribble variant in Stencil
-- This commit adds scribble variant in Stencil.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
* [SD] Use latest diffusers
-- This commit points back to the latest diffusers and updates the
processing script to tackle the Pix2Pix import issue.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
---------
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
Co-authored-by: Abhishek Varma <abhishek@nod-labs.com>
Example:
$ python my_app.py --device_allocator caching debug
This will wrap the device allocator with first caching allocator then
debug allocator.
$ python my_app.py --device_allocator caching
Only wrap with caching allocator.
Co-authored-by: Boian Petkantchin <boian@nod-labs.com>
-- Currently stencil feature works with 512x512 images only.
-- This commit relaxes this constraint and adds support for various
image sizes.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
-- This commit removes the hardcoded HF ID for Stencil and instead
utilizes a dynamic instantiation of HF model.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
* [WIP] Add ControlNet to SD pipeline
-- This commit adds ControlNet to SD pipeline.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
* [SD] Add ControlNet to img2img + fix bug for img2img scheduler
-- This commit adds ControlNet execution to img2img.
-- It restructures the addition of ControlNet variants.
-- It also fixes scheduler selecting bug for img2img pipeline.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
* add shark models for stencilSD
* Add Stencil controlled SD in img2img pipeline (#1106)
* use shark stencil modules
* adjust diffusers change
* modify to use pipeline
* remove control from unet
* pump stencils through unet
* complete integration in img2img
* fix lint and comments
* [SD] Add ControlNet pipeline + integrate with WebUI + add compiled flow execution
-- This commit creates a dedicated SD pipeline for ControlNet.
-- Integrates it with img2img WebUI.
-- Integrates the compiled execution flow for ControlNet.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
* [SD] Stencil execution
* Remove integration setup
* [SD] Fix args.use_stencil overriding bug + vmfb caching issue
-- This commit fixes args.use_stencil overriding issue which caused
img2img pipeline to pick wrong set of modules.
-- It also fixes vmfb caching issue to speed up the loading time
and pick right set of modules based on a mask.
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
---------
Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
Co-authored-by: Abhishek Varma <abhishek@nod-labs.com>
Co-authored-by: PhaneeshB <b.phaneesh@gmail.com>
