Ryan Dick
c0aab56d08
Remove DiffusersControlNetFlux.from_transformer(...).
2024-10-09 14:17:42 +00:00
Ryan Dick
1795f4f8a2
Fixup typing around DiffusersControlNetFluxOutput.
2024-10-09 14:17:42 +00:00
Ryan Dick
5bfd2ec6b7
Remove gradient checkpointing from DiffusersControlNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
a35b229a9d
Remove FluxMultiControlNetModel
2024-10-09 14:17:42 +00:00
Ryan Dick
e93da5d4b2
Remove LoRA stuff from DiffusersCotnrolNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
a17ea9bfad
Remove logic for modifying attn processors from DiffusersControlNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
3578010ba4
Rename FluxControlNetModel -> DiffusersControlNetFlux
2024-10-09 14:17:42 +00:00
Ryan Dick
459cf52043
Start updating imports for FluxControlNetModel
2024-10-09 14:17:42 +00:00
Ryan Dick
9bcb93f575
Copy model from 99f608218c/src/diffusers/models/controlnet_flux.py
2024-10-09 14:17:42 +00:00
Ryan Dick
d1a0e99701
Rename ControlNetFlux -> XLabsControlNetFlux
2024-10-09 14:17:42 +00:00
Ryan Dick
36515e1e2a
Add support for FLUX controlnet weight, begin_step_percent and end_step_percent.
2024-10-09 14:17:42 +00:00
Ryan Dick
c81bb761ed
First pass at integrating FLUX ControlNets into the FLUX Denoise invocation.
2024-10-09 14:17:42 +00:00
Ryan Dick
1d4a58e52b
Add FLUX XLabs ControlNet model probing.
2024-10-09 14:17:42 +00:00
Ryan Dick
62d12e6468
Fix type errors and imporve docs for ControlNetFlux.
2024-10-09 14:17:41 +00:00
Ryan Dick
9541156ce5
Remove gradient checkpointing from ControlNetFlux.
2024-10-09 14:17:41 +00:00
Ryan Dick
eb5b6625ea
Remove ControlNetFlux logic related to attn processor overrides.
2024-10-09 14:17:41 +00:00
Ryan Dick
9758e5a622
Remove duplicate FluxParams class.
2024-10-09 14:17:41 +00:00
Ryan Dick
58eba8bdbd
Fix FLUX module imports for ControlNetFlux.
2024-10-09 14:17:41 +00:00
Ryan Dick
2821ba8967
Copy ControlNetFlux model from 47495425db/src/flux/controlnet.py.
2024-10-09 14:17:41 +00:00
Kent Keirsey
969f8b8e8d
ruff update
2024-10-08 08:56:26 -04:00
David Burnett
ccb5f90556
Get Flux working on MPS when torch 2.5.0 test or nightlies are installed.
2024-10-08 08:56:26 -04:00
Ryan Dick
3d4bd71098
Update test_probe_handles_state_dict_with_integer_keys() to make sure that it is still testing what it's intended to test. Previously, we were skipping an important part of the test by using a fake file path.
2024-10-02 18:33:05 -04:00
Brandon Rising
814be44cd7
Ignore paths that don't exist in probe for unit tests
2024-10-02 18:33:05 -04:00
Brandon Rising
d328eaf743
Remove no longer used dequantize_tensor function
2024-10-02 18:33:05 -04:00
Brandon Rising
0f333388bb
Add comment describing why we're not using the meta device during probing of gguf files
2024-10-02 18:33:05 -04:00
Ryan Dick
bc63e2acc5
Add workaround for FLUX GGUF models with incorrect img_in.weight shape.
2024-10-02 18:33:05 -04:00
Ryan Dick
ec7e771942
Add a compute_dtype field to GGMLTensor.
2024-10-02 18:33:05 -04:00
Ryan Dick
fe84013392
Add unit tests for GGMLTensor.
2024-10-02 18:33:05 -04:00
Ryan Dick
710f81266b
Fix type errors in GGMLTensor.
2024-10-02 18:33:05 -04:00
Brandon Rising
446e2884bc
Remove no longer used code paths, general cleanup of new dequantization code, update probe
2024-10-02 18:33:05 -04:00
Brandon Rising
7d9f125232
Run ruff and update imports
2024-10-02 18:33:05 -04:00
Brandon Rising
66bbd62758
Run ruff and fix typing in torch patcher
2024-10-02 18:33:05 -04:00
Brandon Rising
0875e861f5
Various updates to gguf performance
2024-10-02 18:33:05 -04:00
Brandon
0267d73dfc
Update invokeai/backend/model_manager/load/model_loaders/flux.py
...
Co-authored-by: Ryan Dick <ryanjdick3@gmail.com >
2024-10-02 18:33:05 -04:00
Ryan Dick
f06765dfba
Get alternative GGUF implementation working... barely.
2024-10-02 18:33:05 -04:00
Ryan Dick
f347b26999
Initial experimentation with Tensor-like extension for GGUF.
2024-10-02 18:33:05 -04:00
Lincoln Stein
c665cf3525
recognize .gguf files when scanning a folder for import
2024-10-02 18:33:05 -04:00
Brandon Rising
2bfb0ddff5
Initial GGUF support for flux models
2024-10-02 18:33:05 -04:00
Ryan Dick
807f458f13
Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.
2024-10-01 10:22:11 -04:00
Ryan Dick
68dbe45315
Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.
2024-10-01 10:22:11 -04:00
Mary Hipp
c224971cb4
feat(ui,api): add guidance as a default setting option for FLUX models
2024-09-30 17:15:33 -04:00
Ryan Dick
c256826015
Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.
2024-09-30 07:59:14 -04:00
Ryan Dick
7d38a9b7fb
Add prefix to distinguish FLUX LoRA submodels.
2024-09-30 07:59:14 -04:00
Ryan Dick
d332d81866
Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.
2024-09-30 07:59:14 -04:00
Ryan Dick
bdeec54886
Remove FLUX TrajectoryGuidanceExtension and revert to the InpaintExtension. Keep the improved inpaint gradient mask adjustment behaviour.
2024-09-26 19:54:28 -04:00
Ryan Dick
8d50ecdfc3
Update docs explaining inpainting trajectory guidance.
2024-09-26 19:54:28 -04:00
Ryan Dick
ba07e255f5
Add support for fractional denoise start and end with FLUX.
2024-09-26 19:54:28 -04:00
Ryan Dick
fae96f3b9f
Remove trajectory_guidance_strength parameter.
2024-09-26 19:54:28 -04:00
psychedelicious
dc10197615
fix(app): step callbacks for SD, FLUX, MultiDiffusion
...
Each of these was a bit off:
- The SD callback started at `-1` and ended at `i`. Combined w/ the weird math on the previous `calc_percentage` util, this caused the progress bar to never finish.
- The MultiDiffusion callback had the same problems as SD.
- The FLUX callback didn't emit a pre-denoising step 0 image. It also reported total_steps as 1 higher than the actual step count.
Each of these now emit the expected events to the frontend:
- The initial latents at 0%
- Progress at each step, ending at 100%
2024-09-22 21:20:32 +03:00
Ryan Dick
a43a045b04
Fix preview image to work well with FLUX trajectory guidance.
2024-09-20 21:08:41 +00:00
