Ryan Dick
|
c8d1d14662
|
Work on integrating InstantX into denoise process.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
44c588d778
|
Rename DiffusersControlNetFlux -> InstantXControlNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
d75ac56d00
|
Create flux/extensions directory.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
714dd5f0be
|
Update FluxControlnetModel to work with both XLabs and InstantX.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
2f4d3cb5e6
|
Add unit test to test the full flow of loading an InstantX ControlNet from a state dict.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
1cdd501a0a
|
Add unit test for infer_flux_params_from_state_dict(...).
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
03cf953398
|
First pass of utility function to infer the FluxParams from a state dict.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
24c115663d
|
Add unit test for convert_diffusers_instantx_state_dict_to_bfl_format(...) and fix a few bugs.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
a9e7ecad49
|
Finish first draft of convert_diffusers_instantx_state_dict_to_bfl_format(...).
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
76f4766324
|
WIP - implement convert_diffusers_instantx_state_dict_to_bfl_format(...).
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
3dfc242f77
|
(minor) rename other_forward() -> forward()
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
1e43389cb4
|
Add utils for detecting XLabs ControlNet vs. InstantX ControlNet from
state dict.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
cb33de34f7
|
Migrate DiffusersControlNetFlux from diffusers-style to BFL-style.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
7562ea48dc
|
Improve typing of zero_module().
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
83f4700f5a
|
Use top-level torch import for all torch stuff.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
704e7479b2
|
Remove DiffusersControlNetFlux.from_transformer(...).
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
5f44559f30
|
Fixup typing around DiffusersControlNetFluxOutput.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
7a22819100
|
Remove gradient checkpointing from DiffusersControlNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
70495665c5
|
Remove FluxMultiControlNetModel
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
ca30acc5b4
|
Remove LoRA stuff from DiffusersCotnrolNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
8121843d86
|
Remove logic for modifying attn processors from DiffusersControlNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
bc0ded0a23
|
Rename FluxControlNetModel -> DiffusersControlNetFlux
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
30f6034f88
|
Start updating imports for FluxControlNetModel
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
7d56a8ce54
|
Copy model from 99f608218c/src/diffusers/models/controlnet_flux.py
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
e7dc439006
|
Rename ControlNetFlux -> XLabsControlNetFlux
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
93e98a1f63
|
Add support for FLUX controlnet weight, begin_step_percent and end_step_percent.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
0f93deab3b
|
First pass at integrating FLUX ControlNets into the FLUX Denoise invocation.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
3f3aba8b10
|
Add FLUX XLabs ControlNet model probing.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
0b84f567f1
|
Fix type errors and imporve docs for ControlNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
69c0d7dcc9
|
Remove gradient checkpointing from ControlNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
5307248fcf
|
Remove ControlNetFlux logic related to attn processor overrides.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
2efaea8f79
|
Remove duplicate FluxParams class.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
c1dfd9b7d9
|
Fix FLUX module imports for ControlNetFlux.
|
2024-10-10 07:59:29 -04:00 |
|
Ryan Dick
|
c594ef89d2
|
Copy ControlNetFlux model from 47495425db/src/flux/controlnet.py.
|
2024-10-10 07:59:29 -04:00 |
|
Eugene Brodsky
|
b6c7949bb7
|
feat(backend): prefer xformers based on cuda compute capability
|
2024-10-09 22:46:18 -04:00 |
|
Kent Keirsey
|
969f8b8e8d
|
ruff update
|
2024-10-08 08:56:26 -04:00 |
|
David Burnett
|
ccb5f90556
|
Get Flux working on MPS when torch 2.5.0 test or nightlies are installed.
|
2024-10-08 08:56:26 -04:00 |
|
Ryan Dick
|
3d4bd71098
|
Update test_probe_handles_state_dict_with_integer_keys() to make sure that it is still testing what it's intended to test. Previously, we were skipping an important part of the test by using a fake file path.
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
814be44cd7
|
Ignore paths that don't exist in probe for unit tests
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
d328eaf743
|
Remove no longer used dequantize_tensor function
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
0f333388bb
|
Add comment describing why we're not using the meta device during probing of gguf files
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
bc63e2acc5
|
Add workaround for FLUX GGUF models with incorrect img_in.weight shape.
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
ec7e771942
|
Add a compute_dtype field to GGMLTensor.
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
fe84013392
|
Add unit tests for GGMLTensor.
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
710f81266b
|
Fix type errors in GGMLTensor.
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
446e2884bc
|
Remove no longer used code paths, general cleanup of new dequantization code, update probe
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
7d9f125232
|
Run ruff and update imports
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
66bbd62758
|
Run ruff and fix typing in torch patcher
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
0875e861f5
|
Various updates to gguf performance
|
2024-10-02 18:33:05 -04:00 |
|
Brandon
|
0267d73dfc
|
Update invokeai/backend/model_manager/load/model_loaders/flux.py
Co-authored-by: Ryan Dick <ryanjdick3@gmail.com>
|
2024-10-02 18:33:05 -04:00 |
|