maryhipp
43cc4684e1
(api) make sure all controlnet starter models will still have pre-processors correctly assigned when probed based on name
2024-10-24 23:34:06 +11:00
maryhipp
9cd47fa857
(api): update names of starter models, add ability to track previous_names so it does not mess up logic that prevents dupe starter model installs
2024-10-24 23:34:06 +11:00
David Burnett
24f9b46fbc
ruff fix
2024-10-23 10:09:24 +11:00
David Burnett
54b3aa1d01
load t5 model in the same format as it is saved, seems to load as float32 on Macs
2024-10-23 10:09:24 +11:00
Ryan Dick
5cbe89afdd
Merge branch 'main' into ryan/flux-ip-adapter-cfg-2
2024-10-22 21:17:36 +00:00
Ryan Dick
e545f18a45
(minor) Fix ruff.
2024-10-21 22:38:06 +00:00
Ryan Dick
e8cd1bb3d8
Add FLUX IP-Adapter starter models.
2024-10-21 22:17:42 +00:00
Ryan Dick
90a906e203
Simplify handling of CLIP ViT selection for FLUX IP-Adapter invocation.
2024-10-21 19:54:59 +00:00
Ryan Dick
f70a8e2c1a
A bunch of HACKS to get ViT-L CLIP vision encoder working for FLUX IP-Adapter. Need to revisit how to clean this all up long term.
2024-10-21 15:43:00 +00:00
Ryan Dick
c2a8fbd8d6
(minor) Move infer_xlabs_ip_adapter_params_from_state_dict(...) to state_dict_utils.py.
2024-10-21 15:38:50 +00:00
Ryan Dick
d6643d7263
Add model loading code for xlabs FLUX IP-Adapter (not tested).
2024-10-21 15:38:50 +00:00
Ryan Dick
412e79d8e6
Add model probing for XLabs FLUX IP-Adapter.
2024-10-21 15:38:50 +00:00
Mary Hipp
bbd89d54b4
add it to list
2024-10-19 14:08:49 +11:00
Mary Hipp
ee61006a49
add starter model
2024-10-19 14:08:49 +11:00
Mary Hipp
5bd87ca89b
feat(ui,api): add starter bundles to MM
2024-10-15 15:58:11 -04:00
Ryan Dick
bb6d073828
Use the Shakker-Labs ControlNet union model as the only FLUX ControlNet starter model.
2024-10-10 13:59:59 +00:00
maryhipp
3977ffaa3e
update prepreprocessor logic to be more resilient
2024-10-09 14:57:14 -04:00
maryhipp
9a8a858fe4
update starter models to include FLUX controlnets
2024-10-09 14:57:14 -04:00
Ryan Dick
8d1a45863c
Support installing InstantX ControlNet models from diffusers directory format.
2024-10-09 17:04:10 +00:00
Ryan Dick
5d11c30ce6
Update ControlNetCheckpointProbe.get_base_type() to work with InstantX.
2024-10-09 14:17:42 +00:00
Ryan Dick
bfc460a5c6
Rename DiffusersControlNetFlux -> InstantXControlNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
56731766ca
Update FluxControlnetModel to work with both XLabs and InstantX.
2024-10-09 14:17:42 +00:00
Ryan Dick
d1a0e99701
Rename ControlNetFlux -> XLabsControlNetFlux
2024-10-09 14:17:42 +00:00
Ryan Dick
c81bb761ed
First pass at integrating FLUX ControlNets into the FLUX Denoise invocation.
2024-10-09 14:17:42 +00:00
Ryan Dick
1d4a58e52b
Add FLUX XLabs ControlNet model probing.
2024-10-09 14:17:42 +00:00
Ryan Dick
3d4bd71098
Update test_probe_handles_state_dict_with_integer_keys() to make sure that it is still testing what it's intended to test. Previously, we were skipping an important part of the test by using a fake file path.
2024-10-02 18:33:05 -04:00
Brandon Rising
814be44cd7
Ignore paths that don't exist in probe for unit tests
2024-10-02 18:33:05 -04:00
Brandon Rising
0f333388bb
Add comment describing why we're not using the meta device during probing of gguf files
2024-10-02 18:33:05 -04:00
Ryan Dick
bc63e2acc5
Add workaround for FLUX GGUF models with incorrect img_in.weight shape.
2024-10-02 18:33:05 -04:00
Ryan Dick
ec7e771942
Add a compute_dtype field to GGMLTensor.
2024-10-02 18:33:05 -04:00
Brandon Rising
446e2884bc
Remove no longer used code paths, general cleanup of new dequantization code, update probe
2024-10-02 18:33:05 -04:00
Brandon Rising
7d9f125232
Run ruff and update imports
2024-10-02 18:33:05 -04:00
Brandon Rising
0875e861f5
Various updates to gguf performance
2024-10-02 18:33:05 -04:00
Brandon
0267d73dfc
Update invokeai/backend/model_manager/load/model_loaders/flux.py
...
Co-authored-by: Ryan Dick <ryanjdick3@gmail.com >
2024-10-02 18:33:05 -04:00
Ryan Dick
f06765dfba
Get alternative GGUF implementation working... barely.
2024-10-02 18:33:05 -04:00
Lincoln Stein
c665cf3525
recognize .gguf files when scanning a folder for import
2024-10-02 18:33:05 -04:00
Brandon Rising
2bfb0ddff5
Initial GGUF support for flux models
2024-10-02 18:33:05 -04:00
Mary Hipp
c224971cb4
feat(ui,api): add guidance as a default setting option for FLUX models
2024-09-30 17:15:33 -04:00
Ryan Dick
e88d3cf2f7
Assume alpha=rank for FLUX diffusers PEFT LoRA models.
2024-09-16 13:57:07 +00:00
Ryan Dick
81fbaf2b8b
Assume LoRA alpha=8 for FLUX diffusers PEFT LoRAs.
2024-09-15 04:39:56 +03:00
Ryan Dick
2ff4dae5ce
Add util functions calc_tensor_size(...) and calc_tensors_size(...).
2024-09-15 04:39:56 +03:00
Ryan Dick
5800e60b06
Add model probe support for FLUX LoRA models in Diffusers format.
2024-09-15 04:39:56 +03:00
Ryan Dick
cf9f30cc56
Rename flux_kohya_lora_conversion_utils.py
2024-09-15 04:39:56 +03:00
Ryan Dick
50c9410121
WIP
2024-09-15 04:39:56 +03:00
Ryan Dick
01a15b4d80
WIP - add invocations to support FLUX LORAs.
2024-09-15 04:39:56 +03:00
Ryan Dick
db61ec4322
Get probing of FLUX LoRA kohya models working.
2024-09-15 04:39:56 +03:00
Ryan Dick
04b37e64ea
Move the responsibilities of 1) state_dict loading from file, and 2) SDXL lora key conversions, out of LoRAModelRaw and into LoRALoader.
2024-09-15 04:39:56 +03:00
Ryan Dick
2b3e4e123d
Split LoRA layer implementations into separate files.
2024-09-12 15:53:30 +00:00
psychedelicious
53792fafb3
feat(nodes): add DWOpenposeDetectionInvocation
...
Similar to the existing node, but without any resizing. The backend logic was consolidated and modified so that it the model loading can be managed by the model manager.
The ONNX Runtime `InferenceSession` class was added to the `AnyModel` union to satisfy the type checker.
2024-09-11 08:12:48 -04:00
Brandon Rising
a16b555d47
Simplify flux model dtype conversion in model loader
2024-09-05 15:47:14 -04:00
