Ryan Dick
|
807f458f13
|
Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.
|
2024-10-01 10:22:11 -04:00 |
|
Ryan Dick
|
68dbe45315
|
Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.
|
2024-10-01 10:22:11 -04:00 |
|
Ryan Dick
|
c256826015
|
Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
7d38a9b7fb
|
Add prefix to distinguish FLUX LoRA submodels.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
d332d81866
|
Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
e88d3cf2f7
|
Assume alpha=rank for FLUX diffusers PEFT LoRA models.
|
2024-09-16 13:57:07 +00:00 |
|
Ryan Dick
|
61d3d566de
|
Minor cleanup and documentation updates.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
81fbaf2b8b
|
Assume LoRA alpha=8 for FLUX diffusers PEFT LoRAs.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
10c3c61cb2
|
Get diffusers FLUX LoRA working as sidecar patch on quantized model.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
705173b575
|
Remove unused layer_key property from LoRALayerBase.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ee5d8f6caf
|
lora_layer_from_state_dict(...) -> any_lora_layer_from_state_dict(...)
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
aac97e105a
|
Genera cleanup/documentation.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
552a5b06a4
|
Add a check that all keys are handled in the FLUX Diffusers LoRA loading code.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
31a8757e6b
|
Add is_state_dict_likely_in_flux_diffusers_format(...) function with unit test.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
534e938a62
|
Add unit test for lora_model_from_flux_diffusers_state_dict(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
040cc28f93
|
First draft of lora_model_from_flux_diffusers_state_dict(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
dc09171cdb
|
WIP on supporting diffusers format FLUX LoRAs.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
cf9f30cc56
|
Rename flux_kohya_lora_conversion_utils.py
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
50c9410121
|
WIP
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
00e56863c2
|
Add utility function for detecting whether a state_dict is in the FLUX kohya LoRA format.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
7b5befad0d
|
Update convert_flux_kohya_state_dict_to_invoke_format() to raise an exception if an unexpected key is encountered, and add a corresponding unit test.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
d0d91eaeec
|
Fix type errors in sdxl_lora_conversion_utils.py
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
fc380f077f
|
Start moving SDXL-specific LoRA conversions out of the general-purpose LoRAModelRaw class.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ade75b4748
|
Get convert_flux_kohya_state_dict_to_invoke_format(...) working, with unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
c41bd59812
|
WIP - Initial logic for kohya FLUX LoRA conversion.
|
2024-09-15 04:39:56 +03:00 |
|