Ryan Dick
|
807f458f13
|
Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.
|
2024-10-01 10:22:11 -04:00 |
|
Ryan Dick
|
68dbe45315
|
Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.
|
2024-10-01 10:22:11 -04:00 |
|
Ryan Dick
|
c256826015
|
Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
7d38a9b7fb
|
Add prefix to distinguish FLUX LoRA submodels.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
d332d81866
|
Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
2934e31620
|
Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.
|
2024-09-16 14:48:39 +00:00 |
|
Ryan Dick
|
e88d3cf2f7
|
Assume alpha=rank for FLUX diffusers PEFT LoRA models.
|
2024-09-16 13:57:07 +00:00 |
|
Ryan Dick
|
d51f2c5e00
|
Add bias to LoRA sidecar layer unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
78efed4499
|
Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
02f27c750a
|
Add unit tests for LoRAPatcher.apply_lora_sidecar_patches(...) and fixup dtype handling in the sidecar layers.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ba3ba3c23a
|
Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
61d3d566de
|
Minor cleanup and documentation updates.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ae41651346
|
Remove LoRA conv sidecar layers until they are needed and properly tested.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
5bb0c79c14
|
Add links to test models for loha, lokr, ia3.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
9438ea608c
|
Update all lycoris layer types to use the new torch.nn.Module base class.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
81fbaf2b8b
|
Assume LoRA alpha=8 for FLUX diffusers PEFT LoRAs.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
10c3c61cb2
|
Get diffusers FLUX LoRA working as sidecar patch on quantized model.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
45bc8fcd7f
|
WIP - Implement sidecar LoRA layers using functional API.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
f5f894437c
|
Bug fixes to get LoRA sidecar patching working for the first time.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
3e12ac9740
|
WIP - LoRA sidecar layers.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
049ce1826c
|
WIP - adding LoRA sidecar layers
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
2ff4dae5ce
|
Add util functions calc_tensor_size(...) and calc_tensors_size(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
705173b575
|
Remove unused layer_key property from LoRALayerBase.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
fef26a5f2f
|
Consolidate all LoRA patching logic in the LoRAPatcher.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ee5d8f6caf
|
lora_layer_from_state_dict(...) -> any_lora_layer_from_state_dict(...)
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ddda60c1a2
|
Rename peft/ -> lora/
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
aac97e105a
|
Genera cleanup/documentation.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
552a5b06a4
|
Add a check that all keys are handled in the FLUX Diffusers LoRA loading code.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
31a8757e6b
|
Add is_state_dict_likely_in_flux_diffusers_format(...) function with unit test.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
534e938a62
|
Add unit test for lora_model_from_flux_diffusers_state_dict(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
040cc28f93
|
First draft of lora_model_from_flux_diffusers_state_dict(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
bb528d916e
|
Add ConcatenateLoRALayer class.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
dc09171cdb
|
WIP on supporting diffusers format FLUX LoRAs.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
cf9f30cc56
|
Rename flux_kohya_lora_conversion_utils.py
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
50c9410121
|
WIP
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
01a15b4d80
|
WIP - add invocations to support FLUX LORAs.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
00e56863c2
|
Add utility function for detecting whether a state_dict is in the FLUX kohya LoRA format.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
7b5befad0d
|
Update convert_flux_kohya_state_dict_to_invoke_format() to raise an exception if an unexpected key is encountered, and add a corresponding unit test.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
04b37e64ea
|
Move the responsibilities of 1) state_dict loading from file, and 2) SDXL lora key conversions, out of LoRAModelRaw and into LoRALoader.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
8518ae9ccb
|
Remove unused LoRAModelRaw.name attribute.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
d0d91eaeec
|
Fix type errors in sdxl_lora_conversion_utils.py
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
fc380f077f
|
Start moving SDXL-specific LoRA conversions out of the general-purpose LoRAModelRaw class.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ade75b4748
|
Get convert_flux_kohya_state_dict_to_invoke_format(...) working, with unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
c41bd59812
|
WIP - Initial logic for kohya FLUX LoRA conversion.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
2b3e4e123d
|
Split LoRA layer implementations into separate files.
|
2024-09-12 15:53:30 +00:00 |
|