Kent Keirsey
|
af58a75e97
|
Support PEFT Loras with Base_Model.model prefix (#8433)
* Support PEFT Loras with Base_Model.model prefix
* update tests
* ruff
* fix python complaints
* update kes
* format keys
* remove unneeded test
|
2025-08-18 09:14:46 -04:00 |
|
Kevin Turner
|
50cf285efb
|
fix: group aitoolkit lora layers
|
2025-06-16 19:08:11 +10:00 |
|
Kevin Turner
|
a214f4fff5
|
fix: group aitoolkit lora layers
|
2025-06-16 19:08:11 +10:00 |
|
Kevin Turner
|
2981591c36
|
test: add some aitoolkit lora tests
|
2025-06-16 19:08:11 +10:00 |
|
Ryan Dick
|
206f261e45
|
Add utils for loading FLUX OneTrainer DoRA models.
|
2025-01-28 14:51:35 +00:00 |
|
Ryan Dick
|
dfa253e75b
|
Add utils for working with Kohya LoRA keys.
|
2025-01-28 14:51:35 +00:00 |
|
Ryan Dick
|
faa4fa02c0
|
Expand unit tests to test for confusion between FLUX LoRA formats.
|
2025-01-28 14:51:35 +00:00 |
|
Ryan Dick
|
5bd6428fdd
|
Add is_state_dict_likely_in_flux_onetrainer_format() util function.
|
2025-01-28 14:51:35 +00:00 |
|
Ryan Dick
|
8b4f411f7b
|
Add a test state dict for the OneTrainer DoRA format.
|
2025-01-28 14:51:35 +00:00 |
|
Ryan Dick
|
6fd9b0a274
|
Delete old sidecar wrapper implementation. This functionality has moved into the custom layers.
|
2024-12-29 17:33:08 +00:00 |
|
Ryan Dick
|
6d49ee839c
|
Switch the LayerPatcher to use 'custom modules' to manage layer patching.
|
2024-12-29 01:18:30 +00:00 |
|
Ryan Dick
|
2855bb6b41
|
Update BaseLayerPatch.get_parameters(...) to accept a dict of orig_parameters rather than orig_module. This will enable compatibility between patching and cpu->gpu streaming.
|
2024-12-28 21:12:53 +00:00 |
|
Ryan Dick
|
6d7314ac0a
|
Consolidate the LayerPatching patching modes into a single implementation.
|
2024-12-24 15:57:54 +00:00 |
|
Ryan Dick
|
80db9537ff
|
Rename model_patcher.py -> layer_patcher.py.
|
2024-12-24 15:57:54 +00:00 |
|
Ryan Dick
|
0148512038
|
(minor) Rename num_layers -> num_loras in unit tests.
|
2024-12-24 15:57:54 +00:00 |
|
Ryan Dick
|
d0f35fceed
|
Add test_apply_smart_lora_patches_to_partially_loaded_model(...).
|
2024-12-24 15:57:54 +00:00 |
|
Ryan Dick
|
cefcb340d9
|
Add LoRAPatcher.smart_apply_lora_patches()
|
2024-12-24 15:57:54 +00:00 |
|
Ryan Dick
|
dd09509dbd
|
Rename ModelPatcher -> LayerPatcher to avoid conflicts with another ModelPatcher definition.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
7fad4c9491
|
Rename LoRAModelRaw to ModelPatchRaw.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
b820862eab
|
Rename ModelPatcher methods to reflect that they are general model patching methods and are not LoRA-specific.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
c604a0956e
|
Rename LoRAPatcher -> ModelPatcher.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
37e3089457
|
Push LoRA layer reshaping down into the patch layers and add a new FluxControlLoRALayer type.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
fe09f2d27a
|
Move handling of LoRA scale and patch weight down into the layer patch classes.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
606d58d7db
|
Add sidecar wrapper for FLUX RMSNorm layers to support SetParameterLayers used by FLUX structural control LoRAs.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
c76a448846
|
Delete old sidecar_layers/ dir.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
1e0552c813
|
Add optimized implementations for the LinearSidecarWrapper when using LoRALayer or ConcatenatedLoRALayer patch types (since these are the most common).
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
e2451ef5ca
|
A unit tests for LinearSidecarWrapper (and fix a bug).
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
3a8a5442ea
|
Add basic unit tests for SetParameterLayer.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
693d42661c
|
Add basic unit tests for LoRALayer.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
41664f88db
|
Rename backend/patches/conversions/ to backend/patches/lora_conversions/
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
42f8d6aa11
|
Rename backend/lora/ to backend/patches
|
2024-12-17 13:20:19 +00:00 |
|