Brandon Rising
|
046d19446c
|
Rename Structural Lora to Control Lora
|
2024-12-17 07:28:45 -05:00 |
|
Brandon Rising
|
f53da60b84
|
Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model
|
2024-12-17 07:28:45 -05:00 |
|
Brandon Rising
|
5a035dd19f
|
Support bnb quantized nf4 flux models, Use controlnet vae, only support 1 structural lora per transformer. various other refractors and bugfixes
|
2024-12-17 07:28:45 -05:00 |
|
Brandon Rising
|
f3b253987f
|
Initial setup for flux tools control loras
|
2024-12-17 07:28:45 -05:00 |
|
Ryan Dick
|
d51f2c5e00
|
Add bias to LoRA sidecar layer unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
78efed4499
|
Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ba3ba3c23a
|
Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
61d3d566de
|
Minor cleanup and documentation updates.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
5bb0c79c14
|
Add links to test models for loha, lokr, ia3.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
9438ea608c
|
Update all lycoris layer types to use the new torch.nn.Module base class.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
10c3c61cb2
|
Get diffusers FLUX LoRA working as sidecar patch on quantized model.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
2ff4dae5ce
|
Add util functions calc_tensor_size(...) and calc_tensors_size(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
705173b575
|
Remove unused layer_key property from LoRALayerBase.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ee5d8f6caf
|
lora_layer_from_state_dict(...) -> any_lora_layer_from_state_dict(...)
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ddda60c1a2
|
Rename peft/ -> lora/
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
bb528d916e
|
Add ConcatenateLoRALayer class.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
50c9410121
|
WIP
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
2b3e4e123d
|
Split LoRA layer implementations into separate files.
|
2024-09-12 15:53:30 +00:00 |
|