14 Commits

Author	SHA1	Message	Date
Ryan Dick	d51f2c5e00	Add bias to LoRA sidecar layer unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	78efed4499	Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.	2024-09-15 04:39:56 +03:00
Ryan Dick	ba3ba3c23a	Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.	2024-09-15 04:39:56 +03:00
Ryan Dick	61d3d566de	Minor cleanup and documentation updates.	2024-09-15 04:39:56 +03:00
Ryan Dick	5bb0c79c14	Add links to test models for loha, lokr, ia3.	2024-09-15 04:39:56 +03:00
Ryan Dick	9438ea608c	Update all lycoris layer types to use the new torch.nn.Module base class.	2024-09-15 04:39:56 +03:00
Ryan Dick	10c3c61cb2	Get diffusers FLUX LoRA working as sidecar patch on quantized model.	2024-09-15 04:39:56 +03:00
Ryan Dick	2ff4dae5ce	Add util functions calc_tensor_size(...) and calc_tensors_size(...).	2024-09-15 04:39:56 +03:00
Ryan Dick	705173b575	Remove unused layer_key property from LoRALayerBase.	2024-09-15 04:39:56 +03:00
Ryan Dick	ee5d8f6caf	lora_layer_from_state_dict(...) -> any_lora_layer_from_state_dict(...)	2024-09-15 04:39:56 +03:00
Ryan Dick	ddda60c1a2	Rename peft/ -> lora/	2024-09-15 04:39:56 +03:00
Ryan Dick	bb528d916e	Add ConcatenateLoRALayer class.	2024-09-15 04:39:56 +03:00
Ryan Dick	50c9410121	WIP	2024-09-15 04:39:56 +03:00
Ryan Dick	2b3e4e123d	Split LoRA layer implementations into separate files.	2024-09-12 15:53:30 +00:00