7 Commits

Author	SHA1	Message	Date
Ryan Dick	d51f2c5e00	Add bias to LoRA sidecar layer unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	78efed4499	Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.	2024-09-15 04:39:56 +03:00
Ryan Dick	5bb0c79c14	Add links to test models for loha, lokr, ia3.	2024-09-15 04:39:56 +03:00
Ryan Dick	10c3c61cb2	Get diffusers FLUX LoRA working as sidecar patch on quantized model.	2024-09-15 04:39:56 +03:00
Ryan Dick	2ff4dae5ce	Add util functions calc_tensor_size(...) and calc_tensors_size(...).	2024-09-15 04:39:56 +03:00
Ryan Dick	705173b575	Remove unused layer_key property from LoRALayerBase.	2024-09-15 04:39:56 +03:00
Ryan Dick	2b3e4e123d	Split LoRA layer implementations into separate files.	2024-09-12 15:53:30 +00:00