10 Commits

Author	SHA1	Message	Date
Ryan Dick	2934e31620	Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.	2024-09-16 14:48:39 +00:00
Ryan Dick	78efed4499	Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.	2024-09-15 04:39:56 +03:00
Ryan Dick	ba3ba3c23a	Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.	2024-09-15 04:39:56 +03:00
Ryan Dick	61d3d566de	Minor cleanup and documentation updates.	2024-09-15 04:39:56 +03:00
Ryan Dick	ae41651346	Remove LoRA conv sidecar layers until they are needed and properly tested.	2024-09-15 04:39:56 +03:00
Ryan Dick	10c3c61cb2	Get diffusers FLUX LoRA working as sidecar patch on quantized model.	2024-09-15 04:39:56 +03:00
Ryan Dick	45bc8fcd7f	WIP - Implement sidecar LoRA layers using functional API.	2024-09-15 04:39:56 +03:00
Ryan Dick	f5f894437c	Bug fixes to get LoRA sidecar patching working for the first time.	2024-09-15 04:39:56 +03:00
Ryan Dick	3e12ac9740	WIP - LoRA sidecar layers.	2024-09-15 04:39:56 +03:00
Ryan Dick	049ce1826c	WIP - adding LoRA sidecar layers	2024-09-15 04:39:56 +03:00