Ryan Dick 2934e31620 Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.

2024-09-16 14:48:39 +00:00

..

concatenated_lora

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

lora

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

__init__.py

WIP - adding LoRA sidecar layers

2024-09-15 04:39:56 +03:00

lora_sidecar_layer.py

WIP - adding LoRA sidecar layers

2024-09-15 04:39:56 +03:00

lora_sidecar_module.py

Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.

2024-09-16 14:48:39 +00:00