Ryan Dick 78efed4499 Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

..

__init__.py

WIP - adding LoRA sidecar layers

2024-09-15 04:39:56 +03:00

lora_linear_sidecar_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00