Brandon Rising f53da60b84 Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model

2024-12-17 07:28:45 -05:00

..

__init__.py

Split LoRA layer implementations into separate files.

2024-09-12 15:53:30 +00:00

any_lora_layer.py

Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model

2024-12-17 07:28:45 -05:00

concatenated_lora_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

full_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

ia3_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

loha_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

lokr_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

lora_layer_base.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

lora_layer.py

Add bias to LoRA sidecar layer unit tests.

2024-09-15 04:39:56 +03:00

norm_layer.py

Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.

2024-09-15 04:39:56 +03:00

reshape_weight_layer.py

Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model

2024-12-17 07:28:45 -05:00

set_parameter_layer.py

Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model

2024-12-17 07:28:45 -05:00

utils.py

Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model

2024-12-17 07:28:45 -05:00