Ryan Dick 6c919e1bca Handle DoRA layer device casting when model is partially-loaded.

2025-01-28 14:51:35 +00:00

..

__init__.py

Rename backend/lora/ to backend/patches

2024-12-17 13:20:19 +00:00

base_layer_patch.py

Update BaseLayerPatch.get_parameters(...) to accept a dict of orig_parameters rather than orig_module. This will enable compatibility between patching and cpu->gpu streaming.

2024-12-28 21:12:53 +00:00

dora_layer.py

Handle DoRA layer device casting when model is partially-loaded.

2025-01-28 14:51:35 +00:00

flux_control_lora_layer.py

Update BaseLayerPatch.get_parameters(...) to accept a dict of orig_parameters rather than orig_module. This will enable compatibility between patching and cpu->gpu streaming.

2024-12-28 21:12:53 +00:00

full_layer.py

Mark LoRALayerBase.rank(...) as a private method.

2024-12-17 13:20:19 +00:00

ia3_layer.py

Handle device casting in ia2_layer.py.

2025-01-07 00:31:00 +00:00

loha_layer.py

Mark LoRALayerBase.rank(...) as a private method.

2024-12-17 13:20:19 +00:00

lokr_layer.py

Mark LoRALayerBase.rank(...) as a private method.

2024-12-17 13:20:19 +00:00

lora_layer_base.py

Fix bug with some LoRA variants when applied to a BnB NF4 quantized model. Note the previous commit which added a unit test to trigger this bug.

2025-01-22 09:20:40 +11:00

lora_layer.py

Mark LoRALayerBase.rank(...) as a private method.

2024-12-17 13:20:19 +00:00

merged_layer_patch.py

Rename ConcatenatedLoRALayer to MergedLayerPatch. And other minor cleanup.

2025-01-28 14:51:35 +00:00

norm_layer.py

Mark LoRALayerBase.rank(...) as a private method.

2024-12-17 13:20:19 +00:00

param_shape_utils.py

Fix bug with some LoRA variants when applied to a BnB NF4 quantized model. Note the previous commit which added a unit test to trigger this bug.

2025-01-22 09:20:40 +11:00

set_parameter_layer.py

Update BaseLayerPatch.get_parameters(...) to accept a dict of orig_parameters rather than orig_module. This will enable compatibility between patching and cpu->gpu streaming.

2024-12-28 21:12:53 +00:00

utils.py

First draft of DoRALayer. Not tested yet.

2025-01-28 14:51:35 +00:00