Ryan Dick
|
3f990393a1
|
Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.
|
2024-12-24 14:32:11 +00:00 |
|
Ryan Dick
|
fe0ef2c27c
|
Add torch module autocast utilities.
|
2024-12-24 14:32:11 +00:00 |
|
Ryan Dick
|
65fcbf5f60
|
Bump bitsandbytes. The new verson contains improvements to state_dict loading/saving for LLM.int8 and promises improved speed on some HW.
|
2024-12-24 14:32:11 +00:00 |
|
Ryan Dick
|
55b13c1da3
|
(minor) Add TODO comment regarding the location of get_model_cache_key().
|
2024-12-24 14:23:19 +00:00 |
|
Ryan Dick
|
7dc3e0fdbe
|
Get rid of ModelLocker. It was an unnecessary layer of indirection.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
a39bcf7e85
|
Move lock(...) and unlock(...) logic from ModelLocker to the ModelCache and make a bunch of ModelCache properties/methods private.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
a7c72992a6
|
Pull get_model_cache_key(...) out of ModelCache. The ModelCache should not be concerned with implementation details like the submodel_type.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
d30a9ced38
|
Rename model_cache_default.py -> model_cache.py.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
e0bfa6157b
|
Remove ModelCacheBase.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
83ea6420e2
|
Move CacheStats to its own file.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
ce11a1952e
|
Move CacheRecord out to its own file.
|
2024-12-24 14:23:18 +00:00 |
|
Ryan Dick
|
e48dee4c4a
|
Rip out ModelLockerBase.
|
2024-12-24 14:23:18 +00:00 |
|
Mary Hipp
|
0c2f96daf1
|
add probe for ControlLoRA x diffusers
|
2024-12-17 14:01:41 -05:00 |
|
Brandon Rising
|
c9b2cce627
|
Add diffusers config object for control loras
|
2024-12-17 14:01:41 -05:00 |
|
Mary Hipp
|
401fb392b8
|
add FLUX control loras to starter models
|
2024-12-17 09:29:21 -05:00 |
|
Ryan Dick
|
b272d46056
|
Enable ability to control the weight of FLUX Control LoRAs.
|
2024-12-17 13:36:10 +00:00 |
|
Ryan Dick
|
dd09509dbd
|
Rename ModelPatcher -> LayerPatcher to avoid conflicts with another ModelPatcher definition.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
7fad4c9491
|
Rename LoRAModelRaw to ModelPatchRaw.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
b820862eab
|
Rename ModelPatcher methods to reflect that they are general model patching methods and are not LoRA-specific.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
c604a0956e
|
Rename LoRAPatcher -> ModelPatcher.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
9369b39a12
|
Add GGMLTensor op.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
80f64abd1e
|
Use a FluxControlLoRALayer when loading FLUX control LoRAs.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
37e3089457
|
Push LoRA layer reshaping down into the patch layers and add a new FluxControlLoRALayer type.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
fe09f2d27a
|
Move handling of LoRA scale and patch weight down into the layer patch classes.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
e7e3f7e144
|
Ensure that patches are on the correct device when used in sidecar wrappers.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
606d58d7db
|
Add sidecar wrapper for FLUX RMSNorm layers to support SetParameterLayers used by FLUX structural control LoRAs.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
c76a448846
|
Delete old sidecar_layers/ dir.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
46133b5656
|
Switch LoRAPatcher to use the new sidecar_wrappers/ rather than sidecar_layers/.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
ac28370fd2
|
Break up functions in LoRAPatcher in preparation for more refactoring.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
1e0552c813
|
Add optimized implementations for the LinearSidecarWrapper when using LoRALayer or ConcatenatedLoRALayer patch types (since these are the most common).
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
e2451ef5ca
|
A unit tests for LinearSidecarWrapper (and fix a bug).
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
443d838fd0
|
Add initial basic implementation of sidecar wrappers.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
808e3770d3
|
Remove AnyLoRALayer type definition in favor of using BaseLayerPatch base class.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
2b441d6a2d
|
Add BaseLayerPatch ABC to clarify the intended patch interface.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
58de93a89e
|
Delete empty file.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
1eede4315e
|
Delete ONNXModelPatcher. It is outdated and hasn't been used for a long time.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
8ea697d733
|
Mark LoRALayerBase.rank(...) as a private method.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
693d42661c
|
Add basic unit tests for LoRALayer.
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
41664f88db
|
Rename backend/patches/conversions/ to backend/patches/lora_conversions/
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
42f8d6aa11
|
Rename backend/lora/ to backend/patches
|
2024-12-17 13:20:19 +00:00 |
|
Ryan Dick
|
7da90a9b6b
|
Ensure that model probe does not crash with integer state dict keys.
|
2024-12-17 07:28:45 -05:00 |
|
Ryan Dick
|
440185cc40
|
Simplify FLUX control LoRA probing.
|
2024-12-17 07:28:45 -05:00 |
|
Ryan Dick
|
26edc71268
|
ruff format
|
2024-12-17 07:28:45 -05:00 |
|
Ryan Dick
|
a4bed7aee3
|
Minor tidy of FLUX control LoRA implementation. (mostly documentation)
|
2024-12-17 07:28:45 -05:00 |
|
Ryan Dick
|
d84adfd39f
|
Clean up FLUX control LoRA pre-processing logic.
|
2024-12-17 07:28:45 -05:00 |
|
Brandon Rising
|
70811d0bd0
|
Remove unexpected artifacts in output images
|
2024-12-17 07:28:45 -05:00 |
|
Mary Hipp
|
da213e4638
|
feat(ui): add control loras to control adapter model options, add default settings for preprocessor in probe
|
2024-12-17 07:28:45 -05:00 |
|
Brandon Rising
|
046d19446c
|
Rename Structural Lora to Control Lora
|
2024-12-17 07:28:45 -05:00 |
|
Ryan Dick
|
040551d4fb
|
Fixes to get FLUX Control LoRA working.
|
2024-12-17 07:28:45 -05:00 |
|
Brandon Rising
|
f53da60b84
|
Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model
|
2024-12-17 07:28:45 -05:00 |
|