Ryan Dick
cefcb340d9
Add LoRAPatcher.smart_apply_lora_patches()
2024-12-24 15:57:54 +00:00
Ryan Dick
0fc538734b
Skip flaky test when running on Github Actions, and further reduce peak unit test memory.
2024-12-24 14:32:11 +00:00
Ryan Dick
7214d4969b
Workaround a weird quirk of QuantState.to() and add a unit test to exercise it.
2024-12-24 14:32:11 +00:00
Ryan Dick
a83a999b79
Reduce peak memory used for unit tests.
2024-12-24 14:32:11 +00:00
Ryan Dick
f8a6accf8a
Fix bitsandbytes imports to avoid ImportErrors on MacOS.
2024-12-24 14:32:11 +00:00
Ryan Dick
f8ab414f99
Add CachedModelOnlyFullLoad to mirror the CachedModelWithPartialLoad for models that cannot or should not be partially loaded.
2024-12-24 14:32:11 +00:00
Ryan Dick
c6795a1b47
Make CachedModelWithPartialLoad work with models that have non-persistent buffers.
2024-12-24 14:32:11 +00:00
Ryan Dick
0a8fc74ae9
Add CachedModelWithPartialLoad to manage partially-loaded models using the new autocast modules.
2024-12-24 14:32:11 +00:00
Ryan Dick
dc54e8763b
Add CustomInvokeLinearNF4 to enable CPU -> GPU streaming for InvokeLinearNF4 layers.
2024-12-24 14:32:11 +00:00
Ryan Dick
1b56020876
Add CustomInvokeLinear8bitLt layer for device streaming with InvokeLinear8bitLt layers.
2024-12-24 14:32:11 +00:00
Ryan Dick
3f990393a1
Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.
2024-12-24 14:32:11 +00:00
Ryan Dick
97d56f7dc9
Add torch module autocast unit test for GGUF-quantized models.
2024-12-24 14:32:11 +00:00
Ryan Dick
fe0ef2c27c
Add torch module autocast utilities.
2024-12-24 14:32:11 +00:00
Ryan Dick
d30a9ced38
Rename model_cache_default.py -> model_cache.py.
2024-12-24 14:23:18 +00:00
Ryan Dick
e0bfa6157b
Remove ModelCacheBase.
2024-12-24 14:23:18 +00:00
Ryan Dick
dd09509dbd
Rename ModelPatcher -> LayerPatcher to avoid conflicts with another ModelPatcher definition.
2024-12-17 13:20:19 +00:00
Ryan Dick
7fad4c9491
Rename LoRAModelRaw to ModelPatchRaw.
2024-12-17 13:20:19 +00:00
Ryan Dick
b820862eab
Rename ModelPatcher methods to reflect that they are general model patching methods and are not LoRA-specific.
2024-12-17 13:20:19 +00:00
Ryan Dick
c604a0956e
Rename LoRAPatcher -> ModelPatcher.
2024-12-17 13:20:19 +00:00
Ryan Dick
37e3089457
Push LoRA layer reshaping down into the patch layers and add a new FluxControlLoRALayer type.
2024-12-17 13:20:19 +00:00
Ryan Dick
fe09f2d27a
Move handling of LoRA scale and patch weight down into the layer patch classes.
2024-12-17 13:20:19 +00:00
Ryan Dick
606d58d7db
Add sidecar wrapper for FLUX RMSNorm layers to support SetParameterLayers used by FLUX structural control LoRAs.
2024-12-17 13:20:19 +00:00
Ryan Dick
c76a448846
Delete old sidecar_layers/ dir.
2024-12-17 13:20:19 +00:00
Ryan Dick
1e0552c813
Add optimized implementations for the LinearSidecarWrapper when using LoRALayer or ConcatenatedLoRALayer patch types (since these are the most common).
2024-12-17 13:20:19 +00:00
Ryan Dick
e2451ef5ca
A unit tests for LinearSidecarWrapper (and fix a bug).
2024-12-17 13:20:19 +00:00
Ryan Dick
3a8a5442ea
Add basic unit tests for SetParameterLayer.
2024-12-17 13:20:19 +00:00
Ryan Dick
693d42661c
Add basic unit tests for LoRALayer.
2024-12-17 13:20:19 +00:00
Ryan Dick
41664f88db
Rename backend/patches/conversions/ to backend/patches/lora_conversions/
2024-12-17 13:20:19 +00:00
Ryan Dick
42f8d6aa11
Rename backend/lora/ to backend/patches
2024-12-17 13:20:19 +00:00
Ryan Dick
26edc71268
ruff format
2024-12-17 07:28:45 -05:00
Ryan Dick
a4bed7aee3
Minor tidy of FLUX control LoRA implementation. (mostly documentation)
2024-12-17 07:28:45 -05:00
Mary Hipp
da213e4638
feat(ui): add control loras to control adapter model options, add default settings for preprocessor in probe
2024-12-17 07:28:45 -05:00
Brandon Rising
046d19446c
Rename Structural Lora to Control Lora
2024-12-17 07:28:45 -05:00
Brandon Rising
f53da60b84
Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model
2024-12-17 07:28:45 -05:00
Ryan Dick
c6fc82f756
Infer the clip_extra_context_tokens param from the state dict for FLUX XLabs IP-Adapter V2 models.
2024-11-18 17:06:53 -08:00
Ryan Dick
9a77e951d2
Add unit test for FLUX XLabs IP-Adapter V2 model format.
2024-11-18 17:06:53 -08:00
Mary Hipp
c7878fddc6
(pytest) mock emit_invocation_progress on events service
2024-11-15 05:49:05 +11:00
Mary Hipp
1640ea0298
(pytest) add missing arg for mocked context
2024-11-15 05:49:05 +11:00
Mary Hipp
0c32ae9775
(pytest) fix import
2024-11-15 05:49:05 +11:00
Mary Hipp
571faf6d7c
(pytest) add queue_item and invocation to data in context for test
2024-11-15 05:49:05 +11:00
Ryan Dick
68c3b0649b
Add unit tests for FLUX diffusers LoRA without .proj_mlp layers.
2024-11-14 16:53:49 +00:00
Ryan Dick
8ef8bd4261
Add state dict tensor shapes for existing LoRA unit tests.
2024-11-14 16:53:49 +00:00
Darrell
fb19621361
Updated link to flux ip adapter model
2024-11-12 08:11:40 -05:00
psychedelicious
dfb5e8b5e5
tests: add invoke method & output annotation tests
2024-10-31 16:21:07 +11:00
psychedelicious
965069fce1
tests: fix nodes tests
...
they now require a valid output
2024-10-31 16:21:07 +11:00
psychedelicious
6f0f53849b
tests: reset config changes in test_deny_nodes when finished testing
2024-10-31 15:22:14 +11:00
psychedelicious
4e7d63761a
fix(nodes): nodes denylist handling
...
- Add method to force a rebuild of the pydantic type adapter for the union of invocations, which is used to validate graphs.
- Update the xfail'd test.
2024-10-31 15:22:14 +11:00
Ryan Dick
5cbe89afdd
Merge branch 'main' into ryan/flux-ip-adapter-cfg-2
2024-10-22 21:17:36 +00:00
Ryan Dick
d20b894a61
Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.
2024-10-23 07:59:48 +11:00
Ryan Dick
740f6eb19f
Skip tests that use the meta device - they fail on the MacOS CI runners.
2024-10-22 15:56:49 +00:00
