Ryan Dick
37e3089457
Push LoRA layer reshaping down into the patch layers and add a new FluxControlLoRALayer type.
2024-12-17 13:20:19 +00:00
Ryan Dick
fe09f2d27a
Move handling of LoRA scale and patch weight down into the layer patch classes.
2024-12-17 13:20:19 +00:00
Ryan Dick
606d58d7db
Add sidecar wrapper for FLUX RMSNorm layers to support SetParameterLayers used by FLUX structural control LoRAs.
2024-12-17 13:20:19 +00:00
Ryan Dick
c76a448846
Delete old sidecar_layers/ dir.
2024-12-17 13:20:19 +00:00
Ryan Dick
1e0552c813
Add optimized implementations for the LinearSidecarWrapper when using LoRALayer or ConcatenatedLoRALayer patch types (since these are the most common).
2024-12-17 13:20:19 +00:00
Ryan Dick
e2451ef5ca
A unit tests for LinearSidecarWrapper (and fix a bug).
2024-12-17 13:20:19 +00:00
Ryan Dick
3a8a5442ea
Add basic unit tests for SetParameterLayer.
2024-12-17 13:20:19 +00:00
Ryan Dick
693d42661c
Add basic unit tests for LoRALayer.
2024-12-17 13:20:19 +00:00
Ryan Dick
41664f88db
Rename backend/patches/conversions/ to backend/patches/lora_conversions/
2024-12-17 13:20:19 +00:00
Ryan Dick
42f8d6aa11
Rename backend/lora/ to backend/patches
2024-12-17 13:20:19 +00:00
Ryan Dick
26edc71268
ruff format
2024-12-17 07:28:45 -05:00
Ryan Dick
a4bed7aee3
Minor tidy of FLUX control LoRA implementation. (mostly documentation)
2024-12-17 07:28:45 -05:00
Mary Hipp
da213e4638
feat(ui): add control loras to control adapter model options, add default settings for preprocessor in probe
2024-12-17 07:28:45 -05:00
Brandon Rising
046d19446c
Rename Structural Lora to Control Lora
2024-12-17 07:28:45 -05:00
Brandon Rising
f53da60b84
Lots of updates centered around using the lora patcher rather than changing the modules in the transformer model
2024-12-17 07:28:45 -05:00
Ryan Dick
c6fc82f756
Infer the clip_extra_context_tokens param from the state dict for FLUX XLabs IP-Adapter V2 models.
2024-11-18 17:06:53 -08:00
Ryan Dick
9a77e951d2
Add unit test for FLUX XLabs IP-Adapter V2 model format.
2024-11-18 17:06:53 -08:00
Mary Hipp
c7878fddc6
(pytest) mock emit_invocation_progress on events service
2024-11-15 05:49:05 +11:00
Mary Hipp
1640ea0298
(pytest) add missing arg for mocked context
2024-11-15 05:49:05 +11:00
Mary Hipp
0c32ae9775
(pytest) fix import
2024-11-15 05:49:05 +11:00
Mary Hipp
571faf6d7c
(pytest) add queue_item and invocation to data in context for test
2024-11-15 05:49:05 +11:00
Ryan Dick
68c3b0649b
Add unit tests for FLUX diffusers LoRA without .proj_mlp layers.
2024-11-14 16:53:49 +00:00
Ryan Dick
8ef8bd4261
Add state dict tensor shapes for existing LoRA unit tests.
2024-11-14 16:53:49 +00:00
Darrell
fb19621361
Updated link to flux ip adapter model
2024-11-12 08:11:40 -05:00
psychedelicious
dfb5e8b5e5
tests: add invoke method & output annotation tests
2024-10-31 16:21:07 +11:00
psychedelicious
965069fce1
tests: fix nodes tests
...
they now require a valid output
2024-10-31 16:21:07 +11:00
psychedelicious
6f0f53849b
tests: reset config changes in test_deny_nodes when finished testing
2024-10-31 15:22:14 +11:00
psychedelicious
4e7d63761a
fix(nodes): nodes denylist handling
...
- Add method to force a rebuild of the pydantic type adapter for the union of invocations, which is used to validate graphs.
- Update the xfail'd test.
2024-10-31 15:22:14 +11:00
Ryan Dick
5cbe89afdd
Merge branch 'main' into ryan/flux-ip-adapter-cfg-2
2024-10-22 21:17:36 +00:00
Ryan Dick
d20b894a61
Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.
2024-10-23 07:59:48 +11:00
Ryan Dick
740f6eb19f
Skip tests that use the meta device - they fail on the MacOS CI runners.
2024-10-22 15:56:49 +00:00
Ryan Dick
c2a8fbd8d6
(minor) Move infer_xlabs_ip_adapter_params_from_state_dict(...) to state_dict_utils.py.
2024-10-21 15:38:50 +00:00
Ryan Dick
f939dbdc33
Add is_state_dict_xlabs_ip_adapter() utility function.
2024-10-21 15:38:50 +00:00
Ryan Dick
24a0ca86f5
Add logic for loading an Xlabs IP-Adapter from a state dict.
2024-10-21 15:38:50 +00:00
Ryan Dick
95c30f6a8b
Add initial logic for inferring FLUX IP-Adapter params from a state_dict.
2024-10-21 15:38:50 +00:00
Ryan Dick
7bf5927c43
Add XLabs IP-Adapter state dict for unit tests.
2024-10-21 15:38:50 +00:00
Ryan Dick
32c7cdd856
Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.
2024-10-21 14:52:02 +00:00
psychedelicious
5440c03767
fix(app): directory traversal when deleting images
2024-10-18 14:27:41 +11:00
Ryan Dick
6798bbab26
Skip tests that are failing on MacOS CI runners (for now).
2024-10-09 16:34:42 +00:00
Ryan Dick
2c92e8a495
Revert "Try to fix test failures affecting MacOS CI runners."
...
This reverts commit 216b36c75d
2024-10-09 16:30:40 +00:00
Ryan Dick
216b36c75d
Try to fix test failures affecting MacOS CI runners.
2024-10-09 16:21:52 +00:00
Ryan Dick
bfc460a5c6
Rename DiffusersControlNetFlux -> InstantXControlNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
80bc4ebee3
Add unit test to test the full flow of loading an InstantX ControlNet from a state dict.
2024-10-09 14:17:42 +00:00
Ryan Dick
745b6dbd5d
Add unit test for infer_instantx_num_control_modes_from_state_dict().
2024-10-09 14:17:42 +00:00
Ryan Dick
c7628945c4
Add unit test for infer_flux_params_from_state_dict(...).
2024-10-09 14:17:42 +00:00
Ryan Dick
728927ecff
Update FLUX ControlNet unit test state dicts to include shapes.
2024-10-09 14:17:42 +00:00
Ryan Dick
5872f05342
Add unit test for convert_diffusers_instantx_state_dict_to_bfl_format(...) and fix a few bugs.
2024-10-09 14:17:42 +00:00
Ryan Dick
4be3a33744
Add utils for detecting XLabs ControlNet vs. InstantX ControlNet from
...
state dict.
2024-10-09 14:17:42 +00:00
Ryan Dick
92b1515d9d
Add InstantX FLUX ControlNet state dict for unit testing.
2024-10-09 14:17:42 +00:00
Ryan Dick
2cc72b19bc
Add XLabs FLUX controlnet state dict key file to be used for development/testing.
2024-10-09 14:17:41 +00:00
