452 Commits

Author	SHA1	Message	Date
Ryan Dick	5cbe89afdd	Merge branch 'main' into ryan/flux-ip-adapter-cfg-2	2024-10-22 21:17:36 +00:00
Ryan Dick	d20b894a61	Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.	2024-10-23 07:59:48 +11:00
Ryan Dick	740f6eb19f	Skip tests that use the meta device - they fail on the MacOS CI runners.	2024-10-22 15:56:49 +00:00
Ryan Dick	c2a8fbd8d6	(minor) Move infer_xlabs_ip_adapter_params_from_state_dict(...) to state_dict_utils.py.	2024-10-21 15:38:50 +00:00
Ryan Dick	f939dbdc33	Add is_state_dict_xlabs_ip_adapter() utility function.	2024-10-21 15:38:50 +00:00
Ryan Dick	24a0ca86f5	Add logic for loading an Xlabs IP-Adapter from a state dict.	2024-10-21 15:38:50 +00:00
Ryan Dick	95c30f6a8b	Add initial logic for inferring FLUX IP-Adapter params from a state_dict.	2024-10-21 15:38:50 +00:00
Ryan Dick	7bf5927c43	Add XLabs IP-Adapter state dict for unit tests.	2024-10-21 15:38:50 +00:00
Ryan Dick	32c7cdd856	Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.	2024-10-21 14:52:02 +00:00
psychedelicious	5440c03767	fix(app): directory traversal when deleting images	2024-10-18 14:27:41 +11:00
Ryan Dick	6798bbab26	Skip tests that are failing on MacOS CI runners (for now).	2024-10-09 16:34:42 +00:00
Ryan Dick	2c92e8a495	Revert "Try to fix test failures affecting MacOS CI runners." ... This reverts commit 216b36c75d.	2024-10-09 16:30:40 +00:00
Ryan Dick	216b36c75d	Try to fix test failures affecting MacOS CI runners.	2024-10-09 16:21:52 +00:00
Ryan Dick	bfc460a5c6	Rename DiffusersControlNetFlux -> InstantXControlNetFlux.	2024-10-09 14:17:42 +00:00
Ryan Dick	80bc4ebee3	Add unit test to test the full flow of loading an InstantX ControlNet from a state dict.	2024-10-09 14:17:42 +00:00
Ryan Dick	745b6dbd5d	Add unit test for infer_instantx_num_control_modes_from_state_dict().	2024-10-09 14:17:42 +00:00
Ryan Dick	c7628945c4	Add unit test for infer_flux_params_from_state_dict(...).	2024-10-09 14:17:42 +00:00
Ryan Dick	728927ecff	Update FLUX ControlNet unit test state dicts to include shapes.	2024-10-09 14:17:42 +00:00
Ryan Dick	5872f05342	Add unit test for convert_diffusers_instantx_state_dict_to_bfl_format(...) and fix a few bugs.	2024-10-09 14:17:42 +00:00
Ryan Dick	4be3a33744	Add utils for detecting XLabs ControlNet vs. InstantX ControlNet from ... state dict.	2024-10-09 14:17:42 +00:00
Ryan Dick	92b1515d9d	Add InstantX FLUX ControlNet state dict for unit testing.	2024-10-09 14:17:42 +00:00
Ryan Dick	2cc72b19bc	Add XLabs FLUX controlnet state dict key file to be used for development/testing.	2024-10-09 14:17:41 +00:00
Ryan Dick	26832c1a0e	Add unit test to confirm that GGMLTensor sizes (bytes) are being calculated correctly.	2024-10-02 18:33:05 -04:00
Ryan Dick	3d4bd71098	Update test_probe_handles_state_dict_with_integer_keys() to make sure that it is still testing what it's intended to test. Previously, we were skipping an important part of the test by using a fake file path.	2024-10-02 18:33:05 -04:00
Ryan Dick	ec7e771942	Add a compute_dtype field to GGMLTensor.	2024-10-02 18:33:05 -04:00
Ryan Dick	fe84013392	Add unit tests for GGMLTensor.	2024-10-02 18:33:05 -04:00
Brandon Rising	446e2884bc	Remove no longer used code paths, general cleanup of new dequantization code, update probe	2024-10-02 18:33:05 -04:00
Brandon Rising	7d9f125232	Run ruff and update imports	2024-10-02 18:33:05 -04:00
Brandon Rising	0875e861f5	Various updates to gguf performance	2024-10-02 18:33:05 -04:00
Ryan Dick	f347b26999	Initial experimentation with Tensor-like extension for GGUF.	2024-10-02 18:33:05 -04:00
Brandon Rising	8cf19c4124	Run Ruff	2024-10-02 18:33:05 -04:00
Brandon Rising	f7112ae57b	Add unit tests for torch patcher	2024-10-02 18:33:05 -04:00
Ryan Dick	807f458f13	Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.	2024-10-01 10:22:11 -04:00
Ryan Dick	68dbe45315	Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.	2024-10-01 10:22:11 -04:00
Ryan Dick	c256826015	Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.	2024-09-30 07:59:14 -04:00
Ryan Dick	7d38a9b7fb	Add prefix to distinguish FLUX LoRA submodels.	2024-09-30 07:59:14 -04:00
Ryan Dick	d332d81866	Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.	2024-09-30 07:59:14 -04:00
Ryan Dick	ba07e255f5	Add support for fractional denoise start and end with FLUX.	2024-09-26 19:54:28 -04:00
Ryan Dick	183a67cb1e	Merge branch 'main' into ryan/flux-trajectory-guidance	2024-09-20 22:29:34 +00:00
Ryan Dick	f5a2dc609a	Fix flaky FLUX LoRA unit test that fails occasionally due to numerical precision.	2024-09-20 16:01:15 +03:00
Ryan Dick	97de521c70	Add build_line(...) util function.	2024-09-20 01:01:37 +00:00
Ryan Dick	2934e31620	Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.	2024-09-16 14:48:39 +00:00
Ryan Dick	d51f2c5e00	Add bias to LoRA sidecar layer unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	b1cf5e989c	Replace 'torch.device("meta")' with 'accelerate.init_empty_weights()' in the hopes that the latter works properly on MacOS.	2024-09-15 04:39:56 +03:00
Ryan Dick	94668247dd	Delete duplicate file that was accidentally kept during rebase.	2024-09-15 04:39:56 +03:00
Ryan Dick	02f27c750a	Add unit tests for LoRAPatcher.apply_lora_sidecar_patches(...) and fixup dtype handling in the sidecar layers.	2024-09-15 04:39:56 +03:00
Ryan Dick	ba3ba3c23a	Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.	2024-09-15 04:39:56 +03:00
Ryan Dick	7ce41bf7e0	Fixup unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	705173b575	Remove unused layer_key property from LoRALayerBase.	2024-09-15 04:39:56 +03:00
Ryan Dick	fef26a5f2f	Consolidate all LoRA patching logic in the LoRAPatcher.	2024-09-15 04:39:56 +03:00