442 Commits

Author	SHA1	Message	Date
Ryan Dick	6798bbab26	Skip tests that are failing on MacOS CI runners (for now).	2024-10-09 16:34:42 +00:00
Ryan Dick	2c92e8a495	Revert "Try to fix test failures affecting MacOS CI runners." ... This reverts commit 216b36c75d.	2024-10-09 16:30:40 +00:00
Ryan Dick	216b36c75d	Try to fix test failures affecting MacOS CI runners.	2024-10-09 16:21:52 +00:00
Ryan Dick	bfc460a5c6	Rename DiffusersControlNetFlux -> InstantXControlNetFlux.	2024-10-09 14:17:42 +00:00
Ryan Dick	80bc4ebee3	Add unit test to test the full flow of loading an InstantX ControlNet from a state dict.	2024-10-09 14:17:42 +00:00
Ryan Dick	745b6dbd5d	Add unit test for infer_instantx_num_control_modes_from_state_dict().	2024-10-09 14:17:42 +00:00
Ryan Dick	c7628945c4	Add unit test for infer_flux_params_from_state_dict(...).	2024-10-09 14:17:42 +00:00
Ryan Dick	728927ecff	Update FLUX ControlNet unit test state dicts to include shapes.	2024-10-09 14:17:42 +00:00
Ryan Dick	5872f05342	Add unit test for convert_diffusers_instantx_state_dict_to_bfl_format(...) and fix a few bugs.	2024-10-09 14:17:42 +00:00
Ryan Dick	4be3a33744	Add utils for detecting XLabs ControlNet vs. InstantX ControlNet from ... state dict.	2024-10-09 14:17:42 +00:00
Ryan Dick	92b1515d9d	Add InstantX FLUX ControlNet state dict for unit testing.	2024-10-09 14:17:42 +00:00
Ryan Dick	2cc72b19bc	Add XLabs FLUX controlnet state dict key file to be used for development/testing.	2024-10-09 14:17:41 +00:00
Ryan Dick	26832c1a0e	Add unit test to confirm that GGMLTensor sizes (bytes) are being calculated correctly.	2024-10-02 18:33:05 -04:00
Ryan Dick	3d4bd71098	Update test_probe_handles_state_dict_with_integer_keys() to make sure that it is still testing what it's intended to test. Previously, we were skipping an important part of the test by using a fake file path.	2024-10-02 18:33:05 -04:00
Ryan Dick	ec7e771942	Add a compute_dtype field to GGMLTensor.	2024-10-02 18:33:05 -04:00
Ryan Dick	fe84013392	Add unit tests for GGMLTensor.	2024-10-02 18:33:05 -04:00
Brandon Rising	446e2884bc	Remove no longer used code paths, general cleanup of new dequantization code, update probe	2024-10-02 18:33:05 -04:00
Brandon Rising	7d9f125232	Run ruff and update imports	2024-10-02 18:33:05 -04:00
Brandon Rising	0875e861f5	Various updates to gguf performance	2024-10-02 18:33:05 -04:00
Ryan Dick	f347b26999	Initial experimentation with Tensor-like extension for GGUF.	2024-10-02 18:33:05 -04:00
Brandon Rising	8cf19c4124	Run Ruff	2024-10-02 18:33:05 -04:00
Brandon Rising	f7112ae57b	Add unit tests for torch patcher	2024-10-02 18:33:05 -04:00
Ryan Dick	807f458f13	Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.	2024-10-01 10:22:11 -04:00
Ryan Dick	68dbe45315	Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.	2024-10-01 10:22:11 -04:00
Ryan Dick	c256826015	Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.	2024-09-30 07:59:14 -04:00
Ryan Dick	7d38a9b7fb	Add prefix to distinguish FLUX LoRA submodels.	2024-09-30 07:59:14 -04:00
Ryan Dick	d332d81866	Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.	2024-09-30 07:59:14 -04:00
Ryan Dick	ba07e255f5	Add support for fractional denoise start and end with FLUX.	2024-09-26 19:54:28 -04:00
Ryan Dick	183a67cb1e	Merge branch 'main' into ryan/flux-trajectory-guidance	2024-09-20 22:29:34 +00:00
Ryan Dick	f5a2dc609a	Fix flaky FLUX LoRA unit test that fails occasionally due to numerical precision.	2024-09-20 16:01:15 +03:00
Ryan Dick	97de521c70	Add build_line(...) util function.	2024-09-20 01:01:37 +00:00
Ryan Dick	2934e31620	Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.	2024-09-16 14:48:39 +00:00
Ryan Dick	d51f2c5e00	Add bias to LoRA sidecar layer unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	b1cf5e989c	Replace 'torch.device("meta")' with 'accelerate.init_empty_weights()' in the hopes that the latter works properly on MacOS.	2024-09-15 04:39:56 +03:00
Ryan Dick	94668247dd	Delete duplicate file that was accidentally kept during rebase.	2024-09-15 04:39:56 +03:00
Ryan Dick	02f27c750a	Add unit tests for LoRAPatcher.apply_lora_sidecar_patches(...) and fixup dtype handling in the sidecar layers.	2024-09-15 04:39:56 +03:00
Ryan Dick	ba3ba3c23a	Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.	2024-09-15 04:39:56 +03:00
Ryan Dick	7ce41bf7e0	Fixup unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	705173b575	Remove unused layer_key property from LoRALayerBase.	2024-09-15 04:39:56 +03:00
Ryan Dick	fef26a5f2f	Consolidate all LoRA patching logic in the LoRAPatcher.	2024-09-15 04:39:56 +03:00
Ryan Dick	aac97e105a	Genera cleanup/documentation.	2024-09-15 04:39:56 +03:00
Ryan Dick	552a5b06a4	Add a check that all keys are handled in the FLUX Diffusers LoRA loading code.	2024-09-15 04:39:56 +03:00
Ryan Dick	42d6dd3906	Add utility test function for creating a dummy state_dict.	2024-09-15 04:39:56 +03:00
Ryan Dick	31a8757e6b	Add is_state_dict_likely_in_flux_diffusers_format(...) function with unit test.	2024-09-15 04:39:56 +03:00
Ryan Dick	534e938a62	Add unit test for lora_model_from_flux_diffusers_state_dict(...).	2024-09-15 04:39:56 +03:00
Ryan Dick	bb917ae7e5	(minor) Rename test file.	2024-09-15 04:39:56 +03:00
Ryan Dick	cf9f30cc56	Rename flux_kohya_lora_conversion_utils.py	2024-09-15 04:39:56 +03:00
Ryan Dick	92b8477299	Fixup FLUX LoRA unit tests.	2024-09-15 04:39:56 +03:00
Ryan Dick	00e56863c2	Add utility function for detecting whether a state_dict is in the FLUX kohya LoRA format.	2024-09-15 04:39:56 +03:00
Ryan Dick	7b5befad0d	Update convert_flux_kohya_state_dict_to_invoke_format() to raise an exception if an unexpected key is encountered, and add a corresponding unit test.	2024-09-15 04:39:56 +03:00