Ryan Dick
|
6798bbab26
|
Skip tests that are failing on MacOS CI runners (for now).
|
2024-10-09 16:34:42 +00:00 |
|
Ryan Dick
|
2c92e8a495
|
Revert "Try to fix test failures affecting MacOS CI runners."
This reverts commit 216b36c75d.
|
2024-10-09 16:30:40 +00:00 |
|
Ryan Dick
|
216b36c75d
|
Try to fix test failures affecting MacOS CI runners.
|
2024-10-09 16:21:52 +00:00 |
|
Ryan Dick
|
bfc460a5c6
|
Rename DiffusersControlNetFlux -> InstantXControlNetFlux.
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
80bc4ebee3
|
Add unit test to test the full flow of loading an InstantX ControlNet from a state dict.
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
745b6dbd5d
|
Add unit test for infer_instantx_num_control_modes_from_state_dict().
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
c7628945c4
|
Add unit test for infer_flux_params_from_state_dict(...).
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
728927ecff
|
Update FLUX ControlNet unit test state dicts to include shapes.
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
5872f05342
|
Add unit test for convert_diffusers_instantx_state_dict_to_bfl_format(...) and fix a few bugs.
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
4be3a33744
|
Add utils for detecting XLabs ControlNet vs. InstantX ControlNet from
state dict.
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
92b1515d9d
|
Add InstantX FLUX ControlNet state dict for unit testing.
|
2024-10-09 14:17:42 +00:00 |
|
Ryan Dick
|
2cc72b19bc
|
Add XLabs FLUX controlnet state dict key file to be used for development/testing.
|
2024-10-09 14:17:41 +00:00 |
|
Ryan Dick
|
26832c1a0e
|
Add unit test to confirm that GGMLTensor sizes (bytes) are being calculated correctly.
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
ec7e771942
|
Add a compute_dtype field to GGMLTensor.
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
fe84013392
|
Add unit tests for GGMLTensor.
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
446e2884bc
|
Remove no longer used code paths, general cleanup of new dequantization code, update probe
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
7d9f125232
|
Run ruff and update imports
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
0875e861f5
|
Various updates to gguf performance
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
f347b26999
|
Initial experimentation with Tensor-like extension for GGUF.
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
8cf19c4124
|
Run Ruff
|
2024-10-02 18:33:05 -04:00 |
|
Brandon Rising
|
f7112ae57b
|
Add unit tests for torch patcher
|
2024-10-02 18:33:05 -04:00 |
|
Ryan Dick
|
807f458f13
|
Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.
|
2024-10-01 10:22:11 -04:00 |
|
Ryan Dick
|
68dbe45315
|
Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.
|
2024-10-01 10:22:11 -04:00 |
|
Ryan Dick
|
c256826015
|
Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
7d38a9b7fb
|
Add prefix to distinguish FLUX LoRA submodels.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
d332d81866
|
Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.
|
2024-09-30 07:59:14 -04:00 |
|
Ryan Dick
|
ba07e255f5
|
Add support for fractional denoise start and end with FLUX.
|
2024-09-26 19:54:28 -04:00 |
|
Ryan Dick
|
183a67cb1e
|
Merge branch 'main' into ryan/flux-trajectory-guidance
|
2024-09-20 22:29:34 +00:00 |
|
Ryan Dick
|
f5a2dc609a
|
Fix flaky FLUX LoRA unit test that fails occasionally due to numerical precision.
|
2024-09-20 16:01:15 +03:00 |
|
Ryan Dick
|
97de521c70
|
Add build_line(...) util function.
|
2024-09-20 01:01:37 +00:00 |
|
Ryan Dick
|
2934e31620
|
Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.
|
2024-09-16 14:48:39 +00:00 |
|
Ryan Dick
|
d51f2c5e00
|
Add bias to LoRA sidecar layer unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
b1cf5e989c
|
Replace 'torch.device("meta")' with 'accelerate.init_empty_weights()' in the hopes that the latter works properly on MacOS.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
94668247dd
|
Delete duplicate file that was accidentally kept during rebase.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
02f27c750a
|
Add unit tests for LoRAPatcher.apply_lora_sidecar_patches(...) and fixup dtype handling in the sidecar layers.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
ba3ba3c23a
|
Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
7ce41bf7e0
|
Fixup unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
705173b575
|
Remove unused layer_key property from LoRALayerBase.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
fef26a5f2f
|
Consolidate all LoRA patching logic in the LoRAPatcher.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
aac97e105a
|
Genera cleanup/documentation.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
552a5b06a4
|
Add a check that all keys are handled in the FLUX Diffusers LoRA loading code.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
42d6dd3906
|
Add utility test function for creating a dummy state_dict.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
31a8757e6b
|
Add is_state_dict_likely_in_flux_diffusers_format(...) function with unit test.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
534e938a62
|
Add unit test for lora_model_from_flux_diffusers_state_dict(...).
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
bb917ae7e5
|
(minor) Rename test file.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
cf9f30cc56
|
Rename flux_kohya_lora_conversion_utils.py
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
92b8477299
|
Fixup FLUX LoRA unit tests.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
00e56863c2
|
Add utility function for detecting whether a state_dict is in the FLUX kohya LoRA format.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
7b5befad0d
|
Update convert_flux_kohya_state_dict_to_invoke_format() to raise an exception if an unexpected key is encountered, and add a corresponding unit test.
|
2024-09-15 04:39:56 +03:00 |
|
Ryan Dick
|
8518ae9ccb
|
Remove unused LoRAModelRaw.name attribute.
|
2024-09-15 04:39:56 +03:00 |
|