Ryan Dick
807f458f13
Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.
2024-10-01 10:22:11 -04:00
Ryan Dick
68dbe45315
Fix regression with FLUX diffusers LoRA models where lora keys were not given the expected prefix.
2024-10-01 10:22:11 -04:00
Ryan Dick
c256826015
Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.
2024-09-30 07:59:14 -04:00
Ryan Dick
7d38a9b7fb
Add prefix to distinguish FLUX LoRA submodels.
2024-09-30 07:59:14 -04:00
Ryan Dick
d332d81866
Add ability to load FLUX kohya LoRA models that include patches for both the transformer and T5 models.
2024-09-30 07:59:14 -04:00
Ryan Dick
ba07e255f5
Add support for fractional denoise start and end with FLUX.
2024-09-26 19:54:28 -04:00
Ryan Dick
183a67cb1e
Merge branch 'main' into ryan/flux-trajectory-guidance
2024-09-20 22:29:34 +00:00
Ryan Dick
f5a2dc609a
Fix flaky FLUX LoRA unit test that fails occasionally due to numerical precision.
2024-09-20 16:01:15 +03:00
Ryan Dick
97de521c70
Add build_line(...) util function.
2024-09-20 01:01:37 +00:00
Ryan Dick
2934e31620
Fix bug when applying multiple LoRA models via apply_lora_sidecar_patches(), and add unit tests for the stacked LoRA case.
2024-09-16 14:48:39 +00:00
Ryan Dick
d51f2c5e00
Add bias to LoRA sidecar layer unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
b1cf5e989c
Replace 'torch.device("meta")' with 'accelerate.init_empty_weights()' in the hopes that the latter works properly on MacOS.
2024-09-15 04:39:56 +03:00
Ryan Dick
94668247dd
Delete duplicate file that was accidentally kept during rebase.
2024-09-15 04:39:56 +03:00
Ryan Dick
02f27c750a
Add unit tests for LoRAPatcher.apply_lora_sidecar_patches(...) and fixup dtype handling in the sidecar layers.
2024-09-15 04:39:56 +03:00
Ryan Dick
ba3ba3c23a
Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.
2024-09-15 04:39:56 +03:00
Ryan Dick
7ce41bf7e0
Fixup unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
705173b575
Remove unused layer_key property from LoRALayerBase.
2024-09-15 04:39:56 +03:00
Ryan Dick
fef26a5f2f
Consolidate all LoRA patching logic in the LoRAPatcher.
2024-09-15 04:39:56 +03:00
Ryan Dick
aac97e105a
Genera cleanup/documentation.
2024-09-15 04:39:56 +03:00
Ryan Dick
552a5b06a4
Add a check that all keys are handled in the FLUX Diffusers LoRA loading code.
2024-09-15 04:39:56 +03:00
Ryan Dick
42d6dd3906
Add utility test function for creating a dummy state_dict.
2024-09-15 04:39:56 +03:00
Ryan Dick
31a8757e6b
Add is_state_dict_likely_in_flux_diffusers_format(...) function with unit test.
2024-09-15 04:39:56 +03:00
Ryan Dick
534e938a62
Add unit test for lora_model_from_flux_diffusers_state_dict(...).
2024-09-15 04:39:56 +03:00
Ryan Dick
bb917ae7e5
(minor) Rename test file.
2024-09-15 04:39:56 +03:00
Ryan Dick
cf9f30cc56
Rename flux_kohya_lora_conversion_utils.py
2024-09-15 04:39:56 +03:00
Ryan Dick
92b8477299
Fixup FLUX LoRA unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
00e56863c2
Add utility function for detecting whether a state_dict is in the FLUX kohya LoRA format.
2024-09-15 04:39:56 +03:00
Ryan Dick
7b5befad0d
Update convert_flux_kohya_state_dict_to_invoke_format() to raise an exception if an unexpected key is encountered, and add a corresponding unit test.
2024-09-15 04:39:56 +03:00
Ryan Dick
8518ae9ccb
Remove unused LoRAModelRaw.name attribute.
2024-09-15 04:39:56 +03:00
Ryan Dick
ade75b4748
Get convert_flux_kohya_state_dict_to_invoke_format(...) working, with unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
7a80d9ebe2
Add state_dict keys for two FLUX LoRA formats to be used in unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
2b3e4e123d
Split LoRA layer implementations into separate files.
2024-09-12 15:53:30 +00:00
Ryan Dick
2313f326df
Add denoise_end param to FluxDenoiseInvocation.
2024-09-02 09:38:17 -04:00
Ryan Dick
0b77511271
Update HF download logic to work for black-forest-labs/FLUX.1-schnell.
2024-08-26 20:17:50 -04:00
Mary Hipp
41c3e73a3c
fix tests
2024-08-09 16:31:42 -04:00
Mary Hipp
5f83bb0069
update config docstring
2024-08-08 15:20:43 -04:00
Mary Hipp
b138882abc
fix tests?
2024-08-08 15:18:32 -04:00
Lincoln Stein
633bbb4e85
[MM2] Use typed ModelRecordChanges for model_install() rather than untyped dict ( #6645 )
...
* [MM2] replace untyped config dict passed to install_model with typed ModelRecordChanges
- adjusted frontend to work with new schema
- used this facility to assign "starter model" names and descriptions to the installed
models.
* documentation fix
* [MM2] replace untyped config dict passed to install_model with typed ModelRecordChanges
- adjusted frontend to work with new schema
- used this facility to assign "starter model" names and descriptions to the installed
models.
* documentation fix
* remove v9 pnpm lockfile
* [MM2] replace untyped config dict passed to install_model with typed ModelRecordChanges
- adjusted frontend to work with new schema
- used this facility to assign "starter model" names and descriptions to the installed
models.
* [MM2] replace untyped config dict passed to install_model with typed ModelRecordChanges
- adjusted frontend to work with new schema
- used this facility to assign "starter model" names and descriptions to the installed
models.
* remove v9 pnpm lockfile
* regenerate schema.ts
* prettified
---------
Co-authored-by: Lincoln Stein <lstein@gmail.com >
2024-07-23 21:41:00 +00:00
Ryan Dick
83a86abce2
Add unit tests for ExtensionsManager and ExtensionBase.
2024-07-19 14:15:46 -04:00
Ryan Dick
69af099532
Warn on invalid model configs in the DB rather than crashing.
2024-07-11 21:05:55 -04:00
Ryan Dick
35f8781ea2
Fix static type errors with SCHEDULER_NAME_VALUES. And, avoid bi-directional cross-directory imports, which contribute to circular import issues.
2024-07-05 07:38:35 -07:00
Ryan Dick
1d449097cc
Apply ruff rule to disallow all relative imports.
2024-07-04 09:35:37 -04:00
Lincoln Stein
0fe92cd406
[MM bugfix] Put model install errors on the event bus ( #6578 )
...
* fix access token lookup
* fix bug preventing model install error events from being reported
---------
Co-authored-by: Lincoln Stein <lstein@gmail.com >
2024-07-03 22:44:34 -04:00
Ryan Dick
a1b7dbfa54
Add unit test for patch_vae_tiling_params().
2024-07-02 09:07:03 -04:00
psychedelicious
41f46b846b
chore: ruff
2024-06-28 10:36:05 +10:00
psychedelicious
6dfc406c52
tests: update test_bulk_download.py after addition of archived field
2024-06-28 10:36:05 +10:00
Lincoln Stein
3e0fb45dd7
Load single-file checkpoints directly without conversion ( #6510 )
...
* use model_class.load_singlefile() instead of converting; works, but performance is poor
* adjust the convert api - not right just yet
* working, needs sql migrator update
* rename migration_11 before conflict merge with main
* Update invokeai/backend/model_manager/load/model_loaders/stable_diffusion.py
Co-authored-by: Ryan Dick <ryanjdick3@gmail.com >
* Update invokeai/backend/model_manager/load/model_loaders/stable_diffusion.py
Co-authored-by: Ryan Dick <ryanjdick3@gmail.com >
* implement lightweight version-by-version config migration
* simplified config schema migration code
* associate sdxl config with sdxl VAEs
* remove use of original_config_file in load_single_file()
---------
Co-authored-by: Lincoln Stein <lstein@gmail.com >
Co-authored-by: Ryan Dick <ryanjdick3@gmail.com >
2024-06-27 17:31:28 -04:00
psychedelicious
e26125b734
tests: fix test_model_install.py
2024-06-17 10:57:11 +10:00
Lincoln Stein
dc134935c8
replace load_and_cache_model() with load_remote_model() and load_local_odel()
2024-06-07 14:12:16 +10:00
Lincoln Stein
9f9379682e
ruff fixes
2024-06-07 13:54:41 +10:00
