Ryan Dick
d51f2c5e00
Add bias to LoRA sidecar layer unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
78efed4499
Revert change of make all LoRA layers torch.nn.Module's. While the code is uglier, it turns out that the Module implementation of some ops like .to(...) is noticeably slower.
2024-09-15 04:39:56 +03:00
Ryan Dick
b1cf5e989c
Replace 'torch.device("meta")' with 'accelerate.init_empty_weights()' in the hopes that the latter works properly on MacOS.
2024-09-15 04:39:56 +03:00
Ryan Dick
94668247dd
Delete duplicate file that was accidentally kept during rebase.
2024-09-15 04:39:56 +03:00
Ryan Dick
02f27c750a
Add unit tests for LoRAPatcher.apply_lora_sidecar_patches(...) and fixup dtype handling in the sidecar layers.
2024-09-15 04:39:56 +03:00
Ryan Dick
ba3ba3c23a
Add unit tests for LoRALinearSidecarLayer and ConcatenatedLoRALinearSidecarLayer.
2024-09-15 04:39:56 +03:00
Ryan Dick
61d3d566de
Minor cleanup and documentation updates.
2024-09-15 04:39:56 +03:00
Ryan Dick
ae41651346
Remove LoRA conv sidecar layers until they are needed and properly tested.
2024-09-15 04:39:56 +03:00
Ryan Dick
7ce41bf7e0
Fixup unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
5bb0c79c14
Add links to test models for loha, lokr, ia3.
2024-09-15 04:39:56 +03:00
Ryan Dick
9438ea608c
Update all lycoris layer types to use the new torch.nn.Module base class.
2024-09-15 04:39:56 +03:00
Ryan Dick
81fbaf2b8b
Assume LoRA alpha=8 for FLUX diffusers PEFT LoRAs.
2024-09-15 04:39:56 +03:00
Ryan Dick
10c3c61cb2
Get diffusers FLUX LoRA working as sidecar patch on quantized model.
2024-09-15 04:39:56 +03:00
Ryan Dick
45bc8fcd7f
WIP - Implement sidecar LoRA layers using functional API.
2024-09-15 04:39:56 +03:00
Ryan Dick
f5f894437c
Bug fixes to get LoRA sidecar patching working for the first time.
2024-09-15 04:39:56 +03:00
Ryan Dick
3e12ac9740
WIP - LoRA sidecar layers.
2024-09-15 04:39:56 +03:00
Ryan Dick
049ce1826c
WIP - adding LoRA sidecar layers
2024-09-15 04:39:56 +03:00
Ryan Dick
2ff4dae5ce
Add util functions calc_tensor_size(...) and calc_tensors_size(...).
2024-09-15 04:39:56 +03:00
Ryan Dick
705173b575
Remove unused layer_key property from LoRALayerBase.
2024-09-15 04:39:56 +03:00
Ryan Dick
fef26a5f2f
Consolidate all LoRA patching logic in the LoRAPatcher.
2024-09-15 04:39:56 +03:00
Ryan Dick
ee5d8f6caf
lora_layer_from_state_dict(...) -> any_lora_layer_from_state_dict(...)
2024-09-15 04:39:56 +03:00
Ryan Dick
ddda60c1a2
Rename peft/ -> lora/
2024-09-15 04:39:56 +03:00
Ryan Dick
aac97e105a
Genera cleanup/documentation.
2024-09-15 04:39:56 +03:00
Ryan Dick
552a5b06a4
Add a check that all keys are handled in the FLUX Diffusers LoRA loading code.
2024-09-15 04:39:56 +03:00
Ryan Dick
5800e60b06
Add model probe support for FLUX LoRA models in Diffusers format.
2024-09-15 04:39:56 +03:00
Ryan Dick
42d6dd3906
Add utility test function for creating a dummy state_dict.
2024-09-15 04:39:56 +03:00
Ryan Dick
31a8757e6b
Add is_state_dict_likely_in_flux_diffusers_format(...) function with unit test.
2024-09-15 04:39:56 +03:00
Ryan Dick
534e938a62
Add unit test for lora_model_from_flux_diffusers_state_dict(...).
2024-09-15 04:39:56 +03:00
Ryan Dick
040cc28f93
First draft of lora_model_from_flux_diffusers_state_dict(...).
2024-09-15 04:39:56 +03:00
Ryan Dick
bb917ae7e5
(minor) Rename test file.
2024-09-15 04:39:56 +03:00
Ryan Dick
bb528d916e
Add ConcatenateLoRALayer class.
2024-09-15 04:39:56 +03:00
Ryan Dick
dc09171cdb
WIP on supporting diffusers format FLUX LoRAs.
2024-09-15 04:39:56 +03:00
Ryan Dick
cf9f30cc56
Rename flux_kohya_lora_conversion_utils.py
2024-09-15 04:39:56 +03:00
Ryan Dick
92b8477299
Fixup FLUX LoRA unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
50c9410121
WIP
2024-09-15 04:39:56 +03:00
Ryan Dick
01a15b4d80
WIP - add invocations to support FLUX LORAs.
2024-09-15 04:39:56 +03:00
Ryan Dick
db61ec4322
Get probing of FLUX LoRA kohya models working.
2024-09-15 04:39:56 +03:00
Ryan Dick
00e56863c2
Add utility function for detecting whether a state_dict is in the FLUX kohya LoRA format.
2024-09-15 04:39:56 +03:00
Ryan Dick
7b5befad0d
Update convert_flux_kohya_state_dict_to_invoke_format() to raise an exception if an unexpected key is encountered, and add a corresponding unit test.
2024-09-15 04:39:56 +03:00
Ryan Dick
04b37e64ea
Move the responsibilities of 1) state_dict loading from file, and 2) SDXL lora key conversions, out of LoRAModelRaw and into LoRALoader.
2024-09-15 04:39:56 +03:00
Ryan Dick
8518ae9ccb
Remove unused LoRAModelRaw.name attribute.
2024-09-15 04:39:56 +03:00
Ryan Dick
d0d91eaeec
Fix type errors in sdxl_lora_conversion_utils.py
2024-09-15 04:39:56 +03:00
Ryan Dick
fc380f077f
Start moving SDXL-specific LoRA conversions out of the general-purpose LoRAModelRaw class.
2024-09-15 04:39:56 +03:00
Ryan Dick
ade75b4748
Get convert_flux_kohya_state_dict_to_invoke_format(...) working, with unit tests.
2024-09-15 04:39:56 +03:00
Ryan Dick
c41bd59812
WIP - Initial logic for kohya FLUX LoRA conversion.
2024-09-15 04:39:56 +03:00
Ryan Dick
7a80d9ebe2
Add state_dict keys for two FLUX LoRA formats to be used in unit tests.
2024-09-15 04:39:56 +03:00
psychedelicious
28cba5b5c3
chore: v5.0.0.a6
2024-09-15 10:27:31 +10:00
psychedelicious
d50abd80a6
fix(ui): image quality degradation while saving images
...
The HTML Canvas context has an `imageSmoothingEnabled` property which defaults to `true`. This causes the browser canvas API to, well, apply image smoothing - everything gets antialiased when drawn.
This is, of course, problematic when our goal is to be pixel-perfect. When the same image is drawn multiple times, we get progressive image degradation.
In `CanvasEntityObjectRenderer.cloneObjectGroup()`, where we use Konva's `Node.cache()` method to create a canvas from the entity's objects. Here, we were not setting `imageSmoothingEnabled` to false. This method is used very often by the compositor and we end up feeding back antialiased versions of the image data back into the canvas or generation backend.
Disabling smoothing here appears to fix the issue. I've also disabled image smoothing everywhere else we interact with a canvas rendering context.
2024-09-15 10:18:43 +10:00
psychedelicious
ddfa32d101
feat(ui): middle-mouse click on image opens in new tab
...
Closes #6809
2024-09-15 10:18:43 +10:00
psychedelicious
be9c65b8a2
feat(ui): log $stageAttrs in CanvasStageModule.repr()
2024-09-15 10:18:43 +10:00
