Sergey Borisov
432e526999
Revert merge changes
2023-04-25 14:49:08 +03:00
Lincoln Stein
830740b93b
remove redundant/buggy restore_default_attention() method
2023-04-25 07:05:07 -04:00
Lincoln Stein
0f3c456d59
merge with v2.3
2023-04-24 22:51:48 -04:00
Damian Stewart
4d58444153
fix issues and further cleanup
2023-04-16 17:54:21 +02:00
Damian Stewart
3667eb4d0d
activate LoRAs when generating prompt embeddings; also cleanup attention stuff
2023-04-16 17:03:31 +02:00
StAlKeR7779
5a54039dd7
Fix imports for diffusers 0.15.0
...
Imports:
`diffusers.models.cross_attention -> diffusers.models.attention_processor`
Unions:
`AttnProcessor -> AttentionProcessor`
Classes:
| Old name | New name|
| --- | --- |
| CrossAttention | Attention |
| CrossAttnProcessor | AttnProcessor |
| XFormersCrossAttnProcessor | XFormersAttnProcessor |
| CrossAttnAddedKVProcessor | AttnAddedKVProcessor |
| LoRACrossAttnProcessor | LoRAAttnProcessor |
| LoRAXFormersCrossAttnProcessor | LoRAXFormersAttnProcessor |
Same names in this class:
`SlicedAttnProcessor, SlicedAttnAddedKVProcessor`
2023-04-12 22:54:25 +03:00
Damian Stewart
09fe21116b
Update shared_invokeai_diffusion.py
...
add line to docs
2023-04-06 11:01:00 +02:00
Lincoln Stein
afcb278e66
fix crash when no extra conditioning provided (redux)
2023-04-02 19:43:56 -04:00
Lincoln Stein
0a0e44b51e
fix crash when no extra conditioning provided
2023-04-02 17:13:08 -04:00
Lincoln Stein
e0bd30b98c
more elegant handling of lora context
2023-04-01 23:41:22 -04:00
Lincoln Stein
8fbe019273
Merge branch 'release/2.3.3-rc3' into feat/lora-support-2.3
2023-03-31 00:33:47 -04:00
Lincoln Stein
352805d607
fix for python 3.9
2023-03-31 00:33:10 -04:00
Lincoln Stein
ea5f6b9826
Merge branch 'release/2.3.3-rc3' into feat/lora-support-2.3
2023-03-30 22:02:37 -04:00
Lincoln Stein
4145e27ce6
move personalization fallback section into a static method
2023-03-30 21:53:19 -04:00
Lincoln Stein
3d4f4b677f
support external legacy config files with no personalization section
2023-03-30 21:39:05 -04:00
Damian Stewart
7dbe027b18
tweaks and small refactors
2023-02-24 12:46:57 +01:00
Jordan
4ce8b1ba21
setup cross conditioning for lora
2023-02-23 19:27:45 -07:00
Jordan
b69f9d4af1
initial setup of cross attention
2023-02-23 17:30:34 -07:00
Lincoln Stein
0a6d8b4855
Merge branch 'main' into refactor_use_compel
2023-02-21 17:19:48 -05:00
Damian Stewart
6420b81a5d
Merge remote-tracking branch 'upstream/main' into refactor_use_compel
2023-02-20 23:34:38 +01:00
Lincoln Stein
3fa1771cc9
Merge branch 'main' into perf/lowmem_sequential_guidance
2023-02-20 15:20:15 -05:00
Jonathan
b21bd6f428
Fix crash on calling diffusers' prepare_attention_mask
...
Diffusers' `prepare_attention_mask` was crashing when we didn't pass in a batch size.
2023-02-20 11:12:47 -06:00
Lincoln Stein
cfd897874b
Merge branch 'main' into perf/lowmem_sequential_guidance
2023-02-20 07:42:35 -05:00
Jonathan
ca8d9fb885
Add symmetry to generation ( #2675 )
...
Added symmetry to Invoke based on discussions with @damian0815. This can currently only be activated via the CLI with the `--h_symmetry_time_pct` and `--v_symmetry_time_pct` options. Those take values from 0.0-1.0, exclusive, indicating the percentage through generation at which symmetry is applied as a one-time operation. To have symmetry in either axis applied after the first step, use a very low value like 0.001.
2023-02-20 07:33:19 -05:00
Kevin Turner
2dded68267
add --sequential_guidance option for low-RAM tradeoff
2023-02-19 21:21:14 -08:00
Kevin Turner
6c8d4b091e
dev(InvokeAIDiffuserComponent): mollify type checker's concern about the optional argument
2023-02-19 16:58:54 -08:00
Kevin Turner
d0abe13b60
performance(InvokeAIDiffuserComponent): add low-memory path for calculating conditioned and unconditioned predictions sequentially
...
Proof of concept. Still needs to be wired up to options or heuristics.
2023-02-19 16:04:54 -08:00
Kevin Turner
aca9d74489
refactor(InvokeAIDiffuserComponent): rename internal methods
...
Prefix with `_` as is tradition.
2023-02-19 15:33:16 -08:00
Damian Stewart
ded3f13a33
move all prompting stuff to use compel
2023-02-19 20:42:29 +01:00
Jonathan
093174942b
Add thresholding for all diffusers types ( #2479 )
...
`generator` now asks `InvokeAIDiffuserComponent` to do postprocessing work on latents after every step. Thresholding - now implemented as replacing latents outside of the threshold with random noise - is called at this point. This postprocessing step is also where we can hook up symmetry and other image latent manipulations in the future.
Note: code at this layer doesn't need to worry about MPS as relevant torch functions are wrapped and made MPS-safe by `generator.py`.
2023-02-14 18:00:34 -06:00
Damian Stewart
d044d4c577
rename override/restore methods to better reflect what they actually do
2023-01-30 16:23:44 +01:00
Damian Stewart
17d73d09c0
Revert "with diffusers cac, always run the original prompt on the first step"
...
This reverts commit 27ee939e4b
2023-01-30 15:38:03 +01:00
Damian Stewart
c5c160a788
Merge branch 'diffusers_cross_attention_control_reimplementation' of github.com:damian0815/InvokeAI into diffusers_cross_attention_control_reimplementation
2023-01-30 14:51:06 +01:00
Damian Stewart
27ee939e4b
with diffusers cac, always run the original prompt on the first step
2023-01-30 14:50:57 +01:00
damian
c381788ab9
don't restore None
2023-01-26 17:44:27 +01:00
damian
fb312f9ed3
use the correct value - whoops
2023-01-26 17:30:29 +01:00
damian
729752620b
trying out JPPhoto's patch on vast.ai
2023-01-26 17:27:33 +01:00
Damian Stewart
5e7ed964d2
wip updating docs
2023-01-25 23:49:38 +01:00
Damian Stewart
95d147c5df
MPS support: negatory
2023-01-25 23:03:30 +01:00
Damian Stewart
41aed57449
wip tracking down MPS slicing support
2023-01-25 22:27:23 +01:00
Damian Stewart
34a3f4a820
cleanup
2023-01-25 21:47:17 +01:00
Damian Stewart
1f5ad1b05e
sliced swap working
2023-01-25 21:38:27 +01:00
Damian Stewart
a4aea1540b
more wip sliced attention (.swap doesn't work yet)
2023-01-25 14:51:08 +01:00
Damian Stewart
63c6019f92
sliced attention processor wip (untested)
2023-01-24 14:46:32 +01:00
Damian Stewart
c0610f7cb9
pass missing value
2023-01-22 18:19:06 +01:00
Damian Stewart
313b206ff8
squash float16/float32 mismatch on linux
2023-01-22 18:13:12 +01:00
Damian Stewart
bffe199ad7
SwapCrossAttnProcessor working - tested on mac CPU (MPS doesn't work)
2023-01-21 20:54:18 +01:00
Damian Stewart
0c2a511671
wip SwapCrossAttnProcessor
2023-01-21 18:07:36 +01:00
Lincoln Stein
ce1c5e70b8
fix autocast dependency in cross_attention_control
2023-01-16 23:18:43 -05:00
Damian Stewart
563196bd03
pass step count and step index to diffusion step func ( #2342 )
2023-01-16 19:56:54 +00:00
