psychedelicious
61496fdcbc
fix(nodes): load IP Adapter images as RGB
...
FLUX IP Adapter only works with RGB. Did the same for non-FLUX to be safe & consistent, though I don't think it's strictly necessary.
2024-10-23 08:34:15 +10:00
Ryan Dick
5cbe89afdd
Merge branch 'main' into ryan/flux-ip-adapter-cfg-2
2024-10-22 21:17:36 +00:00
Ryan Dick
d20b894a61
Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.
2024-10-23 07:59:48 +11:00
Ryan Dick
20362448b9
Make negative_text_conditioning nullable on FLUX Denoise invocation.
2024-10-23 07:59:48 +11:00
Ryan Dick
5df10cc494
Add support for cfg_scale list on FLUX Denoise node.
2024-10-23 07:59:48 +11:00
Ryan Dick
da171114ea
Naive implementation of CFG for FLUX.
2024-10-23 07:59:48 +11:00
Mary Hipp
ffcec91d87
Merge branch 'ryan/flux-ip-adapter-cfg-2' of https://github.com/invoke-ai/InvokeAI into ryan/flux-ip-adapter-cfg-2
2024-10-22 15:23:35 -04:00
Mary Hipp
0a96466b60
feat(ui): add IP adapters to FLUX in linear UI
2024-10-22 15:22:56 -04:00
Ryan Dick
e48cab0276
Only allow a single image prompt for FLUX IP-Adapters (haven't really looked into this much, but punting on it for now).
2024-10-22 16:32:01 +00:00
psychedelicious
d1bb4c2c70
fix(nodes): FluxDenoiseInvocation.controlnet_vae missing default=None
2024-10-22 10:54:15 +11:00
Ryan Dick
e8cd1bb3d8
Add FLUX IP-Adapter starter models.
2024-10-21 22:17:42 +00:00
Ryan Dick
90a906e203
Simplify handling of CLIP ViT selection for FLUX IP-Adapter invocation.
2024-10-21 19:54:59 +00:00
Ryan Dick
5546110127
Add FluxIPAdapterInvocation.
2024-10-21 18:27:40 +00:00
Ryan Dick
73bbb12f7a
Use a black image as the negative IP prompt for parity with X-Labs implementation.
2024-10-21 15:47:22 +00:00
Ryan Dick
dde54740c5
Test out IP-Adapter with CFG.
2024-10-21 15:47:17 +00:00
Ryan Dick
f70a8e2c1a
A bunch of HACKS to get ViT-L CLIP vision encoder working for FLUX IP-Adapter. Need to revisit how to clean this all up long term.
2024-10-21 15:43:00 +00:00
Ryan Dick
31ffd73423
Initial draft of integrating FLUX IP-Adapter inference support.
2024-10-21 15:42:56 +00:00
Ryan Dick
32c7cdd856
Add cfg_scale_start_step and cfg_scale_end_step to FLUX Denoise node.
2024-10-21 14:52:02 +00:00
Ryan Dick
6df4ee5fc8
Make negative_text_conditioning nullable on FLUX Denoise invocation.
2024-10-18 20:31:27 +00:00
Ryan Dick
371742d8f9
Add support for cfg_scale list on FLUX Denoise node.
2024-10-18 20:14:47 +00:00
Ryan Dick
73d4c4d56d
Naive implementation of CFG for FLUX.
2024-10-16 16:22:35 +00:00
Ryan Dick
683f9a70e7
Restore instantx_control_mode field on FLUX ControlNet invocation.
2024-10-10 15:25:30 +00:00
Ryan Dick
4aace24f1f
Reduce peak memory utilization when preparing FLUX controlnet inputs.
2024-10-10 00:18:46 +00:00
Ryan Dick
b1567fe0e4
Make FLUX controlnet node API more like SD API and get it working with linear UI.
2024-10-09 23:38:31 +00:00
Ryan Dick
3953e60a4f
Remove instantx_control_mode from FLUX ControlNet node.
2024-10-09 22:00:54 +00:00
Ryan Dick
c78eeb1645
Shift the controlnet-type-specific logic into the specific ControlNet extensions and make the FLUX model controlnet-type-agnostic.
2024-10-09 16:12:09 +00:00
Ryan Dick
cd88723a80
Add instantx_control_mode param to FLUX ControlNet invocation.
2024-10-09 14:17:42 +00:00
Ryan Dick
dea6cbd599
Create a dedicated FLUX ControlNet invocation.
2024-10-09 14:17:42 +00:00
Ryan Dick
0dd9f1f772
Bugfixes to get InstantX ControlNet working.
2024-10-09 14:17:42 +00:00
Ryan Dick
2f8f30b497
Add instantx controlnet logic to FLUX model forward().
2024-10-09 14:17:42 +00:00
Ryan Dick
f878e5e74e
Work on integrating InstantX into denoise process.
2024-10-09 14:17:42 +00:00
Ryan Dick
a24581ede2
Create flux/extensions directory.
2024-10-09 14:17:42 +00:00
Ryan Dick
d1a0e99701
Rename ControlNetFlux -> XLabsControlNetFlux
2024-10-09 14:17:42 +00:00
Ryan Dick
c81bb761ed
First pass at integrating FLUX ControlNets into the FLUX Denoise invocation.
2024-10-09 14:17:42 +00:00
Brandon Rising
66bbd62758
Run ruff and fix typing in torch patcher
2024-10-02 18:33:05 -04:00
Brandon Rising
0875e861f5
Various updates to gguf performance
2024-10-02 18:33:05 -04:00
Ryan Dick
807f458f13
Move FLUX_LORA_TRANSFORMER_PREFIX and FLUX_LORA_CLIP_PREFIX to a shared location.
2024-10-01 10:22:11 -04:00
Ryan Dick
ba8ef6ff0f
(minor) remove remaining incorrect references to T5 encoder in comments.
2024-09-30 07:59:14 -04:00
Ryan Dick
c256826015
Whoops, the 'lora_te1' prefix in FLUX kohya models refers to the CLIP text encoder - not the T5 as previously assumed. Update everything accordingly.
2024-09-30 07:59:14 -04:00
Ryan Dick
7d38a9b7fb
Add prefix to distinguish FLUX LoRA submodels.
2024-09-30 07:59:14 -04:00
Ryan Dick
249da858df
Add support for FLUX T5 text encoder LoRA models to invocations.
2024-09-30 07:59:14 -04:00
Ryan Dick
bdeec54886
Remove FLUX TrajectoryGuidanceExtension and revert to the InpaintExtension. Keep the improved inpaint gradient mask adjustment behaviour.
2024-09-26 19:54:28 -04:00
Ryan Dick
ba07e255f5
Add support for fractional denoise start and end with FLUX.
2024-09-26 19:54:28 -04:00
Ryan Dick
fae96f3b9f
Remove trajectory_guidance_strength parameter.
2024-09-26 19:54:28 -04:00
psychedelicious
12e54eb249
feat(nodes): mark core metadata internal
2024-09-23 16:16:51 +03:00
psychedelicious
c0609f760f
feat(app): use new signal_progress API for spandrel nodes
...
Both the vanilla and autoscale invocations report progress while processing each tile.
The autoscale version, which may run the spandrel model multiple times, also includes the current iteration.
2024-09-22 21:20:32 +03:00
Ryan Dick
183a67cb1e
Merge branch 'main' into ryan/flux-trajectory-guidance
2024-09-20 22:29:34 +00:00
maryhipp
e50f71ec53
bump version of flux_denoise node, update default workflows
2024-09-20 15:41:44 -04:00
psychedelicious
6540381fb5
feat(nodes): clean up canvas v2's output node
...
- Marked internal
- Changed output type to plain ol' `ImageOutput`
- Removed unused code
2024-09-20 16:01:02 +03:00
psychedelicious
2d617f6067
feat(nodes): add Classification.Internal
...
This can be used for nodes that Invoke uses internally. Internal nodes do not have API stability guarantees. For example, they may change if the needs of the linear UI change.
2024-09-20 16:01:02 +03:00
