Ryan Dick
1795f4f8a2
Fixup typing around DiffusersControlNetFluxOutput.
2024-10-09 14:17:42 +00:00
Ryan Dick
5bfd2ec6b7
Remove gradient checkpointing from DiffusersControlNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
a35b229a9d
Remove FluxMultiControlNetModel
2024-10-09 14:17:42 +00:00
Ryan Dick
e93da5d4b2
Remove LoRA stuff from DiffusersCotnrolNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
a17ea9bfad
Remove logic for modifying attn processors from DiffusersControlNetFlux.
2024-10-09 14:17:42 +00:00
Ryan Dick
3578010ba4
Rename FluxControlNetModel -> DiffusersControlNetFlux
2024-10-09 14:17:42 +00:00
Ryan Dick
459cf52043
Start updating imports for FluxControlNetModel
2024-10-09 14:17:42 +00:00
Ryan Dick
9bcb93f575
Copy model from 99f608218c/src/diffusers/models/controlnet_flux.py
2024-10-09 14:17:42 +00:00
Ryan Dick
d1a0e99701
Rename ControlNetFlux -> XLabsControlNetFlux
2024-10-09 14:17:42 +00:00
Ryan Dick
36515e1e2a
Add support for FLUX controlnet weight, begin_step_percent and end_step_percent.
2024-10-09 14:17:42 +00:00
Ryan Dick
c81bb761ed
First pass at integrating FLUX ControlNets into the FLUX Denoise invocation.
2024-10-09 14:17:42 +00:00
Ryan Dick
62d12e6468
Fix type errors and imporve docs for ControlNetFlux.
2024-10-09 14:17:41 +00:00
Ryan Dick
9541156ce5
Remove gradient checkpointing from ControlNetFlux.
2024-10-09 14:17:41 +00:00
Ryan Dick
eb5b6625ea
Remove ControlNetFlux logic related to attn processor overrides.
2024-10-09 14:17:41 +00:00
Ryan Dick
9758e5a622
Remove duplicate FluxParams class.
2024-10-09 14:17:41 +00:00
Ryan Dick
58eba8bdbd
Fix FLUX module imports for ControlNetFlux.
2024-10-09 14:17:41 +00:00
Ryan Dick
2821ba8967
Copy ControlNetFlux model from 47495425db/src/flux/controlnet.py.
2024-10-09 14:17:41 +00:00
Kent Keirsey
969f8b8e8d
ruff update
2024-10-08 08:56:26 -04:00
David Burnett
ccb5f90556
Get Flux working on MPS when torch 2.5.0 test or nightlies are installed.
2024-10-08 08:56:26 -04:00
Ryan Dick
bdeec54886
Remove FLUX TrajectoryGuidanceExtension and revert to the InpaintExtension. Keep the improved inpaint gradient mask adjustment behaviour.
2024-09-26 19:54:28 -04:00
Ryan Dick
8d50ecdfc3
Update docs explaining inpainting trajectory guidance.
2024-09-26 19:54:28 -04:00
Ryan Dick
ba07e255f5
Add support for fractional denoise start and end with FLUX.
2024-09-26 19:54:28 -04:00
Ryan Dick
fae96f3b9f
Remove trajectory_guidance_strength parameter.
2024-09-26 19:54:28 -04:00
psychedelicious
dc10197615
fix(app): step callbacks for SD, FLUX, MultiDiffusion
...
Each of these was a bit off:
- The SD callback started at `-1` and ended at `i`. Combined w/ the weird math on the previous `calc_percentage` util, this caused the progress bar to never finish.
- The MultiDiffusion callback had the same problems as SD.
- The FLUX callback didn't emit a pre-denoising step 0 image. It also reported total_steps as 1 higher than the actual step count.
Each of these now emit the expected events to the frontend:
- The initial latents at 0%
- Progress at each step, ending at 100%
2024-09-22 21:20:32 +03:00
Ryan Dick
a43a045b04
Fix preview image to work well with FLUX trajectory guidance.
2024-09-20 21:08:41 +00:00
Ryan Dick
cd3a7bdb5e
Assert that change_ratio is in the expected range in TrajectoryGuidanceExtension.
2024-09-20 20:34:49 +00:00
Ryan Dick
16ca540ece
Pre-compute trajectory guidance schedule params rather than calculating on each step.
2024-09-20 20:18:06 +00:00
Ryan Dick
2f82171dff
Tidy up the logic for inpainting mask adjustment in FLUX TrajectoryGuidanceExtension.
2024-09-20 14:48:06 +00:00
Ryan Dick
b6748fb1e1
Fix typo
2024-09-20 14:15:59 +00:00
Ryan Dick
f0aad5882d
Fixup docs in the TrajectoryGuidanceExtension.
2024-09-20 14:04:53 +00:00
Ryan Dick
e8357afd3a
Add traj_guidance_strength to FluxDenoiseInvocation.
2024-09-20 02:41:52 +00:00
Ryan Dick
93c15c9958
Rough draft of TrajectoryGuidanceExtension.
2024-09-20 02:21:47 +00:00
maryhipp
8916036ed3
fix progress image for FLUX inpainting
2024-09-17 06:41:32 +03:00
Brandon Rising
f3bb592544
Update latents used for preview images in flux
2024-09-03 14:04:16 -04:00
Brandon Rising
69f080fb75
Move flux step callback code into the step_callback util scripts, use other services within the invocation context
2024-09-03 14:04:16 -04:00
Brandon Rising
04272a7cc8
Initial attempt at preview images
2024-09-03 14:04:16 -04:00
Ryan Dick
2313f326df
Add denoise_end param to FluxDenoiseInvocation.
2024-09-02 09:38:17 -04:00
Ryan Dick
8292f6cd42
Code cleanup and documentation around FLUX inpainting.
2024-09-02 09:38:17 -04:00
Ryan Dick
9a8aca69bf
Get a rough version of FLUX inpainting working.
2024-09-02 09:38:17 -04:00
Ryan Dick
a7a33d73f5
Get FLUX non-masked image-to-image working - still rough.
2024-09-02 09:38:17 -04:00
Ryan Dick
e85c3bc465
Add FLUX VAE support to ImageToLatentsInvocation.
2024-09-02 09:38:17 -04:00
Ryan Dick
4e4b6c6dbc
Tidy variable management and dtype handling in FluxTextToImageInvocation.
2024-08-29 19:08:18 +00:00
Brandon Rising
54d54d1bf2
Run ruff
2024-08-26 20:17:50 -04:00
Brandon Rising
65bb46bcca
Rename params for flux and flux vae, add comments explaining use of the config_path in model config
2024-08-26 20:17:50 -04:00
Brandon Rising
2d185fb766
Run ruff
2024-08-26 20:17:50 -04:00
Brandon Rising
849da67cc7
Remove no longer used code in the flux denoise function
2024-08-26 20:17:50 -04:00
Ryan Dick
620f733110
ruff format
2024-08-26 20:17:50 -04:00
Brandon Rising
70c278c810
Remove dependency on flux config files
2024-08-26 20:17:50 -04:00
Brandon Rising
56b9906e2e
Setup scaffolding for in progress images and add ability to cancel the flux node
2024-08-26 20:17:50 -04:00
Ryan Dick
a808ce81fd
Replace swish() with torch.nn.functional.silu(h). They are functionally equivalent, but in my test VAE deconding was ~8% faster after the change.
2024-08-26 20:17:50 -04:00
