Ryan Dick 85eb4f0312 Fix an edge case with model offloading from VRAM to RAM. If a GGML-quantized model is offloaded from VRAM inside of a torch.inference_mode() context manager, this will cause the following error: 'RuntimeError: Cannot set version_counter for inference tensor'.

2025-01-07 15:59:50 +00:00

..

app

Fix an edge case with model offloading from VRAM to RAM. If a GGML-quantized model is offloaded from VRAM inside of a torch.inference_mode() context manager, this will cause the following error: 'RuntimeError: Cannot set version_counter for inference tensor'.

2025-01-07 15:59:50 +00:00

assets

feat(api): chore: pydantic & fastapi upgrade

2023-10-17 14:59:25 +11:00

backend

Offload the current model when locking if it is already partially loaded and we have insufficient VRAM.

2025-01-07 02:53:44 +00:00

configs

Remove dependency on flux config files

2024-08-26 20:17:50 -04:00

frontend

translationBot(ui): update translation (Italian)

2025-01-07 19:32:50 +11:00

invocation_api

Added support for bounding boxes in the Invocation API

2024-08-26 08:03:30 +10:00

version

chore: bump version to v5.6.0rc1

2025-01-07 19:41:56 +11:00

__init__.py

…