InvokeAI/invokeai/backend/quantization/bnb_llm_int8.py at ce286363d0e1639b97dbd76ec00cf00c85bb2e4e - InvokeAI - AtHeartEngineering

github/InvokeAI

mirror of https://github.com/invoke-ai/InvokeAI.git synced 2026-02-06 19:45:02 -05:00

Files

Ryan Dick 3f990393a1 Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.

2024-12-24 14:32:11 +00:00

6.9 KiB

Raw Blame History

View Raw