Lincoln Stein b9493ddce7 Workaround for Windows being unable to remove tmp directories when installing GGUF files (#8699) ...

* (bugfix)(mm) work around Windows being unable to rmtree tmp directories after GGUF install

* (style) fix ruff error

* (fix) add workaround for Windows Permission Denied on GGUF file move() call

* (fix) perform torch copy() in GGUF reader to avoid deletion failures on Windows

* (style) fix ruff formatting issues

2025-12-26 02:02:39 +00:00

..

gguf

Workaround for Windows being unable to remove tmp directories when installing GGUF files (#8699)

2025-12-26 02:02:39 +00:00

scripts

refactor: model manager v3 (#8607)

2025-10-15 10:18:53 +11:00

__init__.py

Move requantize.py to the quatnization/ dir.

2024-08-26 20:17:50 -04:00

bnb_llm_int8.py

Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.

2024-12-24 14:32:11 +00:00

bnb_nf4.py

Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae

2024-08-26 20:17:50 -04:00