Ryan Dick 29fe1533f2 Fix bug in InvokeLinear8bitLt that was causing old state information to persist after loading from a state dict. This manifested as state tensors being left on the GPU even when a model had been offloaded to the CPU cache.

2024-08-29 19:08:18 +00:00

5.8 KiB

Raw Blame History

View Raw