Ryan Dick da589b3f1f Memory optimization to load state dicts one module at a time in CachedModelWithPartialLoad when we are not storing a CPU copy of the state dict (i.e. when keep_ram_copy_of_weights=False).

2025-01-16 17:00:33 +00:00

..

cached_model_only_full_load.py

Add keep_ram_copy option to CachedModelOnlyFullLoad.

2025-01-16 15:08:23 +00:00

cached_model_with_partial_load.py

Memory optimization to load state dicts one module at a time in CachedModelWithPartialLoad when we are not storing a CPU copy of the state dict (i.e. when keep_ram_copy_of_weights=False).

2025-01-16 17:00:33 +00:00