Ryan Dick fc4a22fe78 Allow expensive operations to request more working memory.

2025-01-07 01:20:13 +00:00

..

cached_model

Improve handling of cases when application code modifies the size of a model after registering it with the model cache.

2025-01-07 00:31:00 +00:00

torch_module_autocast

Fix bug in CustomConv1d and CustomConv2d patch calculations.

2024-12-29 19:10:19 +00:00

__init__.py

Remove ModelCacheBase.

2024-12-24 14:23:18 +00:00

cache_record.py

First pass at adding partial loading support to the ModelCache.

2025-01-07 00:30:58 +00:00

cache_stats.py

Move CacheStats to its own file.

2024-12-24 14:23:18 +00:00

model_cache.py

Allow expensive operations to request more working memory.

2025-01-07 01:20:13 +00:00

utils.py

Add get_effective_device(...) utility to aid in determining the effective device of models that are partially loaded.

2025-01-07 00:31:00 +00:00