Ryan Dick 75d8ac378c Update the T5 8-bit quantized starter model to use the BnB LLM.int8() variant.

2024-08-26 20:17:50 -04:00

..

model_cache

don't use cpu state_dict for model unpatching when executing on cpu (#6631)

2024-07-18 15:34:01 -04:00

model_loaders

Update the T5 8-bit quantized starter model to use the BnB LLM.int8() variant.

2024-08-26 20:17:50 -04:00

__init__.py

Apply ruff rule to disallow all relative imports.

2024-07-04 09:35:37 -04:00

load_base.py

Load single-file checkpoints directly without conversion (#6510)

2024-06-27 17:31:28 -04:00

load_default.py

Load single-file checkpoints directly without conversion (#6510)

2024-06-27 17:31:28 -04:00

memory_snapshot.py

Add ruff rule to disallow relative parent imports.

2024-07-04 09:35:37 -04:00

model_loader_registry.py

Apply ruff rule to disallow all relative imports.

2024-07-04 09:35:37 -04:00

model_util.py

Add comment about incorrect T5 Tokenizer size calculation.

2024-08-26 20:17:50 -04:00

optimizations.py

final tidying before marking PR as ready for review

2024-03-01 10:42:33 +11:00