chore: temporary fix to get sonnet 3.7 working again (#7140)

This commit is contained in:
Xingyao Wang
2025-03-06 15:30:35 -05:00
committed by GitHub
parent 22064d5555
commit b146b63380

View File

@@ -418,6 +418,8 @@ class LLM(RetryMixin, DebugMixin):
self.model_info['max_tokens'], int
):
self.config.max_output_tokens = self.model_info['max_tokens']
if 'claude-3-7-sonnet' in self.config.model:
self.config.max_output_tokens = 64000 # litellm set max to 128k, but that requires a header to be set
# Initialize function calling capability
# Check if model name is in our supported list