github/AutoGPT
1
1
Fork 0
mirror of https://github.com/Significant-Gravitas/AutoGPT.git synced 2026-04-08 03:00:28 -04:00
Code Issues Packages Projects Releases Wiki Activity

feat(copilot): set default rate limits based on observed usage data

Browse Source 
Session: 500K tokens (P90 session usage ~550K)
Weekly: 5M tokens (~10x heaviest observed weekly user)
This commit is contained in:
Zamil Majdy
2026-03-13 03:34:05 +07:00
parent 6f90729612
commit 3096f94996
1 changed files with 5 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
autogpt_platform/backend/backend/copilot/config.py
View File

@@ -70,13 +70,15 @@ class ChatConfig(BaseSettings):
description="Cache TTL in seconds for Langfuse prompt (0 to disable caching)",
)
# Rate limiting — token-based limits per session and per week
# Rate limiting — token-based limits per session and per week.
# Defaults based on observed CoPilot usage (P90 session ~550K tokens,
# heaviest weekly user ~600K tokens) with generous headroom.
session_token_limit: int = Field(
default=0,
default=500_000,
description="Max tokens per session (0 = unlimited)",
)
weekly_token_limit: int = Field(
default=0,
default=5_000_000,
description="Max tokens per week (0 = unlimited)",
)