Engel Nyst 5b7fcfbe1a Disable prompt extensions in SWE-bench (#6391)

2025-01-21 17:18:30 +00:00

..

agent_bench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

aider_bench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

biocoder

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

bird

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

browsing_delegation

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

commit0_bench

fix: incorrect soft-timeout implementation & fix hard-timeout follow-up command (#6280)

2025-01-17 01:27:00 +08:00

discoverybench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

EDA

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

gaia

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

gorilla

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

gpqa

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

humanevalfix

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

logic_reasoning

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

miniwob

Update MiniWoB README (#6385)

2025-01-21 16:26:47 +01:00

mint

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

ml_bench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

scienceagentbench

refactor: Replace pexpect with libtmux in BashSession (#4881)

2025-01-04 05:22:13 +08:00

swe_bench

Disable prompt extensions in SWE-bench (#6391)

2025-01-21 17:18:30 +00:00

the_agent_company

Pydantic-based configuration and setting objects (#6321)

2025-01-17 12:33:22 -07:00

toolqa

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

webarena

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00