Xingyao Wang 391200510c fix: revert #5506 for SWE-Bench performance regression (#6491) ...

Co-authored-by: Robert Brennan <accounts@rbren.io>

2025-01-28 22:52:57 +08:00

..

agent_bench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

aider_bench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

biocoder

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

bird

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

browsing_delegation

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

commit0_bench

fix: incorrect soft-timeout implementation & fix hard-timeout follow-up command (#6280)

2025-01-17 01:27:00 +08:00

discoverybench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

EDA

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

gaia

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

gorilla

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

gpqa

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

humanevalfix

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

logic_reasoning

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

miniwob

Update MiniWoB README (#6385)

2025-01-21 16:26:47 +01:00

mint

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

ml_bench

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

scienceagentbench

refactor: Replace pexpect with libtmux in BashSession (#4881)

2025-01-04 05:22:13 +08:00

swe_bench

fix: revert #5506 for SWE-Bench performance regression (#6491)

2025-01-28 22:52:57 +08:00

the_agent_company

Pydantic-based configuration and setting objects (#6321)

2025-01-17 12:33:22 -07:00

toolqa

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00

visualwebarena

Support for VisualWebArena evaluation in OpenHands (#4773)

2025-01-23 20:18:30 +00:00

webarena

refactor(prompt): move runtime/repo info to user message and disable them in eval (#6291)

2025-01-16 17:53:10 +00:00