6 Commits

Author	SHA1	Message	Date
hugehope	9cd4ad3298	chore: fix some typos in comments (#1013) ... Signed-off-by: hugehope <cmm7@sina.cn>	2024-04-11 23:21:46 +02:00
libowen2121	e256329e5e	Update SWE-bench eval results (#978)	2024-04-10 21:09:49 +08:00
libowen2121	40a3614e80	Add a roadmap for eval (#92)	2024-03-22 20:27:30 +08:00
Xingyao Wang	5ff96111f0	A starting point for SWE-Bench Evaluation with docker (#60) ... * a starting point for SWE-Bench evaluation with docker * fix the swe-bench uid issue * typo fixed * fix conda missing issue * move files based on new PR * Update doc and gitignore using devin prediction file from #81 * fix typo * add a sentence * fix typo in path * fix path --------- Co-authored-by: Binyuan Hui <binyuan.hby@alibaba-inc.com>	2024-03-22 12:43:49 +08:00
Jiaxin Pei	dc88dac296	adding a script to fetch and convert devin's output for evaluation (#81) ... * adding code to fetch and convert devin's output for evaluation * update README.md * update code for fetching and processing devin's outputs * update code for fetching and processing devin's outputs	2024-03-22 01:33:01 +08:00
Binyuan Hui	f99f4ebdaa	fix: typo in the evaluation folder name. (#66)	2024-03-20 23:00:09 +08:00