fix: typo in the evaluation folder name. (#66)

This commit is contained in:
Binyuan Hui
2024-03-20 23:00:09 +08:00
committed by GitHub
parent a94f3d81cb
commit f99f4ebdaa
2 changed files with 0 additions and 0 deletions

15
evaluation/README.md Normal file
View File

@@ -0,0 +1,15 @@
# Evaluation
This folder contains code and resources to run experiments and evaluations.
## Logistics
To better organize the evaluation folder, we should follow the rules below:
- Each subfolder contains a specific benchmark or experiment. For example, `evaluation/SWE-bench` should contain
all the preprocessing/evaluation/analysis scripts.
- Raw data and experimental records should not be stored within this repo (e.g. Google Drive or Hugging Face Datasets).
- Important data files of manageable size and analysis scripts (e.g., jupyter notebooks) can be directly uploaded to this repo.
## Tasks
### SWE-bench
- analysis
- devin_eval_analysis.ipynb: notebook analyzing devin's outputs