Files
AutoGPT/benchmark/agbenchmark/challenges/abilities/read_file/data.json
merwanehamadi ff4c76ba00 Make agbenchmark a proxy of the evaluated agent (#5279)
Make agbenchmark a Proxy of the evaluated agent

Signed-off-by: Merwane Hamadi <merwanehamadi@gmail.com>
2023-09-20 16:06:00 -07:00

32 lines
748 B
JSON

{
"name": "ReadFile",
"category": [
"interface"
],
"eval_id": "261ccfaa-02a2-4c1a-8a56-c76c66f7dba1",
"task": "Read the file called file_to_read.txt and write its content to a file called output.txt",
"dependencies": [
"WriteFile"
],
"cutoff": 60,
"ground": {
"answer": "The content of output.txt should be 'Hello World!'",
"should_contain": [
"Hello World!"
],
"files": [
"output.txt"
],
"eval": {
"type": "file"
}
},
"info": {
"description": "tests the ability for an agent to read a file.",
"difficulty": "interface",
"side_effects": [
""
]
}
}