Files
AutoGPT/classic/benchmark/reports/mini-agi/8.1_TestBasicMemory.json
Swifty ef7cfbb860 refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113)
Restructuring the Repo to make it clear the difference between classic autogpt and the autogpt platform:
* Move the "classic" projects `autogpt`, `forge`, `frontend`, and `benchmark` into a `classic` folder
  * Also rename `autogpt` to `original_autogpt` for absolute clarity
* Rename `rnd/` to `autogpt_platform/`
  * `rnd/autogpt_builder` -> `autogpt_platform/frontend`
  * `rnd/autogpt_server` -> `autogpt_platform/backend`
* Adjust any paths accordingly
2024-09-20 16:50:43 +02:00

31 lines
908 B
JSON

{
"command": "agbenchmark start --test TestBasicMemory",
"completion_time": "2023-07-17-18:22",
"metrics": {
"run_time": "53.48 seconds",
"highest_difficulty": "basic: 2"
},
"tests": {
"TestBasicMemory": {
"data_path": "agbenchmark/challenges/memory/m1",
"is_regression": false,
"task": "Follow the instructions in the instructions_1.txt file",
"answer": "2314",
"description": "Tests ability for the agent to remember information between each action. An id is presented initially and the agent has to remember it after reading 4 other files",
"metrics": {
"difficulty": "basic",
"success": true,
"success_%": 75.0,
"run_time": "53.252 seconds"
},
"reached_cutoff": false
}
},
"config": {
"workspace": "${os.path.join(Path.home(), 'miniagi')}"
},
"additional": {
"model": "gpt-4"
}
}