Doc: Mention FORCE_REGENERATE var (#2833)

* Mention FORCE_REGENERATE var in doc

* Update tests/integration/README.md

---------

Co-authored-by: Boxuan Li <liboxuan@connect.hku.hk>
Co-authored-by: Yufan Song <33971064+yufansong@users.noreply.github.com>
This commit is contained in:
மனோஜ்குமார் பழனிச்சாமி
2024-07-11 09:31:15 +05:30
committed by GitHub
parent 456690818c
commit 1d4f422638
2 changed files with 11 additions and 1 deletions

View File

@@ -100,6 +100,16 @@ to cover the cost, ask one of the maintainers to regenerate for you. Before aski
please try running the script first *without* setting `LLM_API_KEY`.
Chance is, the test could be fixed after step 2.
## Regenerate Integration Tests without testing first
If you want to regenerate all prompts and/or responses without running the existing tests first, you can run:
```bash
FORCE_REGENERATE=true ./tests/integration/regenerate.sh
```
This will skip the first step and directly regenerate all tests when you know that the tests will fail due to changes in the prompt or the agent code itself and will save time.
## Regenerate a Specific Agent and/or Test
If you only want to run a specific test, set environment variable

View File

@@ -228,7 +228,7 @@ for ((i = 0; i < num_of_tests; i++)); do
fi
TEST_STATUS=1
if [ -z $SKIP_TEST ]; then
if [ -z $FORCE_REGENERATE ]; then
run_test
TEST_STATUS=$?
fi