Files
tinygrad/test/external/process_replay
qazal 3e49d86c01 process replay diffs 3 things now (#5731)
* github api infra

* process replay is 3 parts now

* parse benchmarks

* add gh_token

* complete diff

* move process replay tests

* last successful run

* add tempdir

* skip master
2024-07-27 12:52:20 +03:00
..

Process replay tests

Process replay is a tool for creating a diff of generated kernels between two commits. By default, process replay doesn't assert kernel diffs.

Refactor and speedup prs must enable the assert by including [run_process_replay] in the pr title.

Note that process replay early stops when over 20% of kernels change, for speed..

Running locally

To run process replay locally:

(optional: clear previous process replay runs with test/external/process_replay/reset.py)

  1. Run tests with RUN_PROCESS_REPLAY=1 in your branch. This will capture the kernels.
  2. Checkout master
  3. Run test/external/process_replay/process_replay.py