Files
tinygrad/test/external/process_replay
qazal 5e827e51d2 add llama3 BEAM=2 failures to test_linearizer_failures (#5553)
* skips

* opts.device

* benchmarks

* add to test_linearizer_failures

* remove hardcoded ones

* linter

* skip cpu
2024-07-30 00:37:32 +03:00
..

Process replay tests

Process replay is a tool for creating a diff of generated kernels between two commits. By default, process replay doesn't assert kernel diffs.

Refactor and speedup prs must enable the assert by including [run_process_replay] in the pr title.

Note that process replay early stops when over 20% of kernels change, for speed..

Running locally

To run process replay locally:

(optional: clear previous process replay runs with test/external/process_replay/reset.py)

  1. Run tests with RUN_PROCESS_REPLAY=1 in your branch. This will capture the kernels.
  2. Checkout master
  3. Run test/external/process_replay/process_replay.py