mirror of
https://github.com/powdr-labs/powdr.git
synced 2026-01-09 19:17:57 -05:00
d1b50d1c87
Changes: - For Keccak and Matmul, we only ran the benchmark with 0 and 100 APCs. I changed it to run with 0, 3, 10, 30. I think more does not make sense, because the effectiveness plots ([matmul](https://github.com/powdr-labs/bench-results/blob/gh-pages/results/2025-09-15-0630/matmul/100apc/effectiveness.png), [keccak](https://github.com/powdr-labs/bench-results/blob/gh-pages/results/2025-09-15-0630/keccak/100apc/effectiveness.png)) do not suggest that there are more basic blocks worth accelerating. - For reth, I also added more steps. - Named experiments more consistently (`apc000`, `apc003`, ...) - Added existing benchmarks for SHA, Pairing, and U256 - Increased the size of the U256 benchmark to get more meaningful results Manual nightly run: https://github.com/powdr-labs/powdr/actions/runs/17772555964 Which leads to the following bench results: https://github.com/powdr-labs/bench-results/tree/gh-pages/results/2025-09-16-2213 Note that the `test_apc` job duration goes from from 2:48h -> 4:34h.
Scripts
Set up (from the project root):
python3 -m venv .venv
source .venv/bin/activate
pip install -r openvm/scripts/requirements.txt