Umut
7f1222ed37
feat(benchmarks): add a way to check benchmark scripts without running them
2021-10-21 16:03:47 +03:00
Benoit Chevallier-Mames
806d6584e8
feat: let us choose file to benchmark
...
if needed, eg during development of new benchmarks, we can chose the files to benchmark with calls like:
- poetry run python script/progress_tracker_utils/measure.py benchmarks -f benchmarks/x_matmul_y.py benchmarks/x_plus_y.py
- poetry run python script/progress_tracker_utils/measure.py benchmarks -f benchmarks/x_matmul_y.py
and the classical
- poetry run python script/progress_tracker_utils/measure.py benchmarks
is still usable
2021-10-20 16:18:32 +02:00
Umut
67f50fb8ce
refactor(benchmarks): use 'bench' header prefix for all benchmark directives
2021-10-14 17:38:01 +03:00
Umut
47f03e427f
feat(benchmarks): add support for full and unit targets
2021-10-12 17:47:27 +03:00
Umut
4205e096f4
feat(benchmark): integrate alert system into measurement script
2021-10-12 12:52:49 +03:00
Umut
2cfb32d2c1
feat(benchmarks): add source code information to benchmarks
2021-10-11 10:07:51 +03:00
Umut
f443b41cef
docs(benchmarks): explain the module trick used in the measurement script with comments
2021-10-08 14:23:54 +03:00
Umut
57b3be2f6d
fix(benchmarks): treat warnings as errors in benchmarks
2021-10-07 18:40:33 +03:00
Umut
7e3b0251fc
fix(script): use shutil.rmtree instead of os.unlink to remove measurement scripts folder
2021-10-05 12:14:12 +03:00
Umut
2515e9bf8a
feat(script): replace '&' with 'and' within benchmark target names
2021-10-05 12:14:12 +03:00
Umut
4ef0a13248
refactor: move measurement scripts to their own directory to avoid pcc errors
2021-09-29 11:51:22 +03:00
Umut
3408bba1ed
fix: properly ignore measurement scripts during benchmarks
2021-09-27 17:59:48 +03:00
Umut
a7d0b87408
fix: revert check argument of subprocess.run as the return code is already checked below
2021-09-17 10:39:17 +03:00
Benoit Chevallier-Mames
af41980f1f
fix: pylint
...
fix: pylint
2021-09-16 12:04:32 +02:00
Benoit Chevallier-Mames
fe03521dc6
fix: python_format
2021-09-16 12:04:32 +02:00
Benoit Chevallier-Mames
ef9200793d
fix: flake8 for script
2021-09-16 12:04:32 +02:00
Umut
c253219277
feat: implement performing and publishing benchmarks with a single make target
2021-09-15 10:08:08 +03:00
Umut
d02e848fca
refactor: update benchmark infrastructure to be compatible with the new progress tracker
2021-09-08 12:31:32 +03:00