Commit Graph

31 Commits

Author SHA1 Message Date
Arthur Meyre
21eb2ac739 chore: fix benchmarks script 2021-12-13 16:34:58 +01:00
Arthur Meyre
faa6dd4403 chore: fix missed changes for docker update 2021-11-30 18:50:16 +01:00
Umut
efde01258c fix(benchmarks): resolve simple errors in some of the benchmarks 2021-11-18 18:41:34 +03:00
Umut
d244bcace9 test(scripts): create measurement script tests 2021-11-15 12:45:55 +03:00
Umut
8e8e777c3d chore(scripts): replace : with colon in measurement script 2021-11-04 17:49:24 +03:00
Umut
7f32cf7965 fix(scripts): properly detect duplicate targets in check mode 2021-11-04 16:13:26 +03:00
Benoit Chevallier-Mames
f1d28c0fad chore(benchmarks): manage comma and point signs 2021-10-21 16:27:25 +02:00
Umut
7f1222ed37 feat(benchmarks): add a way to check benchmark scripts without running them 2021-10-21 16:03:47 +03:00
Benoit Chevallier-Mames
806d6584e8 feat: let us choose file to benchmark
if needed, eg during development of new benchmarks, we can chose the files to benchmark with calls like:
- poetry run python script/progress_tracker_utils/measure.py benchmarks -f benchmarks/x_matmul_y.py benchmarks/x_plus_y.py
- poetry run python script/progress_tracker_utils/measure.py benchmarks -f benchmarks/x_matmul_y.py

and the classical

- poetry run python script/progress_tracker_utils/measure.py benchmarks

is still usable
2021-10-20 16:18:32 +02:00
Umut
67f50fb8ce refactor(benchmarks): use 'bench' header prefix for all benchmark directives 2021-10-14 17:38:01 +03:00
Umut
47f03e427f feat(benchmarks): add support for full and unit targets 2021-10-12 17:47:27 +03:00
Umut
4205e096f4 feat(benchmark): integrate alert system into measurement script 2021-10-12 12:52:49 +03:00
Umut
2cfb32d2c1 feat(benchmarks): add source code information to benchmarks 2021-10-11 10:07:51 +03:00
Umut
a7f00ec111 fix(benchmarks): replace properties field of the machine information to specs 2021-10-11 10:07:51 +03:00
Umut
f443b41cef docs(benchmarks): explain the module trick used in the measurement script with comments 2021-10-08 14:23:54 +03:00
Umut
57b3be2f6d fix(benchmarks): treat warnings as errors in benchmarks 2021-10-07 18:40:33 +03:00
Arthur Meyre
05e1227269 chore: update env docker to have runtime lib path in LD_PRELOAD
- update the rest of the dockers, script and CI to stop setting LD_PRELOAD
2021-10-07 09:58:23 +02:00
Umut
7e3b0251fc fix(script): use shutil.rmtree instead of os.unlink to remove measurement scripts folder 2021-10-05 12:14:12 +03:00
Umut
2515e9bf8a feat(script): replace '&' with 'and' within benchmark target names 2021-10-05 12:14:12 +03:00
Umut
4ef0a13248 refactor: move measurement scripts to their own directory to avoid pcc errors 2021-09-29 11:51:22 +03:00
Umut
ad95aba053 chore: run extract_machine_info.py before running the benchmark target, fix missing MACHINE_NAME variable exception 2021-09-27 17:59:48 +03:00
Umut
3408bba1ed fix: properly ignore measurement scripts during benchmarks 2021-09-27 17:59:48 +03:00
Arthur Meyre
468f8aba62 fix: correct a mistake done when fixing shellcheck lints
- we must not exit right away if sourcing fails
- recreate the venv only if the source fails
2021-09-22 10:04:40 +02:00
Arthur Meyre
1a340e111e tools: add shell_lint target to lint .sh files
- update docker image to install shellcheck
- fix lint errors in files
2021-09-21 11:16:14 +02:00
Umut
a7d0b87408 fix: revert check argument of subprocess.run as the return code is already checked below 2021-09-17 10:39:17 +03:00
Benoit Chevallier-Mames
af41980f1f fix: pylint
fix: pylint
2021-09-16 12:04:32 +02:00
Benoit Chevallier-Mames
fe03521dc6 fix: python_format 2021-09-16 12:04:32 +02:00
Benoit Chevallier-Mames
ef9200793d fix: flake8 for script 2021-09-16 12:04:32 +02:00
Umut
ae3c179294 chore: disable attaching tty to docker during benchmarks 2021-09-15 12:50:08 +03:00
Umut
c253219277 feat: implement performing and publishing benchmarks with a single make target 2021-09-15 10:08:08 +03:00
Umut
d02e848fca refactor: update benchmark infrastructure to be compatible with the new progress tracker 2021-09-08 12:31:32 +03:00