David Testé
03fb3ca49b
chore(ci): move format and linting jobs to their own workflow
...
This is done to declutter the main workflow continuous-integration.yml.
2023-01-12 10:52:00 +01:00
David Testé
94df9ee21d
chore(ci): remove legacy linux build and test job
2023-01-11 17:39:05 +01:00
Quentin Bourgerie
ca83b129b9
chore(ci): fix gpu build on aws using docker
2023-01-11 17:39:05 +01:00
David Testé
be2a377aaf
chore(ci): automaticaly trigger aws build on commit push in pr
2023-01-11 17:39:05 +01:00
David Testé
ea5000aecb
chore(ci) fix build on aws ec2
...
Use the right make rule target for testing the GPU and CPU.
2023-01-11 17:39:05 +01:00
rudy
5797d73683
fix(ci): docker build, use --ssh instead of -v
2023-01-06 17:00:17 +01:00
rudy
7bcb3377fa
fix(ci): docker build, no ssh forward for hpx and cuda
2023-01-06 17:00:17 +01:00
rudy
3c8c1819a8
fix(ci): rebuild docker image when workflow file is updated
2023-01-06 17:00:17 +01:00
Mayeul de Bellabre
78cbebbf31
chore(CI): add CI benchmarks
2023-01-04 16:35:54 +01:00
dependabot[bot]
01ef6ce206
chore(deps): bump appleboy/ssh-action from 0.1.5 to 0.1.6
...
Bumps [appleboy/ssh-action](https://github.com/appleboy/ssh-action ) from 0.1.5 to 0.1.6.
- [Release notes](https://github.com/appleboy/ssh-action/releases )
- [Commits](f9010ff7f1...4a03da89e5 )
---
updated-dependencies:
- dependency-name: appleboy/ssh-action
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-01-04 13:11:26 +01:00
dependabot[bot]
143795244d
chore(deps): bump actions/checkout from 3.1.0 to 3.2.0
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](93ea575cb5...755da8c3cf )
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-01-04 13:11:16 +01:00
dependabot[bot]
29a2fd63d2
chore(deps): bump softprops/action-gh-release from 0.1.14 to 0.1.15
...
Bumps [softprops/action-gh-release](https://github.com/softprops/action-gh-release ) from 0.1.14 to 0.1.15.
- [Release notes](https://github.com/softprops/action-gh-release/releases )
- [Changelog](https://github.com/softprops/action-gh-release/blob/master/CHANGELOG.md )
- [Commits](1e07f43987...de2c0eb89a )
---
updated-dependencies:
- dependency-name: softprops/action-gh-release
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-01-04 13:11:05 +01:00
dependabot[bot]
e8bcbe7c3d
chore(deps): bump actions/setup-python from 4.3.0 to 4.4.0
...
Bumps [actions/setup-python](https://github.com/actions/setup-python ) from 4.3.0 to 4.4.0.
- [Release notes](https://github.com/actions/setup-python/releases )
- [Commits](13ae5bb136...5ccb29d877 )
---
updated-dependencies:
- dependency-name: actions/setup-python
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-01-04 13:10:55 +01:00
dependabot[bot]
ec2517ffeb
chore(deps): bump gsactions/commit-message-checker from 1.0.1 to 2.0.0
...
Bumps [gsactions/commit-message-checker](https://github.com/gsactions/commit-message-checker ) from 1.0.1 to 2.0.0.
- [Release notes](https://github.com/gsactions/commit-message-checker/releases )
- [Commits](b88ee88552...16fa2d5de0 )
---
updated-dependencies:
- dependency-name: gsactions/commit-message-checker
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-01-04 13:10:42 +01:00
Umut
2bd449518c
chore: disable codeblock and notebook tests for the time being
...
These tests take huge amount of time in the CI, we should find a way to utilize key cache in them. Until then, they should be disabled.
2023-01-04 13:10:18 +01:00
rudy
04ea0ab148
fix: ci, build optimizer in docker
2022-12-22 20:08:07 +01:00
rudy
36dc249712
fix: disabling keysetcache until test on aws
2022-12-15 12:40:43 +01:00
rudy
8641b52782
fix: keysetcache name typo
2022-12-14 12:14:53 +01:00
rudy
b742ac35ae
fix(ci): force crt for 9, 10, 11 for table lookup
2022-12-13 13:21:30 +01:00
Quentin Bourgerie
37c2627feb
chore(ci): Regenerate the keyset cache
2022-12-12 10:38:44 +01:00
Quentin Bourgerie
b08ccbbfb5
fix(ci): Select cpu by default for benchmark on main
2022-12-09 13:23:00 +01:00
Quentin Bourgerie
07aa334d8d
chore(benchmarks): Refactor the benchmark tools
2022-12-09 09:51:23 +01:00
youben11
ff4a0076a1
ci: fix release tarball process
...
add install target in Makefile to copy necessary libs, bins, and
includes to an installation directory. Use this install target to
package deps into a tarball with new installation instructions.
2022-12-08 07:45:55 +01:00
Quentin Bourgerie
71b24b1255
chore(ci/bench): Generate gpu benchmarks
2022-12-07 21:32:01 +01:00
David Testé
2c48bdd9fe
test(benchmark): execute on-demand benchmarks with gpu backend
...
When this type of benchmarks is triggered, only the tests that
benefits from GPU acceleration are run on a specific AWS EC2
instance. Note that this instance (p3.2xlarge) is not a bare metal
one, so performance may variate due to hypervisor controlling the
machine.
2022-12-07 21:32:01 +01:00
tmontaigu
188642b153
chore(ci): add rustfmt check
2022-12-07 13:55:02 +01:00
David Testé
17479097b4
chore(ci): build compiler from pull request comment with slab
...
Now compiler builds on AWS can be requested in Pull Request comment
using '@slab-ci <build_command>'. This sets up environment to able
to trigger both CPU and GPU builds on AWS EC2.
2022-12-06 14:35:17 +01:00
youben11
788c4c863d
ci: provide cuda tools in test docker image
...
build cuda image and copy cuda tools in test image to reduce its final
size
2022-12-06 11:29:11 +01:00
Quentin Bourgerie
ccb83cc9be
chore(ci): Fix benchmark generation in CI
2022-12-06 09:30:50 +01:00
dependabot[bot]
ad9c3beee7
chore(deps): bump marocchino/sticky-pull-request-comment
...
Bumps [marocchino/sticky-pull-request-comment](https://github.com/marocchino/sticky-pull-request-comment ) from 2.3.0 to 2.3.1.
- [Release notes](https://github.com/marocchino/sticky-pull-request-comment/releases )
- [Commits](adca94abca...fcf6fe9e4a )
---
updated-dependencies:
- dependency-name: marocchino/sticky-pull-request-comment
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2022-12-05 10:16:57 +01:00
Quentin Bourgerie
8a557368f1
chore(ci): Stay on ubuntu 20.4 for github runners to fix the release process
2022-12-01 23:18:34 +01:00
Quentin Bourgerie
b171bc3c48
chore(ci): Specify the python executable for running tests
2022-11-30 14:41:40 +01:00
Luis Montero
30be8cf4ae
fix: fix MacOS test launching
...
* Update makefile to use appropriate arguments to find executables on
macos systems.
* Add `set -e` to make sure that the tests crash if something goes wrong
in the build or test of the macos job of the CI.
closes #783
2022-11-25 09:48:45 +01:00
David Testé
1e8c0df381
chore(ci): change benchmark parser input name
...
The use of "schema" was incorrect since it's meant to be used as
database name when sending data to Slab.
2022-11-23 16:22:17 +01:00
youben11
2877281aa6
chore(ci): re-enable rust tests in the CI
...
they were mostly removed by a rebase
2022-11-23 14:01:25 +01:00
rudy
454edbb538
fix(ci): KeySetCache pruning was broken
2022-11-22 17:28:40 +01:00
David Testé
3c2a75186f
chore(ci): run ml benchmarks in a matrix with slab
...
This CI "feature" is meant to circumvent the 6 hours hard-limit
for a job in GitHub Action.
The benchmark is done using a matrix which is handled by Slab.
Here's the workflow:
1. ML benchmarks are started in a fire and forget fashion via
start_ml_benchmarks.yml
2. Slab will read ci/slab.toml to get the AWS EC2 configuration
and the matrix parameters
3. Slab will launch at most max_parallel_jobs EC2 instances in
parallel
4. Each job will trigger ml_benchmark_subset.yml which will run
only one of the generated YAML file via make generate-mlbench,
based on the value of the matrix item they were given.
5. As soon as a job is completed, the next one in the matrix
will start promptly.
This is done until all the matrix items are exhausted.
2022-11-21 11:25:40 +01:00
Mayeul@Zama
fa3556e8cc
feat(CI): add cmake-format CI job
2022-11-18 15:15:41 +01:00
David Testé
77729514e0
chore(ci): parse benchmark results to send to postgres instance
...
Previousely, we were sending parsed benchmark results to a
Prometheus instance. Do to its time-series nature, Prometheus would
downsample database content to avoid having to much data points
for a given range of time. While this behavior is good for a
continuous stream of data, like monitoring CPU load, it's not suited
for benchmarks. Indeed benchmarks are discrete events that would
occurr once in a while (i.e once a day). Downsampling would, at
some point, simply omit some of benchmarks results.
Using a regular SQL database like PostgreSQL solves this issue.
2022-11-15 16:18:25 +01:00
dependabot[bot]
31d5915cee
chore(deps): bump machulav/ec2-github-runner from 2.3.2 to 2.3.3
...
Bumps [machulav/ec2-github-runner](https://github.com/machulav/ec2-github-runner ) from 2.3.2 to 2.3.3.
- [Release notes](https://github.com/machulav/ec2-github-runner/releases )
- [Commits](c34ba2df33...4e0303de21 )
---
updated-dependencies:
- dependency-name: machulav/ec2-github-runner
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2022-11-15 11:49:52 +01:00
rudy
1abea50ff8
chore(ci): only cancel continuous-integration.yml on PR update
2022-11-14 11:09:03 +01:00
rudy
5db1b7a27c
chore(benchmark): compile then download
2022-11-14 11:06:47 +01:00
rudy
5b92ed151c
chore(ci): build before download test cache
2022-11-09 16:14:29 +01:00
rudy
819c9e71ca
fix(ci): diff for cpp API change
2022-11-08 11:28:51 +01:00
David Testé
d1db4a5e45
tests(benchmarks): reduce number of test cases to speed-up execution
...
Bench just one compilation option for automatic benchmarks. Only 'loop'
option is tested to take advantage of hardware with a lot of available
CPUs. Running benchmarks with 'default' option is suboptimal for this
kind of hardware since it uses only one CPU.
This also remove time consuming MNIST test, as it should be in ML benchmarks.
Moreover Makefile is fixed to use provided Python executable instead of
relying on system one to generate MLIR Yaml files.
2022-11-03 19:07:39 +01:00
youben11
078a82c1a4
fix(ci): use specific python binary
...
setup-python seems to choose a binary that lead to issues while trying
to install the wheeled package
2022-11-03 13:29:11 +01:00
dependabot[bot]
88fb2ee134
chore(deps): bump marocchino/sticky-pull-request-comment
...
Bumps [marocchino/sticky-pull-request-comment](https://github.com/marocchino/sticky-pull-request-comment ) from 2.2.1 to 2.3.0.
- [Release notes](https://github.com/marocchino/sticky-pull-request-comment/releases )
- [Commits](97bddef64d...adca94abca )
---
updated-dependencies:
- dependency-name: marocchino/sticky-pull-request-comment
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2022-11-03 12:11:54 +01:00
youben11
e3e1602fe8
fix(ci): set python to 3.10 in macos test runner
...
default is now 3.11 which we don't support yet, mainly due to our
version of pybind11. 2.10.1 is the first pybind11 version to supports it
2022-11-02 14:46:38 +01:00
youben11
e40c6392cb
ci: build and test rust bindings
2022-11-02 14:46:38 +01:00
Mayeul@Zama
c994c7afcc
chore(CI): add nightly rust fmt and clippy checks
2022-10-31 14:46:48 +01:00