David Testé
fd6323b311
chore(ci): add throughput and hpu support to data extractor
...
Now throughput results can be fetched.
HPU backend is supported for integer formatting
2025-10-27 14:39:46 +01:00
David Testé
2749c1088c
chore(ci): handle multi directories for parameters records
2025-05-22 15:03:02 +02:00
David Testé
97b5973e4c
chore(bench): store object measurements results in tfhe-benchmark
2025-05-13 16:05:16 +02:00
David Testé
b31fbf5f23
chore(bench): fix result parsing for object and key generation
2024-11-20 11:55:22 +01:00
David Testé
9059ddeacc
chore(bench): add throughput benchmarks to suite
...
All integer benchmarks make recipes can be run to ouput throughput
results.
Only CPU is supported for throughput benchmarks in GitHub CI.
2024-11-19 12:07:50 +01:00
Nicolas Sarlin
a45b7b3974
chore(zk): add benches to tfhe-zk-pok
2024-11-18 13:17:28 +01:00
David Testé
1a5dfb3699
chore(ci): rename benchmark parsing option to object-sizes
...
Since not only key sizes are measured now, it makes more sense to
rename it to --object-sizes.
2024-10-16 16:28:11 +02:00
David Testé
053d56a3d6
chore(ci): format benchmark results parser with black
2024-03-07 13:33:46 +01:00
David Testé
e5b117ca29
chore(ci): handle new name format to get pbs throughput values
...
core_crypto benchmark name format has been changed to reflect
what's used in other layers. Benchmark result parser was no longer
able to compute the right value for the PBS throughput.
2024-03-07 13:33:46 +01:00
David Testé
9ba27b4082
chore(ci): add multiplier to get effective pbs throughput value
2023-09-06 11:02:47 +02:00
David Testé
cbfaf63964
chore(ci): add pbs throughput benchmarks
...
This implies to add a conversion method to CiphertextModulus in
order to create the CryptoParametersRecord struct used as utils.
2023-06-27 18:16:27 +02:00
Arthur Meyre
9e307a8945
chore(hlapi): add example to measure CPK and CCTL sizes
...
This also includes key generation time in WASM web client side
2023-06-12 11:41:21 +02:00
David Testé
6e4a707eff
chore(ci): compute throughput as operations per second
...
Since most of the operations are over 1 ms, there is no point
to compute the number of operation per millisecond.
2023-05-11 08:58:45 +02:00
David Testé
2b24eb304d
chore(ci): record benchmarks parameters to be stored in database
...
This is done to comply with the new Zama benchmark standard.
Exhaustive parameters list is stored so once it's parsed and send
to database, one can easily filter results on such parameters in
visualization tool.
2023-04-11 21:35:56 +02:00
David Testé
b2407d530e
chore(ci): provide hardware name for benchmarks with avx512
...
This also print a human friendly error from parser if the hardware
cannot be found in the product list.
2023-02-24 12:28:53 +01:00
David Testé
a228f24abc
chore(ci): make cli argument --throughput optional
2023-02-24 11:41:20 +01:00
David Testé
8ee7b14abe
chore(ci): benchmark pbs with cost per ms and per dollar spent
...
Here we benchmark a fixed number of PBS with boolean and shortint
flavors on AWS EC2 instance. Once measurements are done, we compute
the number of operations per millisecond and also operations per
dollar we can perform for a given set of cryptographic parameters
and EC2 instance type. Data are then set to Slab that in turn send
them to a database to be plotted in Grafana.
2023-02-23 18:31:23 +01:00
David Testé
0876d7fec0
chore(ci): measure and report key sizes used in benchmarks
...
Size of boostrapping and key switching keys used in benchmarks are
measured and then sent to Slab to be stored into our benchmark
database.
2023-01-03 18:34:41 +01:00
David Testé
d38edb5096
chore(ci): do not parse report dir when walking subdirectories
2022-11-30 18:03:25 +01:00
David Testé
9a2212e305
chore(ci): parse subdirectories for shortint benchmark results
2022-11-30 15:53:42 +01:00
David Testé
34011798f5
chore(ci): change benchmark parser input name
...
The use of "schema" was incorrect since it's meant to be used as
database name when sending data to Slab.
2022-11-23 19:01:36 +01:00
David Testé
8ea446a105
chore(ci): add benchmark workflow for boolean and shortint
...
These workflows are meant to be triggered by Slab CI bot server.
2022-11-23 11:46:36 +01:00
