Calculate mean value of metrics with multiple runs #25

Open
opened 2025-07-08 08:34:50 -04:00 by AtHeartEngineer · 0 comments

Originally created by @MuhtasimTanmoy on 11/24/2024

For each benchmark, calculate the mean value of metrics with multiple runs and aggregate the result.

Decide which one to adopt

Try measuring detailed metrics, including:

  • Mean execution time.
  • Standard deviation.
  • Confidence intervals.
*Originally created by @MuhtasimTanmoy on 11/24/2024* For each benchmark, calculate the mean value of metrics with multiple runs and aggregate the result. Decide which one to adopt - https://github.com/bheisler/criterion.rs - https://github.com/polybase/benchy Try measuring detailed metrics, including: - Mean execution time. - Standard deviation. - Confidence intervals.
Sign in to join this conversation.