github/concrete
1
1
Fork 0
mirror of https://github.com/zama-ai/concrete.git synced 2026-02-09 03:55:04 -05:00
Code Issues Packages Projects Releases Wiki Activity

docs: talk about all progress trackers in the doc

Browse Source
This commit is contained in:
Umut
2022-01-06 15:17:12 +03:00
parent 198ac8f47b
commit aa3d13c121
1 changed files with 8 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
docs/user/basics/benchmarks.md
View File

@@ -1,11 +1,13 @@
# Benchmarks
To track our progress over time, we have created a [progress tracker](https://ml.progress.zama.ai) that:
- lists targets that we want to compile
- updates the status on the compilation of these functions
- tracks compilation and evaluation times on different hardware
- displays accuracy of the functions for which it makes sense
- displays loss of the functions for which it makes sense
To track our progress over time, we have created a couple of progress trackers, one for our [core functionality](https://concrete.progress.zama.ai) and one for [machine learning](https://ml.progress.zama.ai) built on top of our core funtionality.
We track:
- targets that we want to compile
- status of the compilability of these functions
- evaluation times on different hardwares
- accuracy of the functions when it makes sense
- loss and other metrics of the functions when it makes sense
Note that we are not limited to these, and we'll certainly add more information (e.g., key generation time, encryption time, inference time, decryption time, etc.) once the explicit inference API is available.