mirror of
https://github.com/zama-ai/concrete.git
synced 2026-02-18 00:21:36 -05:00
This commit: + Adds support for a protocol which enables inter-op between concrete, tfhe-rs and potentially other contributors to the fhe ecosystem. + Gets rid of hand-made serialization in the compiler, and client/server libs. + Refactors client/server libs to allow more pre/post processing of circuit inputs/outputs. The protocol is supported by a definition in the shape of a capnp file, which defines different types of objects among which: + ProgramInfo object, which is a precise description of a set of fhe circuit coming from the same compilation (understand function type information), and the associated key set. + *Key objects, which represent secret/public keys used to encrypt/execute fhe circuits. + Value object, which represent values that can be transferred between client and server to support calls to fhe circuits. The hand-rolled serialization that was previously used is completely dropped in favor of capnp in the whole codebase. The client/server libs, are refactored to introduce a modular design for pre-post processing. Reading the ProgramInfo file associated with a compilation, the client and server libs assemble a pipeline of transformers (functions) for pre and post processing of values coming in and out of a circuit. This design properly decouples various aspects of the processing, and allows these capabilities to be safely extended. In practice this commit includes the following: + Defines the specification in a concreteprotocol package + Integrate the compilation of this package as a compiler dependency via cmake + Modify the compiler to use the Encodings objects defined in the protocol + Modify the compiler to emit ProgramInfo files as compilation artifact, and gets rid of the bloated ClientParameters. + Introduces a new Common library containing the functionalities shared between the compiler and the client/server libs. + Introduces a functional pre-post processing pipeline to this common library + Modify the client/server libs to support loading ProgramInfo objects, and calling circuits using Value messages. + Drops support of JIT. + Drops support of C-api. + Drops support of Rust bindings. Co-authored-by: Nikita Frolov <nf@mkmks.org>
40 lines
1.1 KiB
YAML
40 lines
1.1 KiB
YAML
name: Compiler - Compliance
|
|
|
|
on:
|
|
workflow_call:
|
|
workflow_dispatch:
|
|
|
|
jobs:
|
|
FormattingAndLinting:
|
|
runs-on: ubuntu-20.04
|
|
steps:
|
|
- uses: actions/checkout@v3
|
|
- name: Format with clang-format (Cpp)
|
|
run: |
|
|
sudo apt install moreutils
|
|
cd compilers/concrete-compiler/compiler
|
|
./scripts/format_cpp.sh
|
|
- name: Format with cmake-format (Cmake)
|
|
run: |
|
|
pip3 install cmakelang
|
|
cd compilers/concrete-compiler/compiler
|
|
./scripts/format_cmake.sh
|
|
- name: Format with black (Python)
|
|
run: |
|
|
cd compilers/concrete-compiler/compiler
|
|
pip install -r lib/Bindings/Python/requirements_dev.txt
|
|
make check-python-format
|
|
- name: Lint with pylint (Python)
|
|
run: |
|
|
cd compilers/concrete-compiler/compiler
|
|
# compiler requirements to lint
|
|
pip install numpy
|
|
make python-lint
|
|
|
|
CheckLicense:
|
|
runs-on: ubuntu-20.04
|
|
steps:
|
|
- uses: actions/checkout@v3
|
|
- name: Check if sources include the license header
|
|
run: .github/workflows/scripts/check_for_license.sh
|