selective-disclosure-benchmark

Benchmarks of cryptographic mechanisms for selective disclosure of attributes. Please refer to arxiv.org/abs/2401.08196 for a full description.

Usage

To run all benchmarks:

cargo bench

For cryptographic mechanisms cm in bbs, cl, merkle, ps, benchmarks are available for the following operations:

1. generate a keypair;
2. generate a signature;
3. verify that signature;
4. create a proof of knowledge for an increasing number of attributes and disclosed messages;
5. verify that proof.

To bench 1: cargo bench --bench=cm_keypair
To bench 2-3: cargo bench --bench=cm_signature
To bench 4-5: cargo bench --bench=cm_proof

Before generating summary plots, two additional steps should be performed.

The most expensive operation by far in CL is primality testing for large primes. The script in prime_repeat.py repeats safe prime generation for 8 runs:

cd benches/ursa_benchmark
python3 src/prime_repeat.py
cd ../..

Secondly, the Merkle tree proof size depends on which attributes are disclosed. To estimate a realistic scenario, we sample the possible combinations of disclosed attributes at random. The following scripts sample possible combinations, saving the measured proof sizes in separate .csv files:

cd benches/merkle_benchmark
cargo run --bin merkle >> merkle_proofbytes.csv
cargo run --bin merkle_rand
mv merkle_proofbytes.csv ../../data
cd ../..
python3 src/merkle_rand_summary.py
cd ../..

To generate plots, from the repo's root folder:

python3 matplotlib/issuing_scatter.py
python3 matplotlib/keygen_scatter.py
python3 matplotlib/presentation_scatter.py
python3 matplotlib/key_vs_holder_proof.py

Plots in .pdf and .svg format will be saved in plots/.

Installation

Install rust following e.g., doc.rust-lang.org:

sudo apt install curl pkg-config
curl --proto '=https' --tlsv1.3 https://sh.rustup.rs -sSf | sh

Install openssl with development packages (required by Ursa):

sudo apt install libssl-dev

Install liboqs dependencies for quantum-safe signatures:

sudo apt install astyle cmake clang gcc ninja-build libssl-dev python3-pytest python3-pytest-xdist unzip xsltproc doxygen graphviz python3-yaml valgrind

ursa-benchmark

Hyperledger Hyperledger Ursa has external dependencies. Note that we have a slightly modified version of CL provided by libursa, which is included in benches/ursa_benchmark/cl/. We had to make some methods public, adjust some parameters to reach a higher level of security for comparison with other mechanisms, and add some functionalities in order to properly test a CL implementation without a blinded signature.

To run these benchmarks, a local copy of libursa and libzmix is necessary. The following shell commands will clone a local copy from the github repo to a folder named ursa, then replace the ursa/libursa/src/cl folder with the one provided in the cl folder from this repository.

Note, the version of Ursa for which our modifications were made is commit 5cd3331 from August 4th, 2022. Since Hyperledger Ursa was moved to end-of-life on April 27th, 2023, we have not invested the time to update them.

cd benches/ursa_benchmark/
mkdir ursa
cd ursa
git init
git branch -m main
git remote add -f origin [email protected]:hyperledger-archives/ursa.git 
git config core.sparseCheckout true
echo "libursa/" >> .git/info/sparse-checkout
echo "libzmix/" >> .git/info/sparse-checkout
git merge 5cd3331
cd ..
cp cl/* ursa/libursa/src/cl/

matplotlib

Additional dependencies to generate graphs in matplotlib:

sudo apt install --upgrade python3-pip
sudo apt install texlive-latex-extra dvipng
python3 -m pip install -r ./matplotlib/requirements.txt