cmp_benchmarks: Example Usage

Usage on an FU server like redwood or nero:

mkdir Repos
cd Repos
git clone https://github.com/wvandertoorn/cmp_benchmarks.git
git clone https://github.com/seqan/seqan3.git
cd seqan3
git submodule update --recursive --init
cd ../..

mkdir seqan3_cmp_benchmarks_results

cd Repos/cmp_benchmarks
./cmp_benchmarks.sh -m build -n 3.1.0-vs-3.2.0-rc -b 3.1.0 -c 3.2.0-rc.1 \
    -s ../seqan3/ -r ../../../Repos/seqan3/test/performance/ -o ../seqan3_cmp_benchmarks_results/ \
    -g /group/ag_abi/software/bin/g++-11.2

Results from 3.1.0 vs 3.2.0:

5% Threshold

• significant_diffs.txt - significant_diffs.csv
• significant_decr.txt - significant_decr.csv
• significant_incr.txt - significant_incr.csv

20% Threshold

• significant_decr.txt - significant_decr.csv
• significant_incr.txt - significant_incr.csv

More details on usage:

• https://github.com/wvandertoorn/cmp_benchmarks