Add communication benchmarks #100

mcopik · 2022-08-09T15:22:10Z

This PR relies on #99 - we need to first merge C++ benchmarks to use communication functions.

The features that we're planning to implement here are:

Implement S3 communication
Implement DynamoDB communication.
Implement Redis communication.
Implement SQS communication.
Using external's hole puncher to implement P2P benchmarks.
Experiment's implementation to run P2P.

…s into cpp_benchmarks

… unique resource ID for all experiments

… handling of storage buckets. In future, we are going to use max 3 buckets per deployment (benchmarks, code, deployment). Warning: this has not been tested and evaluated on Azure, GCP, OpenWhisk and local - only AWS

…2P experiment

…ks into comm_benchmarks

mcopik added 30 commits May 4, 2022 02:09

[aws][system] Add C++ dependencies images

a9f3c27

[aws][system] Add C++ dependencies images

d0af6f9

Merge branch 'cpp_benchmarks' of github.com:spcl/serverless-benchmark…

6cc22bf

…s into cpp_benchmarks

[aws] Change name style of C++ Docker images

495085d

[aws] Add AWS C++ Lambda runtime as dependency

3ca2b87

[aws] Add the basic wrapper for C++

cc5c86b

[aws] Add Docker build container for C++

fae837d

[benchmarks] Add sleep benchmark implementation for C++

6187885

[aws] Define necessary package files for C++

a2879d7

[system] Add Docker build arguments for C++ images

5c38ffe

[aws] Implement correct return from C++

76254bf

[aws] [system] First version of support for C++ benchmarks

f017635

[aws] Add Boost UUID in handler

46131d9

[aws] Support HTTP trigger for C++

a74f6f4

[aws] Minor update of C++ dependencies

2a21112

[aws] Update C++ wrappers to handle exit code

a01c535

[aws] Add storage method to create S3 paths

873e016

[system] Simplify hendling of common configuration options and define…

00156ef

… unique resource ID for all experiments

[system] Fix a typo

ac5382e

[benchmarks] [aws] Add first version of P2P benchmakr for AWS S3

9e1a15e

[system] Add first, incomplete version of P2P experiment

7b38dd0

[experiments] Add first, incomplete version of P2P experiment

9b15b8f

[experiments] Polish the output format and control over messages in P…

1dd2421

…2P experiment

Merge branch 'comm_benchmarks' of github.com:spcl/serverless-benchmar…

2ed1f29

…ks into comm_benchmarks

[system] Fix a typo

91ae119

[experiments] Process data from P2P experiment

766b680

[experiments] Support many sizes in communication p2p benchmark

e465db3

[aws] Handle Lambda library triggers with long timeouts

c4368fe

[aws] Add missing config initizatlion

bf808a6

mcopik added 26 commits May 15, 2022 13:47

[aws] Extend permissions of SeBS role

20959e2

[experiments] Support key-value storage for communication

694e95c

[aws] Add key-value wrapper for C++ benchmarks

35d1775

Merge branch 'cpp_benchmarks' into comm_benchmarks

d463cbd

[bechmarks] Add DynamoDB benchmark

3124beb

[system] Add caching of key-value tables

edda7a8

[benchmarks] Linting

e014c3b

Merge branch 'cpp_benchmarks' into comm_benchmarks

c046490

[aws] Fix a typo in role name

96b4619

[benchmarks] Increase timeout of the benchmark function

d36d30d

[experiments] Add configuration of Redis to communication experiment

41ed692

[system] Add logging of C++ build steps

de87302

[aws] Add Redis wrappers for C++

8e53993

Merge branch 'cpp_benchmarks' into comm_benchmarks

8846844

[benchmarks] Add communication P2P benchmark for Redis

93ba402

[experiments] Process Redis results

a4c7f02

[system] Add Docker image for TCPunch dependency

42132ac

[aws] Add tcpunch to Docker build image

372459d

[benchmarks] Adjust Redis to not leave empty messages

27212a5

[aws] Add TCP wrapper

c858549

[aws] Add TCP wrapper to installation scripts

2ee3567

[aws] Add TCP wrapper

b76168d

[benchmarks] Improve handling of Redis cleanup

1210020

[benchmarks] Add TCP P2P benchmark

76619b9

[experiments] Minor code improvements

0ee4938

Merge branch 'comm_benchmarks' of github.com:spcl/serverless-benchmar…

6b2eb39

…ks into comm_benchmarks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add communication benchmarks #100

Add communication benchmarks #100

mcopik commented Aug 9, 2022

Add communication benchmarks #100

Are you sure you want to change the base?

Add communication benchmarks #100

Conversation

mcopik commented Aug 9, 2022