Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds skeleton performance test framework #1

Merged
merged 2 commits into from
Feb 27, 2024
Merged

Adds skeleton performance test framework #1

merged 2 commits into from
Feb 27, 2024

Conversation

nickschuch
Copy link
Member

@nickschuch nickschuch commented Feb 27, 2024

Overview

Adds a performance testing framework so that we can test the effects of adding new spans to our library.

Implementation

  • Adds a basic k6 scenario for performance testing. Contains cache breaking functionality.
  • Adds a toggle to Docker Compose so that we can disable OpenTelemetry.
  • Adds a Github Actions workflow for executing 2 tests:
    • A baseline test without OpenTelemetry enabled
    • One with OpenTelemetry enabled
  • Adds a script for reviewing the tests. Is responsible for:
    • Checking our tests did not have any errors
    • If our OpenTelemetry implementation operates within a specific budget. Starting with 200ms.
  • Adds Github comment to see data

@nickschuch nickschuch force-pushed the perf-test branch 2 times, most recently from 9358a64 to 9fb3382 Compare February 27, 2024 05:26
@previousnext previousnext deleted a comment from github-actions bot Feb 27, 2024
@previousnext previousnext deleted a comment from github-actions bot Feb 27, 2024
@previousnext previousnext deleted a comment from github-actions bot Feb 27, 2024
@previousnext previousnext deleted a comment from github-actions bot Feb 27, 2024
@previousnext previousnext deleted a comment from github-actions bot Feb 27, 2024
Copy link

Performance Data

Before = 69ms | After = 216ms | Difference = 147ms

@nickschuch nickschuch merged commit fb1c845 into main Feb 27, 2024
1 check passed
@nickschuch nickschuch deleted the perf-test branch February 27, 2024 22:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant