Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking issue for improving benchmarking #686

Open
6 tasks
LtdJorge opened this issue Jan 14, 2025 · 0 comments
Open
6 tasks

Tracking issue for improving benchmarking #686

LtdJorge opened this issue Jan 14, 2025 · 0 comments

Comments

@LtdJorge
Copy link
Contributor

When making decisions around algorithms and implementations, it is often necessary to prove one choice is better than another by benchmarking them, instead of just making assumptions.

There are benchmarks currently in Limbo, but there is lots of room for improvement. I will list here a general set of requirements for benchmarks that give us a good understanding of how Limbo performs and what can be improved.

  • TPC-H support TPC-H support #36
  • TPC-E support TPC-E support #685
  • Add benches with queries stressing CPU-bound operations (aggregates, joins, etc)
  • Add benches with queries stressing IO (full table scans for huge tables, concurrent random IO accesses...)
  • Add benches with high query/IO concurrency
  • Add benchmarks for the C API that compare SQLite and Limbo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant