Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow new benchmark experiments #32

Open
karlaspuldaro opened this issue Aug 28, 2023 · 1 comment · May be fixed by #42
Open

Allow new benchmark experiments #32

karlaspuldaro opened this issue Aug 28, 2023 · 1 comment · May be fixed by #42
Assignees
@karlaspuldaro
Labels
enhancement New feature or request

Comments

@karlaspuldaro
Copy link
Collaborator

karlaspuldaro commented Aug 28, 2023 •
edited
Loading

To make adjustments to the workflow, here are some relevant steps:

  • rethink benchmarking folder structure for better scalability
  • add documentation steps on how to add a new experiment to the benchmark workflow
  • pass qasm filename to tox execution to define which circuit to run
  • configure logic for csv files destination folder based on experiment
  • pass metriq method name in post-processing to define submission details
  • rethink storage of metriq components IDs (submission, tasks, methods, etc)
@karlaspuldaro karlaspuldaro changed the title Allow new experiments Allow new benchmark experiments Aug 28, 2023
@karlaspuldaro
Copy link
Collaborator Author

New experiment - #33

@karlaspuldaro karlaspuldaro self-assigned this Nov 3, 2023
@karlaspuldaro karlaspuldaro linked a pull request Nov 28, 2023 that will close this issue
Draft
4 tasks
@karlaspuldaro karlaspuldaro added the enhancement New feature or request label Dec 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@karlaspuldaro karlaspuldaro

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[WIP] Structure refactor to allow new benchmark experiments karlaspuldaro/qiskit-metriq
1 participant
@karlaspuldaro