Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add performance benchmark #241

Open
9 of 15 tasks
tmigot opened this issue Jun 6, 2024 · 2 comments
Open
9 of 15 tasks

Add performance benchmark #241

tmigot opened this issue Jun 6, 2024 · 2 comments

Comments

@tmigot
Copy link
Member

tmigot commented Jun 6, 2024

We can get inspiration from this:
https://github.com/lanl-ansi/rosetta-opf/blob/main/nlpmodels.jl / https://discourse.julialang.org/t/ac-optimal-power-flow-in-various-nonlinear-optimization-frameworks/78486


First step is to have benchmarks to measure potential regressions:

  • Add benchmark folder
  • Pkg benchmark grad
  • Pkg benchmark jac
  • Pkg benchmark hess
  • Pkg benchmark jprod
  • Pkg benchmark jtprod
  • Pkg benchmark hprod
  • Add NLS variants
  • Add JuMP in the benchmark for local run
  • Parallelize for local run
  • Add benchmark README
  • Add PkgBenchmark CI
  • Add push results from Benchmark CI
  • Store benchmark result in the package
  • Add documentation page listing available benchmarks
@gdalle
Copy link
Collaborator

gdalle commented Jun 6, 2024

@gdalle
Copy link
Collaborator

gdalle commented Jun 6, 2024

Here are the comparison results between JuMP, SCT and Symbolics for the first 90% or so of the OptimizationProblems.jl suite. A couple of the last problems take a really long time (probably for Symbolics) and I haven't yet narrowed down which ones. But I think the trend is clear.

image

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants