Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show percentage of simulation progress #1659

Merged
merged 6 commits into from
Oct 11, 2023

Conversation

JoshuaLampert
Copy link
Member

Only a minor thing, but as a user you are probably interested in how much percent of the simulation is already done, especially in a simulation that runs for a longer time. With this PR, this information is printed in the AnalysisCallback and in the AliveCallback in parenthesis behind the simulation time.

@github-actions
Copy link
Contributor

github-actions bot commented Oct 5, 2023

Review checklist

This checklist is meant to assist creators of PRs (to let them know what reviewers will typically look for) and reviewers (to guide them in a structured review process). Items do not need to be checked explicitly for a PR to be eligible for merging.

Purpose and scope

  • The PR has a single goal that is clear from the PR title and/or description.
  • All code changes represent a single set of modifications that logically belong together.
  • No more than 500 lines of code are changed or there is no obvious way to split the PR into multiple PRs.

Code quality

  • The code can be understood easily.
  • Newly introduced names for variables etc. are self-descriptive and consistent with existing naming conventions.
  • There are no redundancies that can be removed by simple modularization/refactoring.
  • There are no leftover debug statements or commented code sections.
  • The code adheres to our conventions and style guide, and to the Julia guidelines.

Documentation

  • New functions and types are documented with a docstring or top-level comment.
  • Relevant publications are referenced in docstrings (see example for formatting).
  • Inline comments are used to document longer or unusual code sections.
  • Comments describe intent ("why?") and not just functionality ("what?").
  • If the PR introduces a significant change or new feature, it is documented in NEWS.md.

Testing

  • The PR passes all tests.
  • New or modified lines of code are covered by tests.
  • New or modified tests run in less then 10 seconds.

Performance

  • There are no type instabilities or memory allocations in performance-critical parts.
  • If the PR intent is to improve performance, before/after time measurements are posted in the PR.

Verification

  • The correctness of the code was verified using appropriate tests.
  • If new equations/methods are added, a convergence test has been run and the results
    are posted in the PR.

Created with ❤️ by the Trixi.jl community.

@sloede
Copy link
Member

sloede commented Oct 5, 2023

Very interesting idea!

Without having looked at the code yet: How do you know whether the simulation time or the max. number of iterations will determine when the simulation is finished?

@JoshuaLampert
Copy link
Member Author

Ok, justified objection. I just assumed the simulation time will determine when the simulation is finished.

@JoshuaLampert
Copy link
Member Author

But IMHO a finish due to max. number of iterations is something like an "early finish" for me. So I would be fine if it does not say 100% at the end when the simulation is finished due to the max. number of iterations are reached. It would actually be an interesting number at which percent of the final simulation time the simulation ended in this case, I think. What do you think?

@sloede
Copy link
Member

sloede commented Oct 5, 2023

Not really an objection, more of an honest question. I wouldn't mind having such an feature if it is made clear to the user that what this percentage refers to.

@codecov
Copy link

codecov bot commented Oct 5, 2023

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (8bc5469) 93.24% compared to head (0a279e1) 86.32%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1659      +/-   ##
==========================================
- Coverage   93.24%   86.32%   -6.92%     
==========================================
  Files         419      419              
  Lines       34134    34146      +12     
==========================================
- Hits        31826    29474    -2352     
- Misses       2308     4672    +2364     
Flag Coverage Δ
unittests 86.32% <83.33%> (-6.92%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Coverage Δ
src/callbacks_step/alive.jl 94.74% <83.33%> (-2.23%) ⬇️
src/callbacks_step/analysis.jl 92.55% <83.33%> (-0.20%) ⬇️

... and 92 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@DanielDoehring
Copy link
Contributor

In principle one could also print final time alongside current simulation time. Then, if the user forgot the simulation endtime it is conveniently displayed.
Providing a percentage bears in my opinion the danger of people expecting to be able to extrapolate from this, which can go e.g. for AMR horribly wrong.

On the other side, we always write out errors which are also meaningless in actual simulations - in some sense this is also misleading.

@JoshuaLampert
Copy link
Member Author

JoshuaLampert commented Oct 6, 2023

We could document this, e.g., here.

@ranocha
Copy link
Member

ranocha commented Oct 7, 2023

It looks like the P4est_jll update breaks some tests here, too...

@ranocha
Copy link
Member

ranocha commented Oct 7, 2023

Moreover, some *neuralnetwork_perssonperaire.jl test fail due to changes of the results...

@ranocha
Copy link
Member

ranocha commented Oct 7, 2023

Other than the failing tests, I do like the approach. It's of course not perfect (since one could want to have a percentage of the total run time), but it's the best information we can provide.

src/callbacks_step/alive.jl Outdated Show resolved Hide resolved
src/callbacks_step/analysis.jl Outdated Show resolved Hide resolved
Copy link
Member

@ranocha ranocha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@ranocha ranocha merged commit 1727b07 into trixi-framework:main Oct 11, 2023
29 of 31 checks passed
@JoshuaLampert JoshuaLampert deleted the print-progress-perc branch October 11, 2023 14:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants