Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Write DDP upper & lower bound each iteration when solving multi-stage with foresight #686

Closed
JesseJenkins opened this issue Apr 22, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@JesseJenkins
Copy link
Collaborator

Feature description

When solving multi-stage with foresight, GenX applies a dual dynamic decomposition method. We currently record the progression of upper and lower bound from the decomposition stages, showing the progression towards convergence, but we only write this to stats_multi_stage.csv only after completing the GenX run. We should modify the code to write to this file after each forward and backward pass, so that we can see the progression of DDP convergence as it continues, in case we have cases that terminate prior to finishing (e.g. hit a wall clock time limit).

Motivation

Helps debug large-scale multi-stage problems with foresight that might not complete before a wall clock limit is reached.

Implementation strategy

Modify write_multi_stage_stats.jl to write to stats_multi_stage.csv at the end of each forward pass and the end of each backwards pass (as bounds update).

Additional context

No response

@sambuddhac
Copy link
Collaborator

This is now fixed on the release branch

@lbonaldo
Copy link
Collaborator

Addressed on release/0.4.0 and v0.3.

@lbonaldo lbonaldo closed this as completed May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants