Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sprint/workflow_manager #1041

Draft
wants to merge 84 commits into
base: release
Choose a base branch
from
Draft

Sprint/workflow_manager #1041

wants to merge 84 commits into from

Conversation

nwieters
Copy link
Contributor

@nwieters nwieters commented Sep 4, 2023

Refactoring workflow manager

Can be tested by calling
esm_runscripts <runscript.yaml> -i workflow

Examples:
https://esm-tools.readthedocs.io/en/sprint-workflow_manager_documentation/workflow.html#examples-for-the-definition-of-new-workflow-phases

Closes #1047

@nwieters nwieters self-assigned this Sep 21, 2023
@nwieters nwieters added enhancement New feature or request Sprint PRs and Issues for the Sprint workflow manager labels Sep 21, 2023
Copy link
Contributor

@mandresm mandresm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great job so far @nwieters! I'm half way through the review, I'll continue tomorrow. It's way more clear, however, I don't yet understand the whole architecture of the new code, but so far it makes sense to me. Maybe we need to consider changing some of the methods below to be moved into the Workflow class, but that's a discussion for later.

src/esm_plugin_manager/esm_plugin_manager.py Outdated Show resolved Hide resolved
src/esm_plugin_manager/esm_plugin_manager.py Outdated Show resolved Hide resolved
src/esm_runscripts/workflow.py Outdated Show resolved Hide resolved
src/esm_runscripts/workflow.py Show resolved Hide resolved
src/esm_runscripts/workflow.py Outdated Show resolved Hide resolved
src/esm_runscripts/workflow.py Show resolved Hide resolved
src/esm_runscripts/workflow.py Outdated Show resolved Hide resolved
src/esm_runscripts/workflow.py Outdated Show resolved Hide resolved
src/esm_runscripts/workflow.py Outdated Show resolved Hide resolved
src/esm_runscripts/workflow.py Outdated Show resolved Hide resolved
@nwieters
Copy link
Contributor Author

nwieters commented Dec 1, 2023

I hope that these were the last conceptual changes to the code. I will now start to do a cleanup and do some code optimizations.

To run only the tests for examples, run
pytest test_workflow.py -m example --disable-warnings

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Sprint PRs and Issues for the Sprint workflow manager
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Workflow Manager: Improve exception handling and error messages.
2 participants