Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add month-averaging of grazing/mortality & biology growth rate variable groups to make_averaged_dataset #297

Merged
merged 4 commits into from
Sep 30, 2024

Conversation

douglatornell
Copy link
Member

@douglatornell douglatornell commented Sep 24, 2024

  • extraction config YAML files for Reshapr
  • grazing and growth options for reshapr_var_group command-line argument
  • code to prevent redundant calculation of day-average datasets that NEMO produces for grazing and growth
  • automatic calculation of grazing and growth month-average datasets at the end of each month
  • test suite updates

These YAML configuration files resample daily biological growth rate and
grazing/mortality fields to monthly averages for the SalishSeaCast v202111
model. They specify the variables to extract, the resampling method, and the
destination for the output files.
Extended the make_averaged_dataset worker and related test cases to include
grazing and growth dataset variable groups. Updated configuration files and
added parameter-specific validations for these new variable groups.
Copy link

codecov bot commented Sep 24, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.69%. Comparing base (274fc7a) to head (e8964c3).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #297      +/-   ##
==========================================
+ Coverage   77.68%   77.69%   +0.01%     
==========================================
  Files         133      133              
  Lines       18745    18757      +12     
  Branches     1912     1915       +3     
==========================================
+ Hits        14562    14574      +12     
  Misses       4117     4117              
  Partials       66       66              
Flag Coverage Δ
unittests 77.69% <100.00%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Updated the nowcast.yaml configuration file to include failure messages for
grazing and growth dataset day-averaging. Corresponding test cases were also
added to ensure proper error handling for these new scenarios.

Missed in ce694e2. Necessary because grazing and growth dataset day-averaging
operation requests are rejected to avoid redundant work; those datasets are
calculated and output by out NEMO configuration.
Expanded the next_workers module to calculate month-average grazing and growth
datasets at month-end. Added corresponding test functions to ensure the new
make_averaged_dataset worker instances are launched correctly.
@douglatornell
Copy link
Member Author

Tested successfully in automation on 30-Sep-2024.

@douglatornell douglatornell merged commit 5236fe5 into main Sep 30, 2024
5 of 6 checks passed
@douglatornell douglatornell deleted the month-avg-prod-graz branch September 30, 2024 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant