-
Notifications
You must be signed in to change notification settings - Fork 169
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
JP-3702: Fix filenames for level3 NIRSpec #8699
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #8699 +/- ##
==========================================
+ Coverage 60.33% 60.35% +0.01%
==========================================
Files 372 372
Lines 38361 38370 +9
==========================================
+ Hits 23145 23157 +12
+ Misses 15216 15213 -3 ☔ View full report in Codecov by Sentry. 🚨 Try these New Features:
|
Regression tests here: |
Regression tests look correct. Only NIRSpec associations are affected, and the only change in each case is that the product name now contains the slit, in between the grating and the subarray (if present). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It looks like the pool 010 regression test has a duplicated slitname entry in the product name. Other than that, this looks good to me.
I saw that too -- it's actually just because of some weird input data in the synthetic pools. The slit and subarray are set to the same value, and it is appropriately listing them both. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm, it may be time to investigate covering our association testing through flight pools over the synthetic pools...
LGTM!
Resolves JP-3702
Closes #8688
Restore slit names to level 3 filenames for NIRSpec products that do not get planned as fixed slit reductions. This primarily impacts BOTS mode, which has a FXD_SLIT defined, but does not get planned for spec3 with Asn_Lv3NRSFSS rules: these data are planned for tso3 with Asn_Lv3TSO rules. It also impacts background targets for fixed slit, planned with Asn_Lv3SpecAux rules.
In JP-3233 (#7879), association rules were changed for fixed slits to allow S200A1 and S200A2 targets to be reduced together in spec3. Part of this change removed a check for fixed slit as one of the 'opt_elem' fields in the filename. This had the unintended effect of removing the fixed slit from the name for BOTS and auxiliary NIRSpec data.
The fix here is to restore the check for FXD_SLIT in all level3 product names that might apply to NIRSpec data and add the value to the filename if present.
It looks like this regression was reported in the regression tests for JP-3233, e.g. the last entry in this report:
test_against_standard_pool_010_spec_nirspec_lv2bkg, but it was buried in some other expected changes. There were also some unit tests for level3 product names, but they were not specific enough to catch this regression.
I have updated the unit tests (test_level3_product_names.py) to catch this case specifically, and verified that it fails on master and passes with this PR branch. I think the regression tests should be sufficient as is.
Checklist for PR authors (skip items if you don't have permissions or they are not applicable)
CHANGES.rst
within the relevant release sectionHow to run regression tests on a PR