add first patch of cime tests to public CI #6231
Conversation
|
|
Did you try a fully coupled case on these CI resources? For artifacts to save, please add files ending in cprnc.out Testing types: https://github.com/ESMCI/cime/blob/master/CIME/SystemTests/README |
Not explicitly, but I tried the entire e3sm_developer and e3sm_integration test suites (many failed due to missing files like partition files). Could you give me a few examples of coupled cases I should try?
Will add it. Where is this usually located? I am saving Btw, for artifacts, I am not specifying how long they're saved for, so that will be determined in the admin settings on your end (I can also add the retain period in the workflow if we want that). It's usually set to the default value which is 90 days (also happens to be the max allowed for free public repos) |
|
@rljacob when you have a chance, these are the 53 tests from the 123 tests of the e3sm_integration test suite that pass with no modifications. Unless noted after the test, all these tests finish well within an hour (some as fast as a few mins). I am happy to add these to this PR (or in a follow-up PR with potentially other tests). The passing tests
tests:
- ERIO_P4.ne30_g16_rx1.A.singularity_gnu
- ERP_Ld9_P4.ne4_ne4.FIDEAL.singularity_gnu.allactive-pioroot1
- ERP_Ln18_P4.ne4_oQU240.F2010.singularity_gnu
- ERP_Ln9_P4.ne4_ne4.FAQP.singularity_gnu
- ERP_Ln9_P4.ne4_ne4.FRCE.singularity_gnu
- ERS_P4.ELM_USRDAT.I1850ELM.singularity_gnu.elm-usrdat
- ERS_P4.MOS_USRDAT.RMOSGPCC.singularity_gnu.mosart-mos_usrdat
- ERS_P4.MOS_USRDAT.RMOSNLDAS.singularity_gnu.mosart-sediment
- ERS_P4.f19_g16_rx1.A.singularity_gnu
- ERS_P4.ne30_g16_rx1.A.singularity_gnu
- ERS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetahy_ftype2 # (1h14m)
- ERS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetanh_ftype2 # (2h30m)
- ERS_P4.r05_r05.RMOSGPCC.singularity_gnu.mosart-gpcc_1972
- ERS_P4.r05_r05.RMOSGPCC.singularity_gnu.mosart-heat
- ERS_D_P4.ne4_oQU240.F2010.singularity_gnu.eam-hommexx # (4h20m)
- ERS_Ld3_P4.ne4_oQU240.F2010.singularity_gnu
- ERS_Ld3_P4.ne4pg2_oQU480.F2010.singularity_gnu.eam-thetahy_sl_pg2
- ERS_Ld3_P4.ne4pg2_oQU480.F2010.singularity_gnu.eam-thetahy_sl_pg2_ftype0
- ERS_Ld5_P4.T62_oQU120.CMPASO-NYF.singularity_gnu
- ERS_Ld5_P4.T62_oQU240.DTESTM.singularity_gnu
- ERS_Ld5_P4.ne4_oQU240.F2010.singularity_gnu.eam-rrtmgp
- ERS_Ld5_P4.ne4_oQU240.F2010.singularity_gnu.eam-rrtmgpxx
- ERS_Ln9_P4.ne4pg2_ne4pg2.F2010-MMF1.singularity_gnu.eam-mmf_crmout
- ERS_Ln9_P4.ne4pg2_ne4pg2.FRCE-MMF1.singularity_gnu.eam-cosp_nhtfrq9
- NCK_P4.f19_g16_rx1.A.singularity_gnu
- PEM_Ln5_P4.T62_oQU240wLI.DTESTM.singularity_gnu
- PEM_Ln5_P4.ne4_oQU240.F2010.singularity_gnu
- REP_Ln5_P4.ne4_oQU240.F2010.singularity_gnu
- SEQ_P4.f19_g16.X.singularity_gnu
- SMS_P4.MOS_USRDAT.RMOSGPCC.singularity_gnu.mosart-unstructure
- SMS_P4.ne30_f19_g16_rx1.A.singularity_gnu
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-cosplite
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-preqx_ftype0
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-preqx_ftype1
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-preqx_ftype4
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetahy_ftype0
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetahy_ftype1
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetahy_ftype2
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetahy_ftype4
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetahy_sl
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetanh_ftype0 # (1h5m)
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetanh_ftype1
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetanh_ftype2
- SMS_P4.ne4_oQU240.F2010.singularity_gnu.eam-thetanh_ftype4
- SMS_D_Ln5_P4.ne4_oQU240.F2010.singularity_gnu
- SMS_D_Ln5_P4.ne4_oQU240.F2010.singularity_gnu.eam-clubb_sp
- SMS_D_Ln5_P4.ne4_oQU240.F2010.singularity_gnu.eam-cosplite_nhtfrq5
- SMS_Ld1_P4.ne4_ne4.FAQP.singularity_gnu.eam-clubb_only
- SMS_Ln5_P4.ne4pg2_oQU480.F2010.singularity_gnu
- SMS_Ln5_P4.ne4pg2_oQU480.F2010.singularity_gnu.eam-thetahy_pg2
- SMS_Ln5_P4.ne4pg2_oQU480.F2010.singularity_gnu.eam-thetahy_sl_pg2
- SMS_Ln5_P4.ne4pg2_oQU480.F2010.singularity_gnu.eam-thetahy_sl_pg2_ftype0
- SMS_Ln9_P4.ne4_oQU240.F2010.singularity_gnu.eam-outfrq9s
|
|
I downloaded one of the archive files and most of it is what we want. We don't need anything from bld/cmake-bld or the env_archive_test directory. |
|
One more thing we need in the archive: TestStatus.log which is the casedir. |
|
Yeah, the TestStatus.log is important. Also, I wonder if it would be easier to add an entry for singularity machine in config_pes.xml to just set the procs to 4 for all grids/compsets? That way you don't have to add |
Yes, I would like to do this eventually. I was thinking we could formalize this once the container reaches its 0.1.0 release 😉 |
|
Both the The last item to decide before merge: Should we include any of these passing e3sm_integration tests or wait until we see how these go for a few days/weeks? See: #6231 (comment) |
|
Most of those passing integration tests are at resolutions that are going to change so we should wait until #6202 is merged. Then update the CI tests. Just go with what you have. |
|
Alright, sounds good. Once the other PR is merged, I will add the other tests. Feel free to merge at your convenience as this is assigned to you, @rljacob. Thanks, and looking forward to the next installment :) |
|
@mahf708 I cleaned up the PR description (above the line). You may want to edit your first-person story (below the line). |
Thanks and no need, will do better next time 😸 |
|
Or maybe you meant, I should... let me fix it just in case! Edit: done! |
Adds the first batch of 7 tests to run on public CI resources during PR submission. Tests are SMS, SMS_D, ERS, ERP, REP, PET, PEM using F2010 and ne4pg2_oQU480. Tests are run with _P4 because CI resources are limited to 4 virtual CPUs for now. [BFB]
Adds the first batch of 7 tests to run on public CI resources during PR submission.
Tests are SMS, SMS_D, ERS, ERP, REP, PET, PEM using F2010 and ne4pg2_oQU480. Tests are run with _P4 because CI resources are limited to 4 virtual CPUs for now.
[BFB]