Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add runtime and buildnml-time checks on output frequency #2919

Merged
merged 3 commits into from
Jul 30, 2024

Conversation

bartgol
Copy link
Contributor

@bartgol bartgol commented Jul 25, 2024

Ensures dt_output is not smaller than dt_atm, which would cause empty output files. I ran case.setup with an output file with frequency=1800s, for a case with dt_atm=3600s, and got the error

ERROR: Cannot have output frequency faster than atm timestep.
  yaml file: /home/lbertag/acme/scratch/SMS.ne4pg2_ne4pg2.F2010-SCREAMv1.groppello_gnu.20240725_082320_8zpnc3/output.yaml
   Frequency: 1800
   frequency_units: nsecs
   ATM_NCPL: 24
 This yields dt_atm=3600.0 > dt_output=1800. Please, adjust 'Frequency' and/or 'frequency_units'

Fixes #2891 .

Ensures dt_output is not smaller than dt_atm
mahf708
mahf708 previously approved these changes Jul 25, 2024
Copy link
Contributor

@mahf708 mahf708 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks!

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5700
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA dbaeea2
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5935
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA dbaeea2
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)
  • Branch: bartgol/eamxx-add-io-time-check
  • SHA: dbaeea2
  • Mode: TEST_REPO

Pull Request Author: bartgol

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5700
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA dbaeea2
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5935
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA dbaeea2
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM
SCREAM_PullRequest_Autotester_Mappy # 5700 FAILED (click to see last 100 lines of console output)

    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20240725_092013_06d42c
FAIL SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20240725_092013_06d42c
test-scheduler took 401.09948444366455 seconds'
+ errors='Waiting for tests to finish
FAIL ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240725_092013_06d42c
FAIL ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20240725_092013_06d42c
FAIL ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20240725_092013_06d42c
FAIL ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20240725_092013_06d42c
FAIL ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu.C.20240725_092013_06d42c
FAIL PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20240725_092013_06d42c
FAIL SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20240725_092013_06d42c
test-scheduler took 401.09948444366455 seconds'
+ V1_FAILURES_DETAILS+='Waiting for tests to finish
FAIL ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240725_092013_06d42c
FAIL ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20240725_092013_06d42c
FAIL ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20240725_092013_06d42c
FAIL ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20240725_092013_06d42c
FAIL ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu.C.20240725_092013_06d42c
FAIL PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20240725_092013_06d42c
FAIL SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20240725_092013_06d42c
test-scheduler took 401.09948444366455 seconds'
+ set +x
######################################################
FAILS DETECTED:
  SCREAM STANDALONE TESTING FAILED!
Build type full_debug failed at build time. Here's the build log:
Starting analysis on mappy with cmd: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5700/scream/components/eamxx && module purge && module load sems-archive-env acme-env acme-cmake/3.26.3 acme-gcc/11.2.0 sems-archive-git/2.10.1 acme-openmpi/4.1.4 acme-netcdf/4.7.4/acme && export GATOR_INITIAL_MB=4000MB && export PATH=/ascldap/users/jgfouca/packages/valgrind-3.22.0/bin:$PATH && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy
RUN: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5700/scream/components/eamxx && module purge && module load sems-archive-env acme-env acme-cmake/3.26.3 acme-gcc/11.2.0 sems-archive-git/2.10.1 acme-openmpi/4.1.4 acme-netcdf/4.7.4/acme && export GATOR_INITIAL_MB=4000MB && export PATH=/ascldap/users/jgfouca/packages/valgrind-3.22.0/bin:$PATH && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy
FROM: /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5700/scream/components/eamxx
mappy failed
  SCREAM V1 TESTING FAILED!
Waiting for tests to finish
FAIL ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240725_092013_06d42c
FAIL ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20240725_092013_06d42c
FAIL ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20240725_092013_06d42c
FAIL ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20240725_092013_06d42c
FAIL ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu.C.20240725_092013_06d42c
FAIL PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20240725_092013_06d42c
FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20240725_092013_06d42c
FAIL SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase MODEL_BUILD)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20240725_092013_06d42c
test-scheduler took 401.09948444366455 seconds
######################################################
Build step 'Execute shell' marked build as failure
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 33165 killed;
[ssh-agent] Stopped.
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash -le

cd $WORKSPACE/${BUILD_ID}/

./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel

[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins2121805890691638554.sh
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Sending e-mails to: [email protected]
Finished: FAILURE

SCREAM_PullRequest_Autotester_Weaver # 5935 FAILED (click to see last 100 lines of console output)

[ 63%] Built target scream_rrtmgp_yakl
[ 63%] Building Fortran object src/physics/rrtmgp/CMakeFiles/scream_rrtmgp.dir/shr_orb_mod_c2f.F90.o
[ 63%] Building CXX object src/physics/rrtmgp/CMakeFiles/scream_rrtmgp.dir/eamxx_rrtmgp_process_interface.cpp.o
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/physics/p3/eamxx_p3_process_interface.cpp: In member function 'virtual void scream::P3Microphysics::set_grids(std::shared_ptr)':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/physics/p3/eamxx_p3_process_interface.cpp:58:88: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
   58 |   FieldLayout scalar3d_layout_mid { {COL,LEV}, {m_num_cols,m_num_levs} };
      |                                                                                        ^         
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/src/ekat/util/ekat_scaling_factor.hpp(59): warning #177-D: variable "sz_out" was declared but never referenced

/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/src/ekat/util/ekat_units.hpp(200): warning #177-D: variable "size_out" was declared but never referenced

/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/Kokkos_View.hpp: In lambda function:
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/Kokkos_View.hpp:840:32: warning: 'ws_idx_broadcast' may be used uninitialized in this function [-Wmaybe-uninitialized]
840 | return m_map.m_impl_handle[i0];
| ^~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/src/ekat/kokkos/ekat_kokkos_utils.hpp:584:5: note: 'ws_idx_broadcast' was declared here
584 | int ws_idx_broadcast;
| ^ ~~~~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/share/io/scorpio_output.cpp: In member function 'std::vector scream::AtmosphereOutput::get_var_dof_offsets(const scream::FieldLayout&)':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/share/io/scorpio_output.cpp:1131:20: warning: 'min_gid' may be used uninitialized in this function [-Wmaybe-uninitialized]
1131 | auto offset = (gid-min_gid)col_size;
| ~~~~~^~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/share/io/scorpio_output.cpp:1088:24: note: 'min_gid' was declared here
1088 | AbstractGrid::gid_type min_gid;
| ^~~~~~~
nvcc_internal_extended_lambda_implementation: In static member function 'static void
__nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4>::manager::do_copy(void*) [with Lambda = scream::shoc::update_prognostics_implicit_f(ekat::Int, ekat::Int, ekat::Int, ekat::Int, scream::Real, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*)::<lambda(const MemberType&)>; Tag = __nv_dl_tag<void ()(int, int, int, int, double, double, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*, double*), scream::shoc::update_prognostics_implicit_f, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = int; F2 = int; F3 = const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<1> >; F4 = const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<1> >]':
nvcc_internal_extended_lambda_implementation:462:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/KokkosExp_MDRangePolicy.hpp: In copy constructor 'Kokkos::MDRangePolicy<Kokkos::Cuda, Kokkos::Rank<2, Kokkos::Iterate::Right, Kokkos::Iterate::Right>, Kokkos::IndexType >::MDRangePolicy(const Kokkos::MDRangePolicy<Kokkos::Cuda, Kokkos::Rank<2, Kokkos::Iterate::Right, Kokkos::Iterate::Right>, Kokkos::IndexType >&)':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/KokkosExp_MDRangePolicy.hpp:153:8: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
153 | struct MDRangePolicy : public Kokkos::Impl::PolicyTraits<Properties...> {
| ^~~~~~~~~~~~~
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4, F5>::manager::do_copy(void*) [with Lambda = scream::Nudging::run_impl(double)::<lambda(const MemberType&)>; Tag = nv_dl_tag<void (scream::Nudging::)(double), &scream::Nudging::run_impl, 4>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = bool; F2 = ekat::LinInterp<double, 1>; F3 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F4 = Kokkos::View<const ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F5 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >]':
nvcc_internal_extended_lambda_implementation:591:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp: In function 'void Kokkos::parallel_for(const string&, const ExecPolicy&, const FunctorType&) [with ExecPolicy = Kokkos::RangePolicy<>; FunctorType = scream::P3Microphysics::p3_preamble; Enable = void]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp:133:1: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
133 | inline void parallel_for(const std::string& str, const ExecPolicy& policy,
| ^~~~~~~~~~~~
[ 63%] Linking CXX static library libspa.a
[ 63%] Built target spa
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/physics/mam/eamxx_mam_microphysics_process_interface.cpp: In member function 'void scream::MAMMicrophysics::set_defaults
()':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/physics/mam/eamxx_mam_microphysics_process_interface.cpp:47:6: note: the layout of aggregates containing vectors with 4-byte alignment has changed in GCC 5
47 | void MAMMicrophysics::set_defaults
() {
| ^~~~~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp: In function 'void Kokkos::parallel_for(const string&, const ExecPolicy&, const FunctorType&) [with ExecPolicy = Kokkos::MDRangePolicy<Kokkos::Rank<3, Kokkos::Iterate::Default, Kokkos::Iterate::Default> >; FunctorType = __nv_hdl_wrapper_t<false, false, __nv_dl_tag<void (scream::MAMOptics::)(double), &scream::MAMOptics::run_impl, 2>, void(int, int, int), const Kokkos::View<double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, const double, const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, const Kokkos::View<int*, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, const double, const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, const Kokkos::View<double***, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> > >; Enable = void]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp:133:1: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
133 | inline void parallel_for(const std::string& str, const ExecPolicy& policy,
| ^~~~~~~~~~~~
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4, F5, F6, F7, F8>::manager::do_copy(void*) [with Lambda = scream::p3::check_values_f(scream::Real*, scream::Real*, ekat::Int, ekat::Int, ekat::Int, bool, ekat::Int, scream::Real*)::<lambda(const MemberType&)>; Tag = __nv_dl_tag<void ()(double, double*, int, int, int, bool, int, double*), scream::p3::check_values_f, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F2 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F3 = int; F4 = int; F5 = int; F6 = bool; F7 = int; F8 = Kokkos::View<double*, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<1> >]':
nvcc_internal_extended_lambda_implementation:482:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4, F5, F6, F7, F8>::manager::do_copy(void*) [with Lambda = scream::p3::check_values_f(scream::Real*, scream::Real*, ekat::Int, ekat::Int, ekat::Int, bool, ekat::Int, scream::Real*)::<lambda(const MemberType&)>; Tag = __nv_dl_tag<void ()(double, double*, int, int, int, bool, int, double*), scream::p3::check_values_f, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F2 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F3 = int; F4 = int; F5 = int; F6 = bool; F7 = int; F8 = Kokkos::View<double*, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<1> >]':
nvcc_internal_extended_lambda_implementation:482:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4, F5, F6, F7, F8, F9, F10, F11, F12, F13, F14, F15, F16, F17, F18, F19>::manager::do_copy(void*) [with Lambda = scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::p3_main_internal(const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3Runtime&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3PrognosticState&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3DiagnosticInputs&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3DiagnosticOutputs&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3Infrastructure&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3HistoryOnly&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3LookupTables&, const WorkspaceManager&, ekat::Int, ekat::Int, const scream::physics::P3_Constants&)::<lambda(const MemberType&)>; Tag = __nv_dl_tag<int ()(const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3Runtime&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3PrognosticState&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3DiagnosticInputs&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3DiagnosticOutputs&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3Infrastructure&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3HistoryOnly&, const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3LookupTables&, const ekat::WorkspaceManager<ekat::Pack<double, 1>, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >&, int, int, const scream::physics::P3_Constants&), scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::p3_main_internal, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const ekat::WorkspaceManager<ekat::Pack<double, 1>, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >; F2 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3DiagnosticInputs; F3 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3Infrastructure; F4 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3PrognosticState; F5 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3DiagnosticOutputs; F6 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3HistoryOnly; F7 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F8 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F9 = Kokkos::View<ekat::Pack<double, 1>, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F10 = Kokkos::View<bool, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F11 = const int; F12 = int; F13 = const scream::physics::P3_Constants; F14 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3Runtime; F15 = const double; F16 = const scream::p3::Functions<double, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace> >::P3LookupTables; F17 = const int; F18 = const int; F19 = const int]':
nvcc_internal_extended_lambda_implementation:745:19: note: the layout of aggregates containing vectors with 2-byte alignment has changed in GCC 5
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/physics/mam/eamxx_mam_aci_functions.hpp: In static member function 'static void
__nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4, F5, F6, F7, F8>::manager::do_copy(void*) [with Lambda = scream::_GLOBAL__N__62e75071_35_eamxx_mam_aci_process_interface_cpp_59b60e8b::store_liquid_cloud_fraction(haero::ThreadTeamPolicy, const scream::mam_coupling::DryAtmosphere&, scream::MAMAci::const_view_2d, scream::MAMAci::const_view_2d, int, int, scream::MAMAci::view_2d, scream::MAMAci::view_2d)::<lambda(const ThreadTeam&)>; Tag = __nv_dl_tag<void ()(Kokkos::TeamPolicyKokkos::Cuda, const scream::mam_coupling::DryAtmosphere&, Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, int, int, Kokkos::View<double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >, Kokkos::View<double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >), scream::_GLOBAL__N__62e75071_35_eamxx_mam_aci_process_interface_cpp_59b60e8b::store_liquid_cloud_fraction, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const int; F2 = const int; F3 = Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F4 = Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F5 = Kokkos::View<double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F6 = const Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F7 = Kokkos::View<double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >; F8 = const Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx/src/physics/mam/eamxx_mam_aci_functions.hpp:179:933: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
179 | Kokkos::parallel_for(
| ^
[ 63%] Linking CXX static library libdiagnostics.a
[ 63%] Built target diagnostics
[ 63%] Linking CXX static library libshoc_sk.a
[ 63%] Built target shoc_sk
gmake[1]: *** [CMakeFiles/Makefile2:3326: src/share/io/CMakeFiles/scream_io.dir/all] Error 2
gmake[1]: *** Waiting for unfinished jobs....
[ 64%] Linking CXX static library libshoc.a
[ 64%] Built target shoc
[ 64%] Linking CXX static library libp3_sk.a
[ 64%] Built target p3_sk
[ 64%] Linking CXX static library libmam.a
[ 64%] Built target mam
[ 64%] Linking CXX static library libp3.a
[ 64%] Built target p3
[ 64%] Linking CXX static library libnudging.a
[ 64%] Built target nudging
nvcc_internal_extended_lambda_implementation: In static member function 'static void
__nv_hdl_wrapper_t<false, false, Tag, OpFuncR(OpFuncArgs ...), F1, F2, F3, F4>::manager::do_copy(void*) [with Lambda = scream::RRTMGPRadiation::run_impl(double)::<lambda(const MemberType&)>; Tag = __nv_dl_tag<void (scream::RRTMGPRadiation::*)(double), &scream::RRTMGPRadiation::run_impl, 4>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const int; F2 = const int; F3 = yakl::Array<double, 2, 1, 2>; F4 = Kokkos::View<const double**, Kokkos::LayoutRight, Kokkos::Device<Kokkos::Cuda, Kokkos::CudaSpace>, Kokkos::MemoryTraits<0> >]':
nvcc_internal_extended_lambda_implementation:690:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
[ 64%] Linking CXX static library libscream_rrtmgp.a
[ 64%] Built target scream_rrtmgp
gmake: *** [Makefile:166: all] Error 2

Error(s) occurred during test phase
OVERALL STATUS: FAIL
Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5935/scream/components/eamxx
weaver failed
######################################################
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash -le

cd $WORKSPACE/${BUILD_ID}/

./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins15936972461945677666.sh
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Sending e-mails to: [email protected]
Finished: FAILURE

@AaronDonahue
Copy link
Contributor

@bartgol this looks like it hit a number of fails both building on weaver and CIME based tests on mappy. Is it possible our mappy testing all has a frequency < dt and therefore is triggering the new error?

jgfouca
jgfouca previously approved these changes Jul 25, 2024
@bartgol bartgol dismissed stale reviews from jgfouca and mahf708 via 2ed55ac July 26, 2024 18:11
@bartgol
Copy link
Contributor Author

bartgol commented Jul 26, 2024

@AaronDonahue no, the fails were all build errors. Should be fixed now.

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5716
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 2ed55ac
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5950
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 2ed55ac
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)
  • Branch: bartgol/eamxx-add-io-time-check
  • SHA: 2ed55ac
  • Mode: TEST_REPO

Pull Request Author: bartgol

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5716
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 2ed55ac
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5950
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 2ed55ac
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM
SCREAM_PullRequest_Autotester_Mappy # 5716 FAILED (click to see last 100 lines of console output)

416:shoc_p3_nudged
417:shoc_p3_nudged_remapped
418:shoc_p3_nudging_glob_novert
419:homme_shoc_cld_p3_rrtmgp_np1
420:homme_shoc_cld_p3_rrtmgp_np2
421:homme_shoc_cld_p3_rrtmgp_np3
422:homme_shoc_cld_p3_rrtmgp_np4
423:homme_shoc_cld_p3_rrtmgp_np2_vs_np1
424:homme_shoc_cld_p3_rrtmgp_np3_vs_np1
425:homme_shoc_cld_p3_rrtmgp_np4_vs_np1
426:homme_shoc_cld_p3_rrtmgp_baseline_cmp
427:homme_shoc_cld_p3_rrtmgp_pg2_np1
428:homme_shoc_cld_p3_rrtmgp_pg2_np2
429:homme_shoc_cld_p3_rrtmgp_pg2_np3
430:homme_shoc_cld_p3_rrtmgp_pg2_np4
431:homme_shoc_cld_p3_rrtmgp_pg2_np2_vs_np1
432:homme_shoc_cld_p3_rrtmgp_pg2_np3_vs_np1
433:homme_shoc_cld_p3_rrtmgp_pg2_np4_vs_np1
434:homme_shoc_cld_p3_rrtmgp_pg2_baseline_cmp
439:homme_shoc_cld_spa_p3_rrtmgp_np1
440:homme_shoc_cld_spa_p3_rrtmgp_np2
441:homme_shoc_cld_spa_p3_rrtmgp_np3
442:homme_shoc_cld_spa_p3_rrtmgp_np4
443:homme_shoc_cld_spa_p3_rrtmgp_np2_vs_np1
444:homme_shoc_cld_spa_p3_rrtmgp_np3_vs_np1
445:homme_shoc_cld_spa_p3_rrtmgp_np4_vs_np1
446:homme_shoc_cld_spa_p3_rrtmgp_baseline_cmp
447:homme_shoc_cld_spa_p3_rrtmgp_128levels_np1
448:homme_shoc_cld_spa_p3_rrtmgp_128levels_np2
449:homme_shoc_cld_spa_p3_rrtmgp_128levels_np3
450:homme_shoc_cld_spa_p3_rrtmgp_128levels_np4
451:homme_shoc_cld_spa_p3_rrtmgp_128levels_np2_vs_np1
452:homme_shoc_cld_spa_p3_rrtmgp_128levels_np3_vs_np1
453:homme_shoc_cld_spa_p3_rrtmgp_128levels_np4_vs_np1
454:homme_shoc_cld_spa_p3_rrtmgp_128levels_tend_check_np1
455:homme_shoc_cld_spa_p3_rrtmgp_128levels_tend_check_np2
456:homme_shoc_cld_spa_p3_rrtmgp_128levels_tend_check_np3
457:homme_shoc_cld_spa_p3_rrtmgp_128levels_tend_check_np4
458:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
459:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np1
460:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np2
461:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np3
462:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np4
463:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np2_vs_np1
464:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np3_vs_np1
465:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np4_vs_np1
466:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_baseline_cmp
467:homme_shoc_cld_p3_mam_optics_rrtmgp_np1
468:homme_shoc_cld_p3_mam_optics_rrtmgp_np2
469:homme_shoc_cld_p3_mam_optics_rrtmgp_np3
470:homme_shoc_cld_p3_mam_optics_rrtmgp_np4
471:homme_shoc_cld_p3_mam_optics_rrtmgp_np2_vs_np1
472:homme_shoc_cld_p3_mam_optics_rrtmgp_np3_vs_np1
473:homme_shoc_cld_p3_mam_optics_rrtmgp_np4_vs_np1
474:homme_shoc_cld_p3_mam_optics_rrtmgp_baseline_cmp
  SCREAM V1 TESTING FAILED!
Waiting for tests to finish
PASS ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 RUN
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240729_124248_1bs7nw
FAIL ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase RUN)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20240729_124248_1bs7nw
FAIL ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase RUN)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20240729_124248_1bs7nw
FAIL ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase RUN)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20240729_124248_1bs7nw
FAIL ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu (phase RUN)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30_ne30.F2010-SCREAMv1-DP-DYCOMSrf01.mappy_gnu.C.20240729_124248_1bs7nw
FAIL PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase RUN)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20240729_124248_1bs7nw
PASS SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci RUN
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20240729_124248_1bs7nw
PASS SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics RUN
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20240729_124248_1bs7nw
FAIL SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase RUN)
    Case dir: /ascldap/users/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20240729_124248_1bs7nw
test-scheduler took 908.8709979057312 seconds
######################################################
Build step 'Execute shell' marked build as failure
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 115064 killed;
[ssh-agent] Stopped.
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash -le

cd $WORKSPACE/${BUILD_ID}/

./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel

[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins11954673427305735711.sh
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Sending e-mails to: [email protected]
Finished: FAILURE

SCREAM_PullRequest_Autotester_Weaver # 5950 FAILED (click to see last 100 lines of console output)

90:mam4_optics_standalone_np1
91:mam4_optics_standalone_baseline_cmp
92:mam4_aci_standalone_np1
93:mam4_aci_standalone_baseline_cmp
94:shoc_p3_subcycled
95:shoc_p3_monolithic
96:check_subcycling
97:check_subcycling_tend_check
99:shoc_p3_source
100:shoc_p3_nudged
101:shoc_p3_nudged_remapped
102:shoc_p3_nudging_glob_novert

Build type release failed at testing time. Here's a list of failed tests:
3:io_basic_np1
4:io_monthly_np1
5:io_filled_np1
7:io_diags_np1
8:io_se_grid_np1
9:output_restart_np1
10:output_restart_check_INSTANT_np1
11:output_restart_check_AVERAGE_np1
12:io_remap_test_np1
25:time_interpolation_np1
48:nudging_data
50:nudging_tests_np1
80:homme_standalone_np1
81:homme_standalone_baseline_cmp
82:p3_standalone_np1
83:p3_tend_check_np1
84:p3_standalone_baseline_cmp
85:shoc_standalone_np1
86:shoc_tend_check_np1
87:check_U_V_slices_np1
88:check_surf_mom_flux_slices_np1
89:shoc_standalone_baseline_cmp
90:check_U_V_slices_fail_diff
91:check_U_V_slices_fail_layout
92:check_U_V_slices_fail_missing
94:spa_standalone_np1
95:spa_standalone_baseline_cmp
96:surface_coupling_np1
98:rrtmgp_standalone_not_chunked_np1
100:rrtmgp_standalone_chunked_vs_not_chunked
102:cosp_standalone_np1
103:cosp_standalone_baseline_cmp
104:mam4_optics_standalone_np1
105:mam4_optics_standalone_baseline_cmp
106:mam4_aci_standalone_np1
107:mam4_aci_standalone_baseline_cmp
108:shoc_cld_p3_rrtmgp_np1
109:shoc_cld_spa_p3_rrtmgp_np1
110:mam_optics_rrtmgp_np1
111:shoc_mam4_aci_np1
112:shoc_cldfrac_mam4_aci_p3_np1
113:shoc_cldfrac_mam4_aci_p3_rrtmgp_np1
114:shoc_cldfrac_mam4_aci_p3_mam4_optics_rrtmgp_np1
115:shoc_p3_subcycled
116:shoc_p3_monolithic
117:check_subcycling
118:check_subcycling_tend_check
120:shoc_p3_source
121:shoc_p3_nudged
122:shoc_p3_nudged_remapped
123:shoc_p3_nudging_glob_novert
124:homme_shoc_cld_p3_rrtmgp_np1
125:homme_shoc_cld_p3_rrtmgp_baseline_cmp
126:homme_shoc_cld_p3_rrtmgp_pg2_np1
127:homme_shoc_cld_p3_rrtmgp_pg2_baseline_cmp
132:homme_shoc_cld_spa_p3_rrtmgp_np1
133:homme_shoc_cld_spa_p3_rrtmgp_baseline_cmp
134:homme_shoc_cld_spa_p3_rrtmgp_128levels_np1
135:homme_shoc_cld_spa_p3_rrtmgp_128levels_tend_check_np1
136:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
137:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_np1
138:homme_shoc_cld_spa_p3_rrtmgp_pg2_dp_baseline_cmp
139:homme_shoc_cld_p3_mam_optics_rrtmgp_np1
140:homme_shoc_cld_p3_mam_optics_rrtmgp_baseline_cmp

Error(s) occurred during test phase
OVERALL STATUS: FAIL
Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5950/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5950/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/5950/scream/components/eamxx
weaver failed
######################################################
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash -le

cd $WORKSPACE/${BUILD_ID}/

./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins6282453726282157921.sh
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Sending e-mails to: [email protected]
Finished: FAILURE

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5721
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5955
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)
  • Branch: bartgol/eamxx-add-io-time-check
  • SHA: 846e504
  • Mode: TEST_REPO

Pull Request Author: bartgol

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5721
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5955
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pre-Merge Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
THE LAST COMMIT TO THIS PULL REQUEST HAS NOT BEEN REVIEWED YET!

@E3SM-Bot
Copy link
Collaborator

All Jobs Finished; status = PASSED, target_sha=308996be7151e6b08edf5c9a3d2e7925a001a806, However Inspection must be performed before merge can occur...

@E3SM-Bot
Copy link
Collaborator

The base branch has been updated since the last successful testing.

  • last PASS base branch sha: 308996b
  • current base branch sha : 5e7b019
    The AutoTester will discard the last PASS, and re-test the PR from scratch

Copy link
Contributor

@mahf708 mahf708 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5727
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5958
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)
  • Branch: bartgol/eamxx-add-io-time-check
  • SHA: 846e504
  • Mode: TEST_REPO

Pull Request Author: bartgol

@E3SM-Bot
Copy link
Collaborator

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

  • Build Num: 5727
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

  • Build Num: 5958
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PR_LABELS BFB;I/O;AT: AUTOMERGE;code usability
PULLREQUESTNUM 2919
SCREAM_SOURCE_REPO https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA 846e504
SCREAM_TARGET_BRANCH master
SCREAM_TARGET_REPO https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA a1b89eb
TEST_REPO_ALIAS SCREAM

@E3SM-Bot E3SM-Bot merged commit 9d845ad into master Jul 30, 2024
14 checks passed
@E3SM-Bot E3SM-Bot deleted the bartgol/eamxx-add-io-time-check branch July 30, 2024 14:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

IO doesn't O if freq < timestep
5 participants