Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to support arcticx4v1pg2_ARRM10to60E2r1 configuration #27

Conversation

apcraig
Copy link
Collaborator

@apcraig apcraig commented Oct 22, 2022

  • Update pe layout on DoD resources
  • Add default 1950 elm fsurdat dataset
  • Set NCPL to 96 for several components for this resolution

- Update pe layout on DoD resources
- Add default 1950 elm fsurdat dataset
- Set NCPL to 96 for several components for this resolution
Copy link
Owner

@darincomeau darincomeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @apcraig ! As I noted I also have the finidat file ready for the 1950 arcticx4v1 grid, so I may want to group that with the fsurfdat file together (and these should also go into the main E3SM repo). I'll revisit at the beginning of the week.

@@ -390,6 +390,7 @@
<value compset=".+" grid="a%ne1024np4">864</value>
<value compset=".+" grid="a%ne0np4_arm_x8v3" >144</value>
<value compset=".+" grid="a%ne0np4_conus_x4v1" >96</value>
<value compset=".+" grid="a%ne0np4_arcticx4v1">96</value>
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@apcraig thanks this looks like exactly what we need to set the correct coupling frequency for the arcticx4v1_ARRM10to60E2r1 configuration

@@ -231,6 +231,8 @@ lnd/clm2/surfdata_map/surfdata_ne0np4_northamericax4v1.pg2_simyr2010_c210112.nc<
lnd/clm2/surfdata_map/surfdata_arcticx4v1pg2_simyr2010_c210805.nc</fsurdat>
<fsurdat hgrid="ne0np4_arcticx4v1.pg2" sim_year="2000" use_crop=".false." >
lnd/clm2/surfdata_map/surfdata_arcticx4v1pg2_simyr2000_c210707.nc</fsurdat>
<fsurdat hgrid="ne0np4_arcticx4v1.pg2" sim_year="1950" use_crop=".false." >
lnd/clm2/surfdata_map/surfdata_arcticx4v1pg2_simyr2000_c210707.nc</fsurdat>
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've also got the finidat spunup file ready and staged.

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

^actually I see you're pointing to the 2000 year file, and we have a new 1950 one we should use here (h/t @brhillman)

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

HI @darincomeau. This is really just a place holder. It turns out, if fsurfdat is not set to something by default then case.setup fails. Separately, we generally set fsurfdat in our user_nl_files, so the default is overwritten. It's possible that you haven't noticed this problem for a number of reasons. It doesn't affect the case setup because it just causes preview_namelist to fail until user_nl_elm is placed in the case directory. And that is the last step of case.setup. Maybe also because you run the case setup script and don't notice some of the output. Anyway, this just fixes a case setup problem but is not meant to be a long term setting.

It's great that you have an finidat file and may even have a better fsurfdat file. And I welcome those being set in the scripts as defaults.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@darincomeau: you pointed me to this new finidat file: /lcrc/group/e3sm/data/inputdata/lnd/clm2/initdata/20221017.ICRUELM-1950.arcticx4v1pg2_ARRM10to60E2r1.anvil.elm.r.0051-01-01-00000.nc
Could we use this one in this PR and then merge?

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@milenaveneziani I'll do that in step 4. below, and also update fsurdat. Well, step 4 is making the PR into E3SM master, and step 5 will be to bring those changes to this branch.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that means that I will start the new simulations right after step 3 and changing finidat in my user_nl file.

@apcraig
Copy link
Collaborator Author

apcraig commented Oct 23, 2022

Maybe we should merge #26 and this PR soon. This will help us all setting up and running cases. We can do additional updates and merge master into this branch as they are ready.

Separately, we need more pe decomp files for the 10to60 Arctic grid for ice and ocean. In particular, if several files could be added for ice between 840 and 2400 pes, that would be great. And if several files could be added for ocean between 1200 and 2048, that would be helpful too. It's a bit of a challenge to load balance the model well with pe counts being limited by these files. If this grid is more or less blessed, then I'd advocate for even more decomp files, additional ice files are probably useful below 720 and between 2400 and 6000. The ocean decomp files offer pretty good coverage, although it never hurts to have more options. FYI, I believe the decomp files can be found here,

https://web.lcrc.anl.gov/public/e3sm/inputdata/ocn/mpas-o/ARRM10to60E2r1/
https://web.lcrc.anl.gov/public/e3sm/inputdata/ice/mpas-cice/ARRM10to60E2r1/

The ice files we're using are "220802" in that directory. Thanks.

@milenaveneziani
Copy link
Collaborator

@apcraig : since we are rebasing to master again, I don't think we need #26 actually.
@darincomeau: what do you think our plan is? I think we decided to forgo the waiting for v2.1 and instead go with master.

@milenaveneziani
Copy link
Collaborator

milenaveneziani commented Oct 24, 2022

From a slack conversation with Darin, here are the steps we have identified for E3SM-Arctic:

  1. merge this PR;
  2. merge cime update on Darin's cime fork;
  3. make new PR with rebase to master (which should include changes introduced in Updates to ARRM10to60E2r1 mesh #26);
  4. make new PR into E3SM master to add new land ic files for the new ARRM mesh.

@apcraig
Copy link
Collaborator Author

apcraig commented Oct 24, 2022

Sounds like a good plan. Thanks.

Copy link
Owner

@darincomeau darincomeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm going to merge this so it's in before the rebase on E3SM master.

@darincomeau darincomeau merged commit 4a5d157 into darincomeau:E3SMv2-Arctic Oct 24, 2022
darincomeau pushed a commit that referenced this pull request Sep 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants