...
| Anchor | ||||
|---|---|---|---|---|
|
In your repository directory, create a 'grids' subdirectory.
On casper start the VRM Editor from your $REPO/grids directory:
> cd $REPO/grids
> /glade/work/emmons/tutorial_Nanjing/VRM_tools/VRM_Editor/src/VRM_Editor
If you are working on a different computer, download the VRM_tools software by running:
...
Get and build VRM Tools: VRM_Editor and Create_VRMgrid
On casper, download the VRM Tools software:
{navigate to your home or work directory}
> git clone https://github.com/ESMCI/Community_Mesh_Generation_Toolkit.git
> cd Community_Mesh_Generation_Toolkit
> git checkout VRMtools_MCT_v1.0
In the instructions below, $(VRM_tools) = {your_path}/
...
Community_Mesh_Generation_Toolkit
...
/VRM_tools
> cd ${VRM_tools}/VRM_Editor/src
> module load gcc/12.2.0
> module load ncarenv/23.10
> qmake VRM_Editor.pro
> make
Running "make" produces a lot of warning messages; that’s ok. For Linux users, with the Qt and netCDF packages installed, building the editor should be as simple as for Casper.
Build Create_VRMgrid on Casper:
> cd Community_Mesh_Generation_Toolkit/VRM_tools/VRM_Editor/src
> module load gnu
> make -f Makefile-Create_VRMgrid
Instructions on using it are provided below.
Start VRM_Editor
In your repository directory, create a 'grids' subdirectory. On casper start the VRM Editor from your $REPO/grids directory:
> cd $REPO/grids
> ${VRM_tools}/VRM_Editor/src/VRM_Editor
Set up base grid
On the ‘VRM’ tab, select:
- Grid Type: CubeSquared
- Base Resolution: 30
- Click Generate VarMesh. See image below for what it should look like.
Adjust
and follow instructions in the documentation.
Set up the base grid
On the ‘VRM’ tab, select:
- Grid Type: CubeSquared
- Base Resolution: 30
- Click Generate VarMesh. See image below for what it should look like.
Adjust Longitude Shift, Rotate-X and Rotate-Y so that your region of interest is centered within a cube face. You can zoom in/out by using the scroll button of your mouse. The right and left arrow keys move the map sideways; up/down to shift the map N/S.
For example, set Longitude Shift to 30 and Rotate-X to 25, then click Generate VarMesh, to produce grid shown below.
When satisfied with the face location, record the Longitude Shift, Rotate-X and Rotate-Y values (you will need them later).
Create draft refinement region
The default resolution of the Editor map is a bit coarse, so read in a higher resolution map. In the "Actions" menu (upper left), select Read Refinement Map.
Open /glade/work/emmons/Community_Mesh_Generation_Toolkit_Nov23/VRM_tools/VRM_Editor/src/REFMAP_1440x720.nc. For easier access, copy this file to your working directory.
On the ‘Edit’ tab, click ‘Edit refine Map’.
Select ‘Polygon Editor’ - a green box appears over the Pacific. Drag and adjust the 8 points to create a refinement region. Use the scroll button of your mouse to zoom in and out, and the arrow keys to shift the map. Try to have the polygon borders be parallel to the grid lines.
Click ‘Apply’ (with Value =1.00)
To save this, click 'Exit Edit Mode' and 'Yes' to save.
Go to 'Display' tab, check Refinement Map to see the refined region as a red box.
Go back to ‘VRM’ tab. For best results (in many cases), the following settings are recommended:
so that your region of interest is centered within a cube face. You can zoom in/out by using the scroll button of your mouse. The right and left arrow keys move the map sideways; up/down to shift the map N/S.
For example, set Longitude Shift to 30 and Rotate-X to 25, then click Generate VarMesh, to produce grid shown below.
When satisfied with the face location, record the Longitude Shift, Rotate-X and Rotate-Y values (you will need them later).
Create draft refinement region
The default resolution of the Editor map is a bit coarse, so read in a higher resolution map. In the "Actions" menu (upper left), select Read Refinement Map.
Open /glade/work/emmons/Community_Mesh_Generation_Toolkit_Nov23/VRM_tools/VRM_Editor/src/REFMAP_1440x720.nc. For easier access, copy this file to your working directory.
On the ‘Edit’ tab, click ‘Edit refine Map’.
Select ‘Polygon Editor’ - a green box appears over the Pacific. Drag and adjust the 8 points to create a refinement region. Use the scroll button of your mouse to zoom in and out, and the arrow keys to shift the map. Try to have the polygon borders be parallel to the grid lines.
Click ‘Apply’ (with Value =1.00)
To save this, click 'Exit Edit Mode' and 'Yes' to save.
Go to 'Display' tab, check Refinement Map to see the refined region as a red box.
Go back to ‘VRM’ tab. For best results (in many cases), the following settings are recommended:
- Refine Type = LOWCONN
- Select Refine Level (1 = ~0.5 deg, 2=0.25 deg, 3=⅛ deg=14km, …). Resolution in the refined region is the base grid resolution divided by 2^(refinement level)
- Refine Type = LOWCONN
- Select Refine Level (1 = ~0.5 deg, 2=0.25 deg, 3=⅛ deg=14km, …). Resolution in the refined region is the base grid resolution divided by 2^(refinement level)
- Smoothing Options: Spring, with Iterations = 3, Length = 3
...
If making a refined region with the finest resolution ne120a refine level =2 (resolution ne120), then make one halo with Value=0.5.
When satisfied with the halos, Exit Edit Mode, Yes to save, and go back to VRM tab. With the same settings as above used before (LOWCONN, Refine lev level =3, etc.), click Generate VarMesh:
...
The halos can be adjusted repeatedly in the Edit menu until satisfied with the grid. You can try "CUBIT" instead of "LOWCONN" to see if that is more appropriate for your application.
Once the grid is at least close to what you want proceed to steps below.
1) Save the Refinement Map - under the Actions menu. This writes a netcdf file of the map of refinement values (0 for no refinement, 1 for maximum refinement). Save the files as something like: REFMAP_Nanjing_ne30x8.nc.
Save frequently as the VRM Editor on the Mac tends to crash. You can then restart the Editor, Read the refinement later Refinement Map and start adjusting the grid from that point.
Also, make note of any Longitude Shift and Rotate-X, -Y values as those are not saved in the Refinement map Map file.
2) Write EXODUS File: If you are happy with your grid, under Actions: Write Exodus File - give it a name like Nanjing_ne30x8_EXODUS.nc.
If you want to make further manual edits to your grid, as described below, do not save the EXODUS file.
3) Write Refinement Grid - for manual editing of refinement region and halos
...
Once you have a rough version of your grid, save a the Refinement Grid - in the Actions menu, select 'Write Refinement Grid'.
...
(be sure this is all on one line)
For this example:
> /glade/derechowork/scratch/emmons/nanjingtutorial_musicaNanjing/VRM_tutorial> /glade/work/emmons/tutorial_Nanjing/VRM_tools/VRM_tools/VRM_Editor/src/Create_VRMgrid --refine_type "LOWCONN" --grid_type "CubeSquared" --resolution 30 --refine_level 3 --smooth_type "SPRING" --smooth_dist 3 --smooth_iter 3 --x_rotate 25 --y_rotate 0 --lon_shift 30 --refine_file REFMAP_Nanjing_ne30x8.nc --refine_cube RefGrid_Nanjing_ne30x8.dat --output Nanjing_ne30x8_EXODUS.nc
Plot EXODUS file with /glade/u/home/emmons/tutorial_Nanjing_notebooks/plotting/Plot_exodus_grid.ipynb
| Anchor | ||||
|---|---|---|---|---|
|
...
Create SCRIP and LATLON grid files from EXODUS file
On casper: build Gen_ControlVolumes.exe; be sure to use the gnu (gcc) compiler.
> cd $REPO/grids> cp /glade/work/emmons/tutorial_Nanjing/$(VRM_tools)/VRM_ControlVolumes/src/input.nl input-Nanjing.nl
> module load gcc
> make
> module load intel
> cd $REPO/grids> cp ${VRM_tools}/VRM_ControlVolumes/src/input.nl input-Nanjing.nl
Edit input-NanjingEdit input-Nanjing_ne30x8.nl to have your path to $REPO/grids and the grid name.
Then run Gen_ControlVolumes:
> /glade/work/emmons/tutorial_Nanjing/${VRM_tools}/VRM_ControlVolumes/src/Gen_ControlVolumes.exe input-Nanjing.nl > LOG_Nanjing
This produces the SCRIP file: Nanjing_ne30x8_np4_SCRIP.nc which is used for further regridding steps, as well as for plotting your final model output on the native grid.
A "LATLON" file is also produced: Nanjing_ne30x8_ and Nanjing_ne30x8_np4_LATLON.nc
If you do not see these files, check LOG_Nanjing for errors.
Examine the LATLON file to get the number of columns in your new grid:
...
In the directory with your SCRIP file ($REPO/grids), run (be sure all on one line):
> /glade/u/apps/casper/23.10/spack/opt/spack/esmf/8.5.0/mpi-serial/2.3.0/oneapi/2023.2.1/dfkx/bin/ESMF_Scrip2Unstruct Nanjing_ne30x8_np4_SCRIP.nc Nanjing_ne30x8_np4_MESH.nc 0
Note the 0 at the end.
This creates the ESMF mesh file: Nanjing_ne30x8_np4_MESH.nc
...
To keep with previous conventions for the structure of your new grid repository create directories inic, maps, atmsrf and topo in your repository:
> cd $REPO
> mkdir inic
> mkdir maps
> mkdir maps
> mkdir atmsrf
> mkdir topo
The files created below are generally labeled with today's date. Even if you make files on different days, all the files in one repository should have the same date (YYMMDD).
Regrid CAM IC file
atmsrf
> mkdir topo
The files created below are generally labeled with today's date. Even if you make files on different days, all the files in one repository should have the same date (YYMMDD).
Regrid CAM IC file
The resulting file is assigned to ncdata in user_nl_cam.
This script uses the interpic program provided in CESM source code, but must first be compiled. If you do not already have CESM code, see "Set up CESM3" below.
On casper, in CESM source code, ./components/cam/tools/interpic_new:
Edit Makefile:
l.15 from: LIB_NETCDF := /usr/local/lib
to: LIB_NETCDF := $(NETCDF)/lib
l.18 from: INC_NETCDF := /usr/local/include
to: INC_NETCDF := $(NETCDF)/include
l.99 from: LDFLAGS = -L$(LIB_NETCDF) -lnetcdf
to: LDFLAGS = -L$(LIB_NETCDF) -lnetcdff -lnetcdf
Currently Loaded Modules:
1) ncarenv/23.10 (S) 2) intel/2023.2.1 3) ncarcompilers/1.0.0 4) hdf5/1.12.2 5) netcdf/4.9.2
> gmakeThis should have created the executable ‘interpic’. Alternatively, the instructions below use an existing executable available on casperThe resulting file is assigned to ncdata in user_nl_cam.
> cd $REPO/inic
> cp /glade/work/emmons/tutorial_Nanjing/VRM_tools/gen_CAMncdata/TEMPLATES/interpic_script_TEMPLATE.sh interpic_script_Nanjing.sh
> vi interpic_script_Nanjing.sh
Edit the script to point to your grid files. This template includes the path to an existing executable of interpic, which is available in the CESM source code.
# USER CHANGES
VRdate="YYMMDD"
VRgridName="ne0np4.NAME.ne30xR"
VRgridLabel="NAME_RESOL"
VRrepoPath="your_repo_path"
# end of USER CHANGES
...
Check there are no errors in the log file. This should have created an ic file with the dimensions of your new grid: cami-mam4_0000-01-01_ne0np4.Nanjing.ne30x8_L32_c240809.ncwith the dimensions of your new grid: cami-mam4_0000-01-01_ne0np4.Nanjing.ne30x8_L32_c240809.nc
On your own computer, you can find ${VRM_tools}/gen_CAMncdata/TEMPLATES/interpic_script_TEMPLATE.sh, and use the interpic executable that you created. You can start with any *.cam.i.* file that you have available.
Regrid 'atmsrf' file
The resulting file is assigned to drydep_srf_file in user_nl_cam.
Copy On casper: copy the template script to your working directory and edit for your grid. Be sure directory $REPO/maps exists.
...
Check there are no errors in the log file. This writes atmsrf_ne0np4.Nanjing.ne30x8_240809.nc.
On your own computer: find ${VRM_tools}/gen_atmsrf/TEMPLATES/gen_atmsrf_TEMPLATE.ncl
Create Topography file
The resulting file is assigned to bnd_topo in user_nl_cam.
...
Can add option --output_data_directory to specify location of final topography file (be sure it the directory already exists).
This can take several hours.
...
(npl) > /glade/work/emmons/cesm_src_derecho/ctsm5.2.007/tools/mksurfdata_esmf/gen_mksurfdata_namelist --res Nanjingres Nanjing_ne30x8 --start-year 1979 --end-year 2026 --ssp-rcp SSP3-7.0 --model-mesh /glade/work/emmons/tutorial_Nanjing/ne0np4.Nanjing.ne30x8/grids/Nanjing_ne30x8_np4_MESH.nc --model-mesh-nx 60482 --model-mesh-ny 1
This creates files like: landuse_timeseries_SSP3-7.0_1979-2026_78pfts.txt and surfdata_Nanjing_ne30x8_SSP3-7.0_1979_78pfts_c240809.namelist.
...
This creates the netcdf files that will be used in your simulation, specified in user_nl_clm: fsurdat = '/repo_path/land/surfdata_ ... .nc' and flanduse_timeseries = '/repo_path/land/landuse.timeseries_ ... .nc'. In your $REPO, create a directory 'land' (mkdir $REPO/land) and copy these 2 nc files to it.
> conda deactivate
| Anchor | ||||
|---|---|---|---|---|
|
...