https://svn-ccsm-models.cgd.ucar.edu/cam1/trunk_tags/cam3_6_61
Need modified versions of models/atm/cam/bld/namelist_files: namelist_defaults_cam.xml, namelist_definitions.xml that register namelist variable nu_q; available on NCAR goldhill file system in ~mirin/namelist_register.
./configure -phys cam3_5_1 -spmd -nosmp -dyn homme -hgrid ne16np4
Must reference netcdf, p-netcdf, lapack. Instructions for jaguar are below.
Code successfully executed in aqua-planet mode on jaguar for one simulated day. (Did not create history files nor attempt to restart.)
https://svn-ccsm-models.cgd.ucar.edu/cam1/branches/homme_cam3_6_39
./configure -phys cam3_5_1 -spmd -nosmp -dyn homme -hgrid ne16np4 -pnc_lib /contrib/pnetcdf/lib -pnc_include /contrib/pnetcdf/include
CAM3_6_39 (includes everything from 3_6_32 below) and:
1 scheduled for CAM trunk (maybe 3_6_51)
2 requres pio51_prod: run "cd models/utils/pio ;
svn switch https://svn-ccsm-models.cgd.ucar.edu/pio/trunk_tags/pio51_prod/pio"
https://svn-ccsm-models.cgd.ucar.edu/cam1/branches/homme_cam3_6_32
./configure -phys cam3_5 -spmd -nosmp -dyn homme -hgrid ne16np4 -pnc_lib /contrib/pnetcdf/lib -pnc_include /contrib/pnetcdf/include
CAM3_6_32 plus the following patches:
-fc ifort -nc_inc /home/mataylo/netcdf/tbird-intel/include -nc_lib /home/mataylo/netcdf/tbird-intel/lib -pnc_inc /home/mataylo/pnetcdf/tbird-intel/include -pnc_lib /home/mataylo/pnetcdf/tbird-intel/lib -ldflags "-L/usr/lib -llapack -lmpi_f77" -cppdefs "-DNO_MPIINPLACE -DNO_MPI2" -mpi_inc $MPIHOME/include -mpi_lib $MPIHOME/lib
Also, edit the Makefile and add -DLLNL_PELOTON to get "use pio" fixes for Intel ifort
-pnc_inc /soft/apps/parallel-netcdf-1.0.2/include -pnc_lib /soft/apps/parallel-netcdf-1.0.2/lib -nc_inc /soft/apps/netcdf-3.6.2/include -nc_lib /soft/apps/netcdf-3.6.2/lib -target_os bgp
And then change "-lblas_bgp" to "-lblas" in the Makefile.
module load netcdf/3.6.2 (more recent version should work)
module load p-netcdf/1.0.3
module load lapack
setenv LAPACK_LIBDIR /sw/xt5/lapack/3.1.1/cnl2.1_pgi8.0.3/lib (update according to value of LAPACK_LIB)
-fc ftn -cc cc -ldflags '-L$LAPACK_LIBDIR -llapack'
ifneq ($(strip $(LIB_PNETCDF)),)
CPPDEF += -D_PNETCDF -DUSEMPIIO -DPIO_LUSTRE_HINTS
USER_LDFLAGS += -L$(LIB_PNETCDF) -lpnetcdf
endif
NOTE: latest (2009) version of Lustre (Installed on LLNL's Dawn, maybe JaguarPF?) does not require this setting, and will perform much better if this setting is not used.
./build-namelist -namelist "&camexp aqua_planet=.true. /" -csmdata /fs/cgd/csm/inputdata
On jaguar, csmdata directory is /tmp/proj/ccsm/inputdata.
If using build-namelist utility, must provide values for bndtvs, focndomain, fatmlndfrc, fatmgrid, fsurdat, faerdep; these are not used in aqua_planet mode so any value will suffice.
use CAM 3.4.10 physics ( currently not possible with CAM 3.5+)
CH4VMR = 1.650e-6
N2OVMR = 0.306e-6
CO2VMR = 3.480e-4
use symmetric ozone data:
bndtvo = /ptmp/jedwards/cam-tests/testdata/hommeapeozone.nc
in drv_in, timemgr_inparm orbital parameters:
orb_ECCEN = 0.
orb_OBLIQ = 0.
orb_MVELP = 0.
dtime = 360
(and also in drv_in, atm_cpl_dt = 360)
Note: for benchmarking runs, we use dtime=1800.
bndtvaer = AerosolMass_V_ne16np4_clim_c071213.nc
ncdata = cami_0000-01-01_ne16np4_L26_ape_c071213.nc
Note1: need to add instructions on how to compute these
Note2: for now, Mark will generate 1 and 2 degree files and store on bluefire_
phys_loadbalance = -1
homme_ne = 16
homme_nsplit = 2 ( dtime/180)
dtime = 360
nu = 1e16
nu_q = 1e16
homme_ne = 30
homme_nsplit = 4 (dtime/90)
nu = 1e15
nu_q = 1e15
homme_ne = 60
homme_nsplit = 40 (dtime/45)
nu = 1e15
nu_q = 1e15
Note: The high-res settings below require changing dtime so that nsplit<=45. Larger values of nsplit have trouble with our out-of-balance initial condition. They may be possible if we use a spun-up initial condition file.
dtime = 900
homme_ne = 120
homme_nsplit = 45 (dtime/20)
nu = 1.5e13
nu_q = 1.5e13
dtime = 450
homme_ne = 240
homme_nsplit = 45 (dtime/10)
nu = 2e12
nu_q = 2e12
NDENS = 2,2,2,2,2
MFILT = 1,120,720,5
NHTFRQ = -720,-6,-1,-144
FINCL1 = 'DUV ','DVV ',
'ZMDQ ','ZMDT ','TT ','ZZ ',
'OMEGAU ','VZ ',
'DCCLDLIQ','DCCLDICE'
FEXCL1 = 'DISED ','DLSED ','DQSED ','EVAPPREC','EVAPSNOW',
'HEVAP ','HKEIHEAT','HKFLXPRC',
'HKFLXSNW','HKNTPRPD','HKNTSNPD','HMELT ','HPROGCLD',
'HREPART ','HSED ','PCSNOW ','PRECSC ',
'PRECSED ','PRECSL ','PRODPREC','RAINSED ',
'SNOWSED ',
'TSICE ','ZMDLF ','ZMEIHEAT','ZMFLXPRC','ZMFLXSNW',
'ZMNTPRPD','ZMNTSNPD'
FINCL2 = 'PRECC ','PRECL '
FINCL3 = 'TMQ:I '
FINCL4 = 'U:I ','V:I ','PS:I '