Versions Compared

Old Version 8

changes.mady.by.user Ashley Griffin

Saved on

compared with

New Version 9

changes.mady.by.user Francois Hebert

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • PI only
  • Requires NOAA RDHPCs account
Table of Contents

Table of Contents

Instructions for setting up clusters (every time and one-time only)

...

  1. Log into https://noaa.parallel.works/ with case-sensitive NOAA ID and password
  2. Warning! The large green on/off buttons next to the storage and compute resources turn the shared resources on/off with little or no warning!
  3. Upload your public SSH key: click on your name on the top right → Account → Authentication → Add SSH Key; this key is then available for all clusters
  4. Log in: ssh [-i private_key_if_not_default] User.Name@IP
  5. IP gcloud: 34.172.131.70 (after logging in, you’re on gclusternoaav2usc1c2dv2-8)
  6. After logging in, check if X forwarding works: xclock 
  7. Set up necessary modules
    Code Block
    module purge
module unuse /opt/cray/craype/default/modulefiles
module unuse /opt/cray/modulefiles
module use /contrib/spack-stack/modulefiles
module load cmake/3.27.2
module load ecflow/5.8.4
module load git-lfs/2.4.1

  8. Run a few basic sanity checks and one-offs
    Code Block
    ecflow_ui
git lfs install --skip-repo
git config --global credential.helper store
git config --global user.name "Your Name"
git config --global user.email "your.email@domain.com"
# Create your .aws/{config,credentials} as per jedi-docs

  9. Set up Skylab root directory and script
    Code Block
    cd /lustre
mkdir -p skylab_user.name
cd /lustre/skylab_user.name
git clone https://github.com/jcsda-internal/jedi-tools
ln -sf jedi-tools/buildscripts/setup.sh .

# Edit setup script:
JEDI_ROOT=/lustre/skylab_user.name
HOST=pw-gcloud
COMPILER=intel
# Further down (in section `Load JEDI modules`) update the FMS version
module unload fms/release-jcsda
module load fms/202304

# Sourcing setup.sh will create your venv if it doesn’t exist
source setup.sh

  10. Build and run ctests
    Code Block
    # Build everything - change branch names as needed in the script
./jedi-tools/buildscripts/build_skylab.sh 2>&1 | tee build_skylab.log

# Run ctest on login node if so desired
cd build 
ctest 2>&1 | tee log.ctest

  11. Run your experiments

...