You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 8 Next »

meeting notes by Hui Shao


OBS:

Ingest:

  • working on land converters for snow and smap consolidating and ensuring conventions and units are appropriate
  • finishing a weather-sat-followon WSF-M converter with NRL
  • also with NRL have a new contributor and have added conventions to ObsSpace.yaml for TEC and ECEF coordinates
  • finished adding error estimates and quality flags from OceanSurfaceWind products into IODA files for data from CYGNSS and Spire


UFO:

  • merged lightning flash extent density operator
  • merged last PR for EUMETSAT ROM-SAF project (thank-you MetOffice and Neill Bowler) for MeteoFrance style super refraction check
  • merged new ObsFunction from Met Office PR from ChawnHarlow to multiply and/or divide ObsDataVectors
  • merged VarBC sprint. We realized such a merge needs to be streamlined in the future (code, data, r2d2, etc) and noticed the current CI tests might not catch all potential issues. Therefore, please report any issues you may be encountering. We'll provide as much support as we can. 

JEDI:

Model Interface:

- Improving robustness of interpolators for the structured grids used in SABER

ALGO:

  • work with infra and NASA on speck-stack
  • Discussed model name convention with different agencies regarding using CCPP convention and metdata
  • Working on background error covariance training suite. Will also look at spectral data
  • BUMP PRs will speed up a few things (e.g. reading global files)
  • Ran snow 4D-Var. BUMP has a branch to fix most of the issues (this is related to some of the high-reso issues)
  • MetOffice is working on option for hybrid BE in parallel
  • Added diffusion operator for snow into SABER (work from Travis)

INFRA:

  • JEDI interface update. May disable CI tomorrow for that
  • working on speck-stack updates to v1.8. Dom done patches to v1.7.0
  • working on IODA obsframe protopyoe
  • working on Compo ingest template
  • Added RTTOV, ROPP-2d and others in CMAKE 

CRTM: 

(1) Ben is working on upgrading the instrument coefficient generation package, and training in-kind contributors on this matter.
(2) Cheng is developing the optical profile generation package for the CRTM optical generic interface.
(3) The CRTM team is working on several reported issues from collaborators and JCSDA core members regarding CRTM v3.1.0/v2.4.0, including (1) the JEDI/UFO interface for CMAQ aerosol LUT; (2) CRTM calculation for aircraft based sensors.

SOCA:

We moved the soca-specific diffusion saber central block into a generic code in oops/saber. PRs are open now for that. This has been tested with FV3 and SOCA and seems to be working well. It is NOT working for ROMS and MPAS due to an issue with atlas mesh generation. When finished this is a good alternative to BUMP_NICAS for those with very small length scales.

NOAA: 

GFS-17:

  • Testing Travis’s Diffusion correlation operator in for Aerosols
  • Real time conventional observations for marine.
  • SMAP soil moisture IODA converters

Regional (RRFS V2)

  • Continuing to work on MGBF in Saber. Following the GSIbec setup. Unstructured interpolation.
  • PR adding Vader to MPAS-JEDI.
  • Looking at ways of rejecting obs outside the domain.

Atmospheric DA

  • Still looking at excessive memory use by LETKF.
  • Stress testing filters when no observations present.
  • Can pass cubed sphere increments back to UFS.
  • Continued work on JCB, not part of global workflow.

AI/ML

  • Reviving the MAGIC JEDI interface with a view to interfacing NeuralGCM / GraphCastGFS to JEDI.

UFO acceptance: 

  • GPSRO still working on geoval inconsitency
  • Sat winds: PR Submitted for LEO-GEO winds in end-to-end framework. working on others
  • ABI radiance: Phase 1 testing replicates GSI with GSI geovals
  • ADPUPA: A Python converter is finished. Now working on comparison between BUFR and prepBUFR
  • AIRCFT Prepbufr end-to-end: tracking down why std dev difference is large

GMAO:

  • We are looking to understand why the latest VarBC changes introduce unexpected differences in the results of running the var; these are more roundoff that would be caused by the precision of coefficients in the old and new formats not been preserved.
  • We are working to do a very close comparison between GSI and JEDI geovals and clear out differences that seem more than acceptable.


MetOffice:

Philip Underwood reported an issue Chris Thomas (in copy) has identified with the MPI distribution of global aircraft observations. When looking at this obtype in isolation, it’s been identified that some MPI communicators are handling several million locations, whereas others may only be handling tens of thousands (see attached image). Interpolating these to generate the GeoVals is taking a long time as the round-robin distribution means that many of the locations are in geographical regions that are not covered by the model region their MPI communicator is handling. As a result, there is a significant amount of MPI communication taking place for interpolation.

 

Chris has made three suggestions to explore and potentially solve this issue:

  1. Exclude locations that failed thinning prior to calling GetValues
  2. Separate pre-filter step
  3. Create an obs domain decomposition that matches the model one

The following discussion led to the first question; is this problem related to 3D or 4D? Apparently, these issues are less pronounced with 4D. Francois Hebert said that changing the obs distribution would not fix the issue, and that isolating and looking at a single ob type enhances this problem. Hernan G Arango described a more technical approach to MPI distribution, that to be honest I didn’t understand.


(plot was sent after the JEDI meeting for a reference)

NCAR:

reported an issue when we run mpas-jedi in 4DEnVar mode: it will fail if we turn on the output of geovals and ydiags files. Will create an issue for this and seek the solution. 



  • No labels