Yannick opened the meeting announcing that this week's meeting is a general roundtable update. Yannick also introduced two new members of JCSDA:
Steve H gave the following summary:
Maryam:
Steve:
Anna added this item later in the meeting: On November 21-22 we ran a Parameters code sprint, co-organized by Wojciech Smigaj and Anna Shlyaeva. During the code sprint 19 participants from JCSDA, Met Office, NASA, NOAA, NRL contributed to the improvement in JEDI user experience with configuration files across JEDI code. We merged more than 50 PRs in ufo, oops and model repositories as part of the sprint. As Mark Miesch pointed out, this effort will have a nonlinear effect down the line: now that the majority of classes in ufo, ioda, and other repos have Parameters implemented, it will become the default option when people add new classes. Thank you to all of the participants, to Wojciech for organizing and driving this effort, and to Mark Miesch and Kat Shanahan for the assistance with organizing this. See link to the slides that Wojciech prepared for the code sprint with an excellent introduction to Parameters and descriptions on how to approach the tasks: https://wiki.ucar.edu/display/JEDI/2021-10-19+Parameters+code+sprint+preparation |
Anna gave the following summary (notes are from Steve V):
Jedi 2.1 - Improved interpolation (Dan, Francois H)
Jedi 2.2 - Generalized locations (Francois H, Emily)
Jedi 2.3 - Use of NUOPC driver with FV3-JEDI (Mark Potts)
Jedi 2.4 - TLM and adjoint improvements (Dan, New hire)
Jedi 2.5 - 4DVar testing (New hire)
Jedi 2.6 - Ensemble DA validation (Cory, Sergey)
Jedi 2.7 - Background error model validation (Benjamin, Dan, Cathy, Ricardo)
Jedi 2.8 - Regional DA (Ting, Ming)
Jedi 2.9 - MPAS general updates (JJ, BJ)
Jedi 2.10 - LFRic general updates (Kristin, Steve S., Steve V.)
Jedi 2.11 - UM general updates (Kristin, Steve S., Steve V.)
Jedi 2.12 - Neptune general updates (Sarah, Nancy)
Jedi 2.13 - Shallow water model general updates (Chris)
Jedi 2.14 - Cubed sphere grid into Atlas (Dan, Marek, Olly, Steve V)
Jedi 2.15 - VADER (Steve V, Dan)
Jedi 2.16 - Generalized variable naming conventions (EMC liaison)
Jedi 2.17 - Ensemble TLM (New hire, Tim)
Jedi 2.18 - Locations refactoring (Dan, Francois H)
Jedi 2.19 - GeoVaLs refactoring (Anna, Ryan, Carwyn, Wojciech)
Jedi 2.21 - FV3 interface (Dan)
|
In regard to JEDI2.1 (improved interpolation), Yannick added that the consensus was to do the interpolation on the model side. The team is still determining how to organized the code changes (a series of small PRs vs one large PR).
Anna gave the following summary:
JEDI3.3 Variational bias correction. Jo Waller issued a pull request adding preconditioning for VarBC for DR IPCG and DR PCG minimizers: oops#1364 JEDI3.5 EDA. Wojciech Smigaj opened an issue and a PR for generating obs perturbations with zero mean. oops#1506 and oops#1512 Also under discussion: general approach to random number generators in JEDI. Wojciech proposes to initialise a few separate RNGs (or at least define the seeds these RNGs could be initialised with if they are ever needed) at the start of each oops application:
and replace the seed and reset parameters currently passed to the constructors of oops::NormalDistribution<T> etc. with an enum indicating which of these RNGs to use.) JJ Guerrette is running EDA experiments (as several Variational applications). He has also run experiments using block-Lanczos EDA with mpas-jedi, which were failing due to imaginary eigenvalues. JEDI3.7 EnKFs: Sergey Frolov reported that the main focus for the next 6 months - year would be using local volume solvers for coupled assimilation, and doing 3D LETKF. One of the tasks is connecting coupled ensembles to BUMP to diagnose coupled covariances. JEDI3.11 & JEDI3.12 SABER: Benjamin Menetrier has been working on adding Parameters to SABER and preparing SABER to handling B matrix options other than BUMP. Marek Wlasak raised several questions:
Benjamin: for BUMP parameter estimation the process estimates vertical regression, variances, and horizontal lengthscales separately. Ideally in SABER the Increment would be transformed to atlas fieldsets, then all the saber operators would be applied (on atlas pointers), and at the end we’d go back to Increment. The idea is that different SABER blocks can be applied on different resolutions/variables, and all the blocks would be specified in yaml explicitly, including the interpolations. This would improve maintainability and the user would see all the steps in the B matrix. |
Yannick gave the following summary:
Yannick mentioned that the work plans for JEDI4 are being modified due to the reduction in resources. This information will be available in the revised AOP once that is completed. |
Ben R gave the following summary:
Ben expressed thanks to everyone that has been helping him get spun up in his first week with JCSDA. He is currently organizing the work with team members, and reaching out to partners for requirements and support needs. |
Hui gave the following summary:
OBS team are working on
|
Chris S asked if the OBS database for JEDI GDAS was built out of GSI ncdiag files, or are there feeds from obs data providers in place. Currently it is primarily ncdiag data, but the next steps include enabling feeds from the providers.
Francois gave the following summary:
- We reviewed several dashboarding software for the generation of web applications to display diagnostics. For the initial version of the website voila was chosen for its simplicity. |
Sergey asked if there is a way to learn more about the dashboarding aspect of the diagnostics. This effort has just started and is being lead by Travis. Francois will ask Travis to invite Sergey to the discussions.
Ryan gave the following summary:
Last week we hosted a ioda-converters sprint with the objective of switching all Python converters to write out ioda-v2 files natively using the ioda-python interface. Ten people attended the three-day sprint. We ran a bit short on time. A week would likely have been better, though we did accomplish a lot of work. Every converter has had a PR issued, and that PR is either still in review or has been merged. |
Guillaume gave the following summary:
|
Patrick and Cheng gave the following summary:
|
Andy gave the following summary:
Land updates:
|
Jerome gave the following summary:
. PR for PM2.5 Obs operator needs restructuring as it currently lacks genericity . Concept issues with some AOD operators . Plans to include/update new converters to IODA, for atmospheric composition satellites . Plans to update the averaging kernel operator to make it more general |
Sergey Frolov - NOAA Federal 9:06 AM Maryam, is soca staying with travis-ci? Maryam Abdi-Oskouei 9:06 AM yes public repos are free on Travis-CI Guillaume Vernieres 9:06 AM We re special Anna Shlyaeva 9:08 AM https://wiki.ucar.edu/display/JEDI/2021-10-19+Parameters+code+sprint+preparation Jerome Barre 9:13 AM It looks like I have missed meetings this week. It seems i don't receive invites to certain meetings. I would need to be added to some mailing lists. Patrick Stegmann 9:15 AM This is the discussion for the CRTM surface classification issue Francois is working on: https://github.com/JCSDA-internal/ufo/issues/1591 Greg Thompson 9:41 AM Andy: I have exactly same happening Dan H. said same thing also |