JEDI weekly meeting notes


Andy/Land:
- Doubled checked the way of grouping observations for R2D2 after Jerome’s comment last meeting, and they are correct. Just using a different naming convention
- Using EWS to run EWOK on Orion and AWS
- Mainly working with NCAR RAL folks on putting together some basic diagnostics and doing some testing now that they have begun cycling experiments with WRF-Hydro-JEDI.

Maryam/COMPO:

- Able to run GFS w/aerosols under ewok, small H(x) experiment in Aug 2021 on Orion

Travis/Ocean:

- Getting soca working under ewok: currently have hofx done, working on 3dvar next. Hope to get this wrapped up by the end of the week
- Develop branch of soca is "broken", waiting on fixes to oops. The model-specific version of interpolators in oops is not handling halos correctly (see https://github.com/JCSDA-internal/oops/issues/1762)

Patrick,Chen/CRTM:

- Remaining coefficients for tropics constellation, 5/7 completed
- Surface emissivity coefficient table improvements (sea surface, snow surface)

Francois V.,Hui,Ryan/OBS:

- Code sprint this/next week: prepare UFO for JEDI release.
    - Improve the organization of ufo and in particular clean up the ctests. (have over 5000 lines of cmake code in ufo describing over 450 tests)
    - Reorganize the test directories and review all tests.
    - Remove duplicate tests and strip out repetitive sections of YAML that are tested elsewhere.
    - Classify each test into a test tier, move long-running tests, instrument tests and other non-unit tests into tier 2, and use the ufo_add_test macro to make test maintenance easier.
    - Once this is all done, test ufo in a broad range of environments.
- Test ufo in cycling experiments.
    - Adding obs types one after another, focusing on scientific performance, radiance bias correction, and observation errors.
    - Currently, have radiosonde, satwinds, aircraft, GNSSRO, ATMS, AMSU-A included.
- Also working on converters to ingest more data from different resources, which includes working with various providers to examine new missions/observations (e.g., commercial data, TROPICS proxy data, etc.).

Dom/Infrastructure:

- Infrastructure team planning out first 1.5 code sprints for release end of June
- spack-stack beta version planned for tomorrow/email will be sent Monday next week
- Heavy development on EWOK and get it to run through CI on Github self-hosted runners
- When final version of spack-stack is rolled out on all HPCs, in the CI system and for users
    - Need to plan for a hard switch from jedi-stack to spack-stack, since it requires changes in several repositories due to updates in library names etc.

Anna/Algorithms:

- PRs streamlining interfaces between Geometry/State/Increment and atlas functionspace/fieldset are planned for merge on Monday June 13. All model interfaces would need to adapt, see details here: https://github.com/orgs/JCSDA-internal/teams/jedi-models/discussions/71. 
- PRs enabling assimilation when observed and simulated variables are planned for merge on Wednesday June 15. None or minimal changes are expected in yamls, but please test your model with this development. Details here: https://github.com/orgs/JCSDA-internal/teams/jedi-models/discussions/73
- Speed up and clean up fv3-jedi CI tests
    - Split YAML validation and run on single processor, run application w/o validating the YAML is faster than running both in the MPI app. Added option in ufo (oops)? to do this.
    - https://github.com/JCSDA-internal/oops/pull/1774
- Question from Hui: "We noticed some memory issues while running hyperspectral radiance data assimilation. This is also reported by NCAR for their MPAS-JEDI tests. In addition, we are also trying to sort out the issue related to the running clock time of GNSSRO operators, noticed by the JEDI team earlier."

  • No labels