Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation update for v1.2.0 release #37

Merged
merged 49 commits into from
Dec 7, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
debd226
add RTD yaml
gspetro-NOAA Nov 20, 2023
6d3c3ff
fix typo in RTD.yaml
gspetro-NOAA Nov 28, 2023
bc1a52c
restructure docs & add testing chapter
gspetro-NOAA Nov 29, 2023
f048f27
add new features & user support to intro
gspetro-NOAA Nov 30, 2023
149b8d3
minor updates throughout
gspetro-NOAA Dec 1, 2023
3695d13
add gswp3 data info for land cmpnt case
gspetro-NOAA Dec 4, 2023
ca4d4c3
misc updates
gspetro-NOAA Dec 4, 2023
8d1eaf9
DA System & misc updates
gspetro-NOAA Dec 6, 2023
4f0b32e
update release date
gspetro-NOAA Dec 6, 2023
080c38e
minor updates for GSWP3 option
gspetro-NOAA Dec 6, 2023
8141f0c
rm stray .DS_Store file
gspetro-NOAA Dec 6, 2023
fce54fc
container ch updates
gspetro-NOAA Dec 6, 2023
90c2790
Merge branch 'ufs-community:develop' into text/v1.2.0
gspetro-NOAA Dec 6, 2023
878ffc5
Merge branch 'text/v1.2.0' of https://github.com/gspetro-NOAA/land-DA…
gspetro-NOAA Dec 6, 2023
9f881e4
container ch updates
gspetro-NOAA Dec 6, 2023
54985a0
Delete settings_DA_cycle_era5_restart
rhaesung Dec 6, 2023
669e6fa
pinned vector2 submodule to NOAA-PSL/land-vector2tile.git/develop
rhaesung Dec 6, 2023
4f89309
update container ch, RSK changes, other misc
gspetro-NOAA Dec 6, 2023
cbf9e78
Merge branch 'text/v1.2.0' of https://github.com/gspetro-NOAA/land-DA…
gspetro-NOAA Dec 6, 2023
10124fa
revert .gitmodules and update DA_update
rhaesung Dec 6, 2023
e381cfc
Merge branch 'text/v1.2.0' of https://github.com/gspetro-NOAA/land-DA…
rhaesung Dec 6, 2023
bafdee0
update DA_update
rhaesung Dec 6, 2023
1737693
minor container/run updates, other misc
gspetro-NOAA Dec 6, 2023
801989d
update vector2tile
gspetro-NOAA Dec 6, 2023
893f90d
Merge branch 'text/v1.2.0' of https://github.com/gspetro-NOAA/land-DA…
gspetro-NOAA Dec 6, 2023
8663c6f
Delete settings_DA_cycle_era5_restart
rhaesung Dec 6, 2023
3bf9617
pinned vector2 submodule to NOAA-PSL/land-vector2tile.git/develop
rhaesung Dec 6, 2023
f61ebdf
minor container/run updates, other misc
gspetro-NOAA Dec 6, 2023
8a233c4
revert .gitmodules and update DA_update
rhaesung Dec 6, 2023
481d234
update DA_update
rhaesung Dec 6, 2023
a1c26dc
Merge branch 'text/v1.2.0' of https://github.com/gspetro-NOAA/land-DA…
gspetro-NOAA Dec 6, 2023
a8c1e56
restore RSK deletion of vector2tile
gspetro-NOAA Dec 6, 2023
0ac9744
glossary update
gspetro-NOAA Dec 6, 2023
cdbb2a5
restore GP deletion of vector2tile submodule
rhaesung Dec 6, 2023
50fe78d
Update TestingLandDA.rst
gspetro-NOAA Dec 7, 2023
c103375
Update README.md
gspetro-NOAA Dec 7, 2023
5a71eea
Rm comment in BuildRunLandDA.rst
gspetro-NOAA Dec 7, 2023
a429df4
Rm some comments from DASystem.rst
gspetro-NOAA Dec 7, 2023
edf184c
address comments for DASystem chapter
gspetro-NOAA Dec 7, 2023
6d208f2
address/rm comments in Model ch
gspetro-NOAA Dec 7, 2023
72b721b
switch from tag name to branch name
gspetro-NOAA Dec 7, 2023
a576df9
Update file name
gspetro-NOAA Dec 7, 2023
dd3a87d
Update DA_update path to psl_develop
gspetro-NOAA Dec 7, 2023
78657ed
clean the unessary comment
rhaesung Dec 7, 2023
d8f11d0
minor changes - plurals
gspetro-NOAA Dec 7, 2023
fd741f7
update sample files in DASystem
gspetro-NOAA Dec 7, 2023
8288b4e
sample GHCN update
gspetro-NOAA Dec 7, 2023
862591a
update settings_DA_template stub
gspetro-NOAA Dec 7, 2023
5c980d4
minor wording change
gspetro-NOAA Dec 7, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,8 @@
[submodule "DA_update"]
path = DA_update
url = https://github.com/ufs-community/land-DA.git
branch = feature/porting
branch = develop
[submodule "vector2tile"]
path = vector2tile
url = https://github.com/NOAA-PSL/land-vector2tile.git
branch = develop
branch = develop
31 changes: 31 additions & 0 deletions .readthedocs.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,31 @@
# .readthedocs.yaml
# Read the Docs configuration file
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details

# Required
version: 2

# Set the version of Python and other tools you might need
build:
os: ubuntu-20.04
tools:
python: "3.9"
# You can also specify other tool versions:
# nodejs: "16"
# rust: "1.55"
# golang: "1.17"

# Build documentation in the docs/ directory with Sphinx
sphinx:
configuration: docs/source/conf.py

# If using Sphinx, optionally build your docs in additional formats such as PDF
# formats:
# - pdf

# Optionally declare the Python requirements required to build your docs
python:
install:
- requirements: docs/requirements.txt


2 changes: 1 addition & 1 deletion DA_update
Submodule DA_update updated 0 files
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ The UFS includes [multiple applications](https://ufscommunity.org/science/abouta

The offline Noah-MP LSM is a standalone, uncoupled model used to execute land surface simulations. In this traditional uncoupled mode, near-surface atmospheric forcing data is required as input forcing. This LSM simulates soil moisture (both liquid and frozen), soil temperature, skin temperature, snow depth, snow water equivalent (SWE), snow density, canopy water content, and the energy flux and water flux terms of the surface energy balance and surface water balance. Its data assimilation framework applies the Local Ensemble Transform Kalman Filter-Optimal Interpolation (LETKF-OI) algorithm to combine the state-dependent background error derived from an ensemble forecast with the observations and their corresponding uncertainties to produce an analysis ensemble (Hunt et al., 2007).

The Noah-MP LSM has evolved through community efforts to pursue and refine a modern-era LSM suitable for use in the National Centers for Environmental Prediction (NCEP) operational weather and climate prediction models. This collaborative effort continues with participation from entities such as NCAR, NCEP, NASA, and university groups. The development branch of the Land DA System is continually evolving as the system undergoes open development. The latest Land DA release (v1.1.0) represents a snapshot of this continuously evolving system.
The Noah-MP LSM has evolved through community efforts to pursue and refine a modern-era LSM suitable for use in the National Centers for Environmental Prediction (NCEP) operational weather and climate prediction models. This collaborative effort continues with participation from entities such as NCAR, NCEP, NASA, and university groups. The development branch of the Land DA System is continually evolving as the system undergoes open development. The latest Land DA release (v1.2.0) represents a snapshot of this continuously evolving system.

The Land DA System User's Guide associated with the development branch is at: https://land-da.readthedocs.io/en/develop/, while the guide specific to the Land DA v1.1.0 release can be found at: https://land-da-workflow.readthedocs.io/en/release-public-v1.1.0/. Users may download data for use with the most recent release from the [Land DA data bucket](https://noaa-ufs-land-da-pds.s3.amazonaws.com/index.html#current_land_da_release_data/). The [Land DA Docker Hub](https://hub.docker.com/r/noaaepic/ubuntu20.04-intel-landda) hosts Land DA containers. These containers package the Land DA System together with all its software dependencies for an easier experience building and running Land DA.
The Land DA System User's Guide associated with the development branch is at: https://land-da.readthedocs.io/en/develop/, while the guide specific to the Land DA v1.2.0 release can be found at: https://land-da-workflow.readthedocs.io/en/release/public-v1.2.0/. Users may download data for use with the most recent release from the [Land DA data bucket](https://noaa-ufs-land-da-pds.s3.amazonaws.com/index.html#current_land_da_release_data/v1.2.0). The [Land DA Docker Hub](https://hub.docker.com/r/noaaepic/ubuntu20.04-intel-landda) hosts Land DA containers. These containers package the Land DA System together with all its software dependencies for an easier experience building and running Land DA.

For any publications based on work with the UFS Offline Land Data Assimilation System, please include a citation to the DOI below:

UFS Development Team. (2023, March 6). Unified Forecast System (UFS) Land Data Assimilation (DA) System (Version v1.1.0). Zenodo. https://doi.org/10.5281/zenodo.7675721
UFS Development Team. (2023, Dec. 11). Unified Forecast System (UFS) Land Data Assimilation (DA) System (Version v1.2.0). Zenodo. https://doi.org/10.5281/zenodo.7675721

156 changes: 156 additions & 0 deletions docs/source/BackgroundInfo/Introduction.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,156 @@
.. _Intro:

****************
Introduction
****************

This User's Guide provides guidance for running the Unified Forecast System
(:term:`UFS`) offline Land Data Assimilation (DA) System. Land DA is an offline version of the Noah Multi-Physics (Noah-MP) land surface model (LSM) used in the `UFS Weather Model <https://github.com/ufs-community/ufs-weather-model>`__ (WM). Its data assimilation framework uses
the Joint Effort for Data assimilation Integration (:term:`JEDI`) software. The offline UFS Land DA System currently only works with snow data.
Thus, this User's Guide focuses primarily on the snow DA process.

Since the last release, developers have added a variety of features:

* Integration of the UFS Noah-MP land component into the Land DA System for use as an alternative to the Common Community Physics Package (:term:`CCPP`) Noah-MP LSM land driver
* Model forcing options for use with the UFS land component:

* Provided a new analysis option in the cubed-sphere native grid using :term:`GSWP3` forcing
* Established global land grid-point consistency with the head of the UFS WM baseline test cases (New global land grid point is changed from 18360 to 18322.)
* Added a new sample configuration file (``settings_DA_cycle_gswp3``)
* Included a new ECMWF :term:`ERA5` reanalysis forcing option in the existing vector-to-tile conversion analysis process

* CTest suite upgrades --- the ERA5 CTests now test the operability of seven major components of Land DA: vector2tile, create_ens, letkfoi_snowda, apply_jediincr, tile2vector, land_driver, and UFS datm_land.
* Upgrade of JEDI :term:`DA <data assimilation>` framework to use JEDI Skylab v4.0 (`PR #28 <https://github.com/ufs-community/land-DA_workflow/pull/28>`__)
* Updates to sample datasets for the release (see the `Land DA data bucket <https://registry.opendata.aws/noaa-ufs-land-da/>`__)
* Singularity/Apptainer container (``ubuntu20.04-intel-landda-release-public-v1.2.0``) updates to support the changes described above
* Documentation updates to reflect the changes above

The Land DA System citation is as follows and should be used when presenting results based on research conducted with the Land DA System:

UFS Development Team. (2023, December 11). Unified Forecast System (UFS) Land Data Assimilation (DA) System (Version v1.2.0). Zenodo. https://doi.org/10.5281/zenodo.7675721


Organization
**************

This User's Guide is organized into four sections: (1) *Background Information*; (2) *Building, Running, and Testing the Land DA System*; (3) *Customizing the Workflow*; and (4) *Reference*.

Background Information
========================
* This chapter (Introduction) provides background information on the Unified Forecast System (:term:`UFS`) and the NoahMP model.
* :numref:`Chapter %s <TechOverview>` (Technical Overview) outlines prerequisites, user support levels, and directory structure.

Building, Running, and Testing the Land DA System
===================================================

* :numref:`Chapter %s: Land DA Workflow <BuildRunLandDA>` explains how to build and run the Land DA System on :ref:`Level 1 <LevelsOfSupport>` systems (currently Hera and Orion).
* :numref:`Chapter %s: Containerized Land DA Workflow <Container>` explains how to build and run the containerized Land DA System on non-Level 1 systems.
* :numref:`Chapter %s: Testing the Land DA Workflow <TestingLandDA>` explains how to run the Land DA CTests.

Customizing the Workflow
=========================

* :numref:`Chapter %s: Model <Model>` provides information on input data and configuration parameters in the Noah-MP LSM and its Vector-to-Tile Converter.
* :numref:`Chapter %s: DA Framework <DASystem>` provides information on the DA system, required data, and configuration parameters.

Reference
===========

* :numref:`Chapter %s: Glossary <Glossary>` lists important terms.

User Support and Documentation
********************************

Questions
==========

The Land DA System's `GitHub Discussions <https://github.com/ufs-community/land-DA_workflow/discussions/categories/q-a>`__ forum provides online support for UFS users and developers to post questions and exchange information. When users encounter difficulties running the Land DA System, this is the place to post. Users can expect an initial response within two business days.

When posting a question, it is recommended that users provide the following information:

* The platform or system being used (e.g., Hera, Orion, container, MacOS, Linux)
* The version of the Land DA System being used (e.g., ``develop``, ``release/public-v1.1.0``). (To determine this, users can run ``git branch``, and the name of the branch with an asterisk ``*`` in front of it is the name of the branch or tag they are working with.) Note that the Land DA version being used and the version of the documentation being used should match, or users will run into difficulties.
* Stage of the application when the issue appeared (i.e., build/compilation, configuration, or forecast run)
* Contents of relevant configuration files
* Full error message (preferably in text form rather than a screenshot)
* Current shell (e.g., bash, csh) and modules loaded
* Compiler + MPI combination being used
* Run directory and code directory, if available on supported platforms

Bug Reports
============

If users (especially new users) believe they have identified a bug in the system, it is recommended that they first ask about the problem in `GitHub Discussions <https://github.com/ufs-community/land-DA_workflow/discussions/categories/q-a>`__, since many "bugs" do not require a code change/fix --- instead, the user may be unfamiliar with the system and/or may have misunderstood some component of the system or the instructions, which is causing the problem. Asking for assistance in a `GitHub Discussion <https://github.com/ufs-community/land-DA_workflow/discussions/categories/q-a>`__ post can help clarify whether there is a simple adjustment to fix the problem or whether there is a genuine bug in the code. Users are also encouraged to search `open issues <https://github.com/ufs-community/land-DA_workflow/issues>`__ to see if their bug has already been identified. If there is a genuine bug, and there is no open issue to address it, users can report the bug by filing a `GitHub Issue <https://github.com/ufs-community/land-DA_workflow/issues/new>`__.

Feature Requests and Enhancements
==================================

Users who want to request a feature enhancement or the addition of a new feature have two options:

#. File a `GitHub Issue <https://github.com/ufs-community/land-DA_workflow/issues/new>`__ and add (or request that a code manager add) the ``EPIC Support Requested`` label.
#. Post a request for a feature or enhancement in the `Enhancements <https://github.com/ufs-community/land-DA_workflow/discussions/categories/enhancements>`__ category of GitHub Discussions. These feature requests will be forwarded to the Earth Prediction Innovation Center (`EPIC <https://epic.noaa.gov/>`__) management team for prioritization and eventual addition to the Land DA System.


.. _Background:

Background Information
************************

Unified Forecast System (UFS)
===============================

The UFS is a community-based, coupled, comprehensive Earth modeling system. It includes `multiple applications <https://ufscommunity.org/science/aboutapps/>`__ that support different forecast durations and spatial domains. NOAA's operational model suite for numerical weather prediction (:term:`NWP`) is quickly transitioning to the UFS from many different modeling systems.
The UFS is designed to enable research, development, and contribution
opportunities within the broader :term:`Weather Enterprise` (including
government, industry, and academia). For more information about the UFS, visit the `UFS Portal <https://ufscommunity.org/>`__.


.. _NoahMP:

Noah-MP
==========

The offline Noah-MP LSM is a stand-alone, uncoupled model used to execute land surface simulations. In this traditional uncoupled mode, near-surface atmospheric :term:`forcing data` are required as input forcing. This LSM simulates soil moisture (both liquid and frozen), soil temperature, skin temperature, snow depth, snow water equivalent (SWE), snow density, canopy water content, and the energy flux and water flux terms of the surface energy balance and surface water balance.

Noah-MP uses a big-leaf approach with a separated vegetation canopy accounting
for vegetation effects on surface energy and water balances, a modified two-stream
approximation scheme to include the effects of vegetation canopy gaps that vary
with solar zenith angle and the canopy 3-D structure on radiation transfer,
a 3-layer physically-based snow model, a more permeable frozen soil by separating
a grid cell into a permeable fraction and impermeable fraction, a simple
groundwater model with a TOPMODEL-based runoff scheme, and a short-term leaf
phenology model. Noah-MP LSM enables a modular framework for diagnosing differences
in process representation, facilitating ensemble forecasts and uncertainty
quantification, and choosing process presentations appropriate for the application.
Noah-MP developers designed multiple parameterization options for leaf dynamics,
radiation transfer, stomatal resistance, soil moisture stress factor for stomatal
resistance, aerodynamic resistance, runoff, snowfall, snow surface albedo,
supercooled liquid water in frozen soil, and frozen soil permeability.

The Noah-MP LSM has evolved through community efforts to pursue and refine a modern-era LSM suitable for use in the National Centers for Environmental Prediction (NCEP) operational weather and climate prediction models. This collaborative effort continues with participation from entities such as NCAR, NCEP, NASA, and university groups.

Noah-MP has been implemented in the UFS via the :term:`CCPP` physics package and
is currently being tested for operational use in GFSv17 and RRFS v2. Additionally, the UFS Weather Model now contains a Noah-MP land component. Noah-MP has
also been used operationally in the NOAA National Water Model (NWM) since 2016. Details about the model's physical parameterizations can be found in :cite:t:`NiuEtAl2011` (2011).

Disclaimer
*************

The United States Department of Commerce (DOC) GitHub project code is
provided on an “as is” basis and the user assumes responsibility for its
use. DOC has relinquished control of the information and no longer has a
responsibility to protect the integrity, confidentiality, or
availability of the information. Any claims against the Department of
Commerce stemming from the use of its GitHub project will be governed by
all applicable Federal laws. Any reference to specific commercial
products, processes, or services by service mark, trademark,
manufacturer, or otherwise, does not constitute or imply their
endorsement, recommendation, or favoring by the Department of Commerce.
The Department of Commerce seal and logo, or the seal and logo of a DOC
bureau, shall not be used in any manner to imply endorsement of any
commercial product or activity by DOC or the United States Government.

References
*************

.. bibliography:: ../references.bib
Loading