NOAA Unified Forecast System Short-Range Weather (UFS SRW) Application Dataset for Machine Learning
Install DagsHub:
pip install dagshub
To stream this data directly on DagsHub
from dagshub.streaming import DagsHubFilesystem
fs = DagsHubFilesystem(".", repo_url="https://test.dagshub.com/DagsHub-Datasets/noaa-ufs-shortrangeweather-dataset")
fs.listdir("s3://noaa-ufs-srw-pds")
Description
The “Unified Forecast System (UFS)” is a community-based, coupled, comprehensive Earth Modeling System. It supports ” multiple applications” with different forecast durations and spatial domains. The UFS Short-Range Weather (SRW) Application figures among these applications. It targets predictions of atmospheric behavior on a limited spatial domain and on time scales from minutes to several days. The SRW Application includes a prognostic atmospheric model, pre-processor, post-processor, and community workflow for running the system end-to-end. The “SRW Application Users’s Guide” includes information on these components and provides detailed instructions on how to build and run the SRW Application. Users can access additional technical support via the “UFS GitHub Discussions”
This data registry contains the data required to run the “out-of-the-box” SRW Application case. The SRW App requires numerous input files to run, including static datasets (fix files containing climatological information, terrain and land use data), initial condition data files, lateral boundary condition data files, and model configuration files (such as namelists). The SRW App experiment generation system also contains a set of workflow end-to-end (WE2E) tests that exercise various configurations of the system (e.g., different grids, physics suites). Data for running a subset of these WE2E tests are also included within this registry.
Users can generate forecasts for dates not included in this data registry by downloading and manually adding raw model files for the desired dates. Many of these model files are publicly available and can be accessed via links on the “Developmental Testbed Center” website.
Additional information
Documentation
Update frequency
These are stable datasets for use with the SRW Application. They will not be updated frequently.
Managed by
License
The UFS SRW Application license page can be found at: https://github.com/ufs-community/ufs-srweather-app/blob/develop/LICENSE.md