Photo by DeepMind on Unsplash

NOAA Unified Forecast System Short-Range Weather (UFS SRW) Application Dataset for Machine Learning

Install DagsHub:

pip install dagshub
Click on copy button to copy content

To stream this data directly on DagsHub

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://test.dagshub.com/DagsHub-Datasets/noaa-ufs-shortrangeweather-dataset")

fs.listdir("s3://noaa-ufs-srw-pds")
Click on copy button to copy content

Description

The “Unified Forecast System (UFS)” is a community-based, coupled, comprehensive Earth Modeling System. It supports ” multiple applications” with different forecast durations and spatial domains. The UFS Short-Range Weather (SRW) Application figures among these applications. It targets predictions of atmospheric behavior on a limited spatial domain and on time scales from minutes to several days. The SRW Application includes a prognostic atmospheric model, pre-processor, post-processor, and community workflow for running the system end-to-end. The “SRW Application Users’s Guide” includes information on these components and provides detailed instructions on how to build and run the SRW Application. Users can access additional technical support via the “UFS GitHub Discussions

This data registry contains the data required to run the “out-of-the-box” SRW Application case. The SRW App requires numerous input files to run, including static datasets (fix files containing climatological information, terrain and land use data), initial condition data files, lateral boundary condition data files, and model configuration files (such as namelists). The SRW App experiment generation system also contains a set of workflow end-to-end (WE2E) tests that exercise various configurations of the system (e.g., different grids, physics suites). Data for running a subset of these WE2E tests are also included within this registry.

Users can generate forecasts for dates not included in this data registry by downloading and manually adding raw model files for the desired dates. Many of these model files are publicly available and can be accessed via links on the “Developmental Testbed Center” website.

Additional information

Update frequency

These are stable datasets for use with the SRW Application. They will not be updated frequently.

License

The UFS SRW Application license page can be found at: https://github.com/ufs-community/ufs-srweather-app/blob/develop/LICENSE.md

Related datasets

Atmospheric Models from Météo-France

CAFE60 reanalysis

Coupled Model Intercomparison Project Phase 5 (CMIP5) University of Wisconsin-Madison Probabilistic Downscaling Dataset

Earth Radio Occultation

Launch your ML development to new heights with DagsHub

Back to top