NOAA Open Data Dissemination: Petabyte scale Earth System Data in the Cloud

NOAA Open Data Dissemination (NODD) makes NOAA environmental data publicly and freely available on Amazon Web Services (AWS), Microsoft Azure (Azure), and Google Cloud Platform (GCP). These data can be accessed by anyone with an internet connection and span key datasets across the Earth system including satellite imagery, radar, weather models and observations, ocean databases, and climate data records. NODD works closely with NOAA stakeholders to make these data available consistently and performantly, often with near-real-time latency. Since its inception, NODD has grown to provide public access to more than 24PB of NOAA data and can support billions of requests and petabytes of access daily. NODD growth is driven by use; stake- holders routinely access more than 5PB of NODD data every month. NODD continues to grow to support open petabyte-scale Earth system data science in the cloud by investing in onboarding additional NOAA data, performant data formats, and streaming data platforms. Here, we document how this pro- gram works with a focus on data provenance, discuss the key datasets available through NODD, show how these data are being used, and highlight ways these data can be accessed with the goal of accelerating use of NOAA resources in the cloud.