Atmospheric rivers dataset for machine learning training
收藏资源简介:
A thorough description of the data and how it was created can be found: http://climate-cms.org/CNN-Atmospheric-Rivers/ A Jupyter notebook has also been created where we'll show you how to use this data to train a deep learning model to identify whether an Integrated Vapor Transport map contains an atmosperhic river. it can be found: CNN_AR_tutorial.ipynb and had been published here: Mesto, M., Hobeichi, S., & Green, S. (2024). CNN-Atmospheric-Rivers (v1.0.0). Zenodo. https://doi.org/10.5281/zenodo.12538779 The data is organised in three folders: IVT_ERA5_2Deg: Contains global IVT data. AR_Global: Contains polygons representing AR objects identified and hand-labelled in each IVT map. Training_Testing_tiles: Contains tiles of IVT data with an annotation file that classifies each tile as one of the following: ‘Atmospheric River’, ‘Ambiguous’. The ‘Ambiguous’ class refers to objects that are not clearly identifiable as atmospheric rivers. Integrated Vapor Transport maps: These maps were computed using the magnitude of the vertical integral of northward and eastward water vapour flux variables from ERA5. The IVT values are expressed in units of kg m^-1 s^-1. All the IVT TIFF files were loaded into ArcGIS software and displayed using a colour scheme that allows for the visual identification of atmospheric rivers. Data details: Folder: IVT_ERA5_2Deg File format: TIFF Spatial resolution: 2 degrees Spatial coverage: Global (longitude: -180 to 180 , latitude: -90 to 90) Geographic Coordinate System: GCS_WGS_1984 Temporal coverage: 1st – 5th day of January, April, July, October for 2010, 2013, 2015; these years correspond to La Niña, neutral, and El Niño year respectively Temporal resolution: Daily Naming of files: ivt_2deg_ddmmyyyy.tif Number of files: 60 (5 days × 4 months × 3 years) Number of channels in each file: 1 Atmospheric Rivers in IVT maps: The annotation tool ‘Label Objects for Deep Learning’ was used to draw polygons to cover the shape of atmospheric rivers on each IVT map. Each polygon was assigned one of two labels: 'Atmospheric Rivers' or 'Ambiguous'. The polygons were drawn based on visual identification of the shape of atmospheric rivers, guided by IVT values close to 500kg m^-1 s^-1 as in Reid et al (2020). The 'Ambiguous' label was assigned to objects that were unclear in their classification as ARs. This ambiguity arose from objects that were shorter, wider, had slightly lower IVT values, or it was hard to tell if they were ARs of tropical cyclones during the early stages of their formation. Data details: Folder: AR_Global File format: SHP (shapefile) Spatial coverage: Global Geographic Coordinate System: GCS_WGS_1984 Temporal coverage: 1st – 5th day of January, April, July, October for 2010, 2013, 2015 (corresponding to La Niña, neutral, and El Niño year respectively) Temporal resolution: Daily Naming of files: ivt_2deg_ddmmyyyy_labelled.shp Number of files: 60 (5 days × 4 months × 3 years) Dataset for deep learning training: The tool 'Export Training Data for Deep Learning' uses the IVT maps in the 'AR_Global' folder and the shapefiles in the 'IVT_ERA5_2Deg' folder to create labelled tiles for deep learning training. Each tile in the map is assigned a label: 'Atmospheric River', 'Ambiguous', or no label if it doesn’t contain any AR or ambiguous shape. The generated map chips are stored in folder Training_Testing_tiles/ RCNN_Masks_All_Tiles (no 3-10-15)/images, and the labels are provided in the textfile 'map.txt' file in folder Training_Testing_tiles/ RCNN_Masks_All_Tiles (no 3-10-15)/. Data details: Folder: Training_Testing_tiles/ RCNN_Masks_All_Tiles (no 3-10-15)/images File format: TIFF Spatial resolution: 2 degrees Spatial coverage: varies. Width of tile = 40 gridcells. Height of tile = 20grid cells Geographic Coordinate System: GCS_WGS_1984 Temporal coverage: 1st – 5th day of January, April, July, October for 2010, 2013, 2015. These years correspond to La Niña, neutral, and El Niño year respectively. Please note that data for certain days are missing; these omissions correspond to days with no or only a single atmospheric river detected. Temporal resolution: Daily Number of files: varies Number of channels in each file: 1



