UK RSE Conference 2022 Walkthrough - MLOps for RSEs - Sample Data

This record is intended as sample data for a Walkthrough at the UK RSE 2022 Conference titled "MLOps for RSEs". The code that uses this sample dataset can be found on GitHub. There are 2 parts based on the sample problems in the walkthrough

Classifying wind rotor events

Clustering weather regimes

Rotors Dataset

This dataset is  intended as a machine learning dataset, to train a model to predict the occurrence of turbulent wind gusts called "rotors". These are wind gusts happening on the leeward side of mountains. When they occur near an airfield, this can be hazardous from aviation operations.  This data is intended to be used with the code on the Met Office Data Science Community of Practice GitHub repository.

Files:

2021_met_office_aviation_rotors.csv - Raw dataset

2021_met_office_aviation_rotors_preprocessed.csv - Preprocessed dataset ready for machine learning

rotors_catalog.yml - Intake Catalog file for the rotors dataset.

More Information:

MO Data Science Community  of Practice GitHub - https://github.com/MetOffice/data_science_cop/tree/master/challenges/2021_falklands_rotors  

Met Office Youtube - What are rotors? https://www.youtube.com/watch?v=jgSZG9SqN_s

What are Lee Waves? https://www.metoffice.gov.uk/weather/learn-about/weather/types-of-weather/wind/lee-waves\

Weather Regime Clustering

This dataset is a UK and North Atlantic cutout of the Mean Sea-level Pressure (MSLP) field in  ERA5 reanalysis dataset produced by ECMWF. This dataset is used for demonstrating an unsupervised learning pipeline.

Files:

era5_mslp_UK_2017_2020.nc - Gridded dataset of ERA5 reanalysis data.