OEMC Hackathon 2023: EU Land Cover Classification Dataset

Dataset organized by the Open-Earth-Monitor (OEMC) project within the context of Hackathon 2023. The dataset (both train and test) was produced by stratified sampling of the <strong>ground-truth</strong> data provided by LUCAS Survey, funded by the European Commission. The target land cover considered <strong>level-3</strong> classes from the harmonized legend, resulting in <strong>72 classes</strong> distributed over <strong>5 years </strong>(<code>2006</code>, <code>2009</code>, <code>2012</code>, <code>2015</code>, <code>2018</code>): All samples were overlaid with <strong>416</strong> raster spatial layers, including satellite (spectral bands and indices) and temperature images (land surface temperature), climate images (precipitation, air temperature), accessibility and distance maps (highways, water bodies, burned areas), digital terrain model (slope and elevation) and other existing maps (population count and snow covering). The result values were organized in columns, one for each spatial layers, which combined represent the feature space available for ML modeling. <strong>Column names:</strong> The columns are formed by six metadata fields separated by <code>_</code>: Example: <strong>red_landsat.glad.ard_p50_30m_jun25_sep12</strong> Metadata fields: F1 - Variable name: <strong>red</strong> F2 - Variable procedure including product name: <strong>landsat.glad.ard</strong> F3 - Position in the probability distribution: <strong>p50</strong> F4 - Spatial resolution: <strong>30m</strong> F5 - Start date: <strong>jun25</strong> F6 - End date: <strong>sep12</strong> <strong>Column description:</strong> All the columns can be aggregated in six thematic groups according to F1 and F2: <strong>Satellite images (spectral reflectance &amp; vegetation indices):</strong> <code>blue_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat blue band (Witjes et al., 2023) <code>blue_mod13q1_{..}</code>: Monthly time-series of MOD13Q1 blue band (EarthData) <code>evi_mod13q1.stl.trend.ols.alpha_{..}</code>: Alpha coefficient / intercept (derived by OLS) over the deseasonalized monthly time-series of MOD13Q1 Enhanced Vegetation Index (EVI) index (EarthData) <code>evi_mod13q1.stl.trend.ols.beta_{..}</code>: Beta coefficient / trend (derived by OLS) over the deseasonalized monthly time-series of MOD13Q1 Enhanced Vegetation Index (EVI) index (EarthData) <code>evi_mod13q1.stl.trend_{..}</code>: Deseasonalized monthly time-series (trend component of STL) for MOD13Q1 Enhanced Vegetation Index (EVI) index (EarthData) <code>evi_mod13q1_{..}</code>: Monthly time-series of MOD13Q1 Enhanced Vegetation Index (EVI) index (EarthData) <code>green_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat green band (Witjes et al., 2023) <code>mir_mod13q1_{..}</code>: Monthly time-series of MOD13Q1 mid-infrared band (EarthData) <code>ndvi_mod13q1_{..}</code>: Monthly time-series of MOD13Q1 normalized vegetation index (NDVI) (EarthData) <code>nir_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat near-infrared band (Witjes et al., 2023) <code>nir_mod13q1_{..}</code>: Monthly time-series of MOD13Q1 near-infrared band (EarthData) <code>red_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat red band (Witjes et al., 2023) <code>red_mod13q1_{..}</code>: Monthly time-series of MOD13Q1 red band (EarthData) <code>swir1_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat short-wave infrared-1 band (Witjes et al., 2023) <code>swir2_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat short-wave infrared-1 band (Witjes et al., 2023) <strong>Temperature images:</strong> <code>lst_mod11a2.daytime_{..}</code>: Monthly time-series of MOD13Q1 day time land surface temperature (EarthData) <code>lst_mod11a2.daytime.{month}_{..}</code>: Long-term monthly aggregation (2000—2022) for MOD13Q1 day time land surface temperature (EarthData) <code>lst_mod11a2.daytime.trend_{..}</code>: Deseasonalized monthly time-series (trend component of STL) for MOD13Q1 day time land surface temperature (EarthData) <code>lst_mod11a2.daytime.trend.ols.alpha_{..}</code>: Alpha coefficient / intercept (derived by OLS) over the deseasonalized monthly time-series of MOD13Q1 day time land surface temperature (EarthData) <code>lst_mod11a2.daytime.trend.ols.beta_{..}</code>: Beta coefficient / trend (derived by OLS) over the deseasonalized monthly time-series of MOD13Q1 day time land surface temperature (EarthData) <code>lst_mod11a2.nighttime_{..}</code>: Monthly time-series of MOD13Q1 night time land surface temperature (EarthData) <code>lst_mod11a2.nighttime.{month}_{..}</code>: Long-term monthly aggregation (2000—2022) for MOD13Q1 day time land surface temperature (EarthData) <code>lst_mod11a2.nighttime.trend_{..}</code>: Deseasonalized monthly time-series (trend component of STL) for MOD13Q1 night time land surface temperature (EarthData) <code>lst_mod11a2.nighttime.trend.ols.alpha_{..}</code>: Alpha coefficient / intercept (derived by OLS) over the deseasonalized monthly time-series of MOD13Q1 night time land surface temperature (EarthData) <code>lst_mod11a2.nighttime.trend.ols.beta_{..}</code>: Beta coefficient / trend (derived by OLS) over the deseasonalized monthly time-series of MOD13Q1 night time land surface temperature (EarthData) <code>thermal_landsat.glad.ard_{..}</code>: Quarterly time-series of Landsat thermal band (Witjes et al., 2023) <strong>Climate layers:</strong> <code>accum.precipitation_chelsa.annual_{..}</code>: Accumulated precipitation over the entire year according to CHELSA timeseries in <code>mm</code> of water (Karger et al., 2017) <code>accum.precipitation_chelsa.annual.3years.dif_{..}</code>: 3-years difference considering the yearly accumulated precipitation according to CHELSA timeseries in <code>mm</code> of water (Karger et al., 2017) <code>accum.precipitation_chelsa.annual.log.csum_{..}</code>: Cumulative sum, in logarithmic space, consdering the yearly accumulated precipitation according to CHELSA timeseries (Karger et al., 2017) <code>accum.precipitation_chelsa.montlhy_{..}</code>: Accumulated precipitation for each month according to CHELSA timeseries in <code>mm</code> of water (Karger et al., 2017) <code>bioclim.var_chelsa.{variable_code}_{..}</code>: Bioclimatic variables derived variables from the monthly mean, max, mean temperature, and mean precipitation values. For <code>variable_code</code> descriptions see chelsa-climate.org (Karger et al., 2017) <strong>Accessibility &amp; distance maps:</strong> <code>accessibility.to.ports_map.ox.{variable_code}_{..}</code>: Time-required to access ports of different size according to Nelson et al., 2019 <code>burned.area.distance_global.fire.atlas_{..}</code>: Distance to burned areas mapped by Global Fire Atlas <code>cost.distance.to.coast_gedi.grass.gis_{..}</code>: Cumulative cost of moving (derived by r.cost) to the coast <code>road.distance_osm.highways.high.density_{..}</code>: Distance to high density of roads according to OpenStreetMap <code>road.distance_osm.highways.low.density_{..}</code>: Distance to low density of roads according to OpenStreetMap <code>water.distance_glad.interanual.dynamic.classes_{..}</code>: Distance to permanent / seasonal water bodies according to<br> Pickens et al., 2020 <strong>Digital terrain model (DTM):</strong> <code>elev.lowestmode_gedi.eml_{..}</code>: Mean estimate of the terrain elevation in <code>dm</code> filtered using SAGA GIS Gaussian filter (Witjes et al., 2023) <code>slope.percent_gedi.eml_{..}</code>: Mean slope in <code>%</code> derived from terrain elevation ([Witjes et al., 2023] <strong>Other existing maps:</strong> <code>pop.count_ghs.jrc_{..}</code>: Annual time-series of population count in number of people mapped by Schiavina et al., 2023 <code>snow.duration_global.snowpack_{..}</code>: Annual duration of snow occurrence mapped by Global SnowPack <strong>Files</strong> <strong>train.csv</strong>: Training set with 42,237 rows and 420 columns, including sample id (<code>sample_id</code> - index column), land cover code (<code>land_cover</code>), land cover label (<code>land_cover_label</code>), reference year (<code>year</code>) and 416 features / covariates <strong>test.csv</strong>: Test set with 42,271 rows and 418 columns, including sample id (<code>sample_id</code> - index column), reference year (<code>year</code>) and 416 features / covariates <strong>sample_submission.csv</strong>: a sample submission file with 42,271 rows and 2 columns, including sample id (<code>sample_id</code> - index column) and predicted land cover code (<code>land_cover</code>)