DeepOrchidSeries: A Sentinel-2 Dataset to inform convolutional SDMs with twelve-month Sentinel-2 image time-series, Orchid family

<strong>Deep Species Distribution Modelling from Sentinel-2 Image Time-series: a Global Scale Analysis on the Orchid Family</strong> <strong><em>DeepOrchidSeries</em></strong> dataset gathers Sentinel-2 image time-series around geolocated orchid occurrences. Seasonal evolutions of the habitats are captured in the twelve-month RGB/IR time-series with 640x640m spatial resolution. It allows novel Species Distribution Models (SDMs) coupled with convolutional networks to take advantage of both spatial and temporal information. Our <strong>associated article</strong> is describing the modeling choices made to shape this ambitious dataset. It is submitted to https://www.frontiersin.org/research-topics/18336/plant-biodiversity-science-in-the-era-of-artificial-intelligence. We believe such global data, methods and scripts are valuable to the conservation ecology community and especially deep-SDMs users. To our knowledge, no similar ready-to-use dataset is available. In the article, the dataset's temporal dimension is proven to significantly improve SDMs performances. <strong><em>sen2patch</em></strong> is the gitlab project gathering the code to create such dataset. It is available at https://gitlab.inria.fr/jestopin/sen2patch. <strong><em>DeepOrchidSeries.csv</em></strong> contains all occurrences-level information. We advice to load it with: <pre><code class="language-python">import pandas as pd df = pd.read_csv("path/to/DeepOrchidSeries.csv", sep=';') df.columns ['gbifid', 'canonical_name', 'decimallatitude', 'decimallongitude', 'speciesKey', 'cell_index', 'bot_country', 'bot_code', 'lvl2_code', 'continent_code']</code></pre> 'gbifid' is the occurrences GBIF ID 'canonical_name', is the species canonical name 'decimallatitude', 'decimallongitude' are the species coordinates in decimal degrees 'speciesKey' is the species GBIF unique identifier 'cell_index' is a unique cell ID in a 0.0025° lon/lat grid partitioning the Earth (used to stratify train/val/test set by geographic blocks) 'bot_country', 'bot_code', 'lvl2_code', 'continent_code' are geographic subdivisions defined in https://github.com/tdwg/wgsrpd (code and string for WGSRPD level 1, the botanical countries) Initial GBIF query DOI is https://doi.org/10.15468/dl.4bijtu (26 August 2019). <strong><em>DeepOrchidSeries.tar</em></strong> file contains the satellite image time-series and is available at https://lab.plantnet.org/deeporchidseries/ <em>.tar</em> archive measure 286 GB and extends to 432 GB once decompressed. Image time-series relative tree paths are constructed from the occurrences unique GBIF IDs. For a given occurence <em>gbifid</em>, matching patches are located in: <em>final_dataset_by_gbifid/gbifid[-2:]/gbifid[-4:-2]</em>, <em>i.e.</em> in a first folder named with the <em>gbifid</em> last two numbers and a subfolder with the previous two ones. Example: the time-series files matching occurrence 2236837714 are located at <em>final_dataset_by_gbifid/14/77/</em>. Image time-series are composed of twelve 16 bits RGB <em>.png</em> and twelve 16 bits IR <em>.png</em> files containing data identical to the original L1C products, no lossy compression was made. There are one RGB and one IR .png file per month. Patches from month MM/YYYY of occurrence <em>gbifid</em> are named<em> </em><em>RGB_YYYY_MM_gbifid_.png</em> and <em>IR0_YYYY_MM_gbifid_.png</em>. <em><strong>models.zip</strong></em> is the archive containing the four PyTorch models weights described in our article and<strong><em> </em></strong><em><strong>inception_env.py</strong></em> the used Inception V3 architecture. <em><strong>index.json</strong></em> contains the dictionnary linking the models class indexes from 0 to 14128 with our labels <em>speciesKey</em>: {"class_index":speciesKey}. <strong>ACKNOWLEDGMENTS</strong>: We warmly thank Alexander Zizka et al. for providing us the geographically and taxonomically curated set of Orchids occurrences. This dataset contains modified Copernicus Sentinel data and Copernicus Service information (2018). Sentinel-2 MSI data used were available at no cost from ESA Sentinels Scientific Data Hub.