Sea level data archaeology at Socoa (Saint Jean-de-Luz, France)
收藏资源简介：
1. Description This repository contains the data, notebooks, and documents covering the archeology and rescue of tide gauge observation at Socoa (Saint Jean-de-Luz, Southwestern France), and is complementary to the paper (henceforth "data paper") titled "Extension of high temporal resolution sea level time series at Socoa (Saint Jean-de-Luz, France) back to 1875". Authors: Md Jamal Uddin Khan, Inge Van Den Beld, Guy Woppelmann, Laurent Testut, Alexa Latapy, Nicolas Pouvreau For up-to-date sea level timeseries, visit the Shom data distribution portal linked in the Related identifier section below. At the time of writing, corrected and valid data over 1875 to date at original sampling is identified as 'Validées temps différé'. The data and source-codes presented here is open-access. Please consider citing the data paper if you use the data. More information is given in the Data-use section below. A brief structure of the files contained in this repository is shown below, and a brief description is given in the following sections - |- data |- auxiliary |- brest_data.shom.fr/ |- santander_marcos_etal.dat |- socoa |- data.shom.fr/ |- corrections.csv |- corrections_marigram.csv |- corrections_registry.csv |- data_inventory.csv |- socoa_L0.csv |- socoa_L1.csv |- socoa_L2.csv |- socoa_L2_nominal.csv |- socoa_L3.csv |- socoa_L4.csv |- socoa_raw.txt |- documents |- archive_records |- AD64__Pau_4S 33.docx |- Archives_Shom_plusieursCotes.docx |- SHD_Brest_MB3W.docx |- SHD_Rochefort_7JJ418-7JJ1551.docx |- SHD_Vincennes_plusieurCotes.docx |- tidegauge_journal |- <year>_Socoa_Notes_Registres.docx |- inventory.xlsx |- figures |- figure01 |- ... |- figure 06 |- supp |- notebooks |- 01_data_processing.ipynb |- 02_buddy_checking.ipynb |- 03_trend_analysis.ipynb |- README.md 2. Data and codes 2.1 Data (/data) Data directory (/data) contains two folder - auxiliary, and socoa. /data/socoa contains raw data (socoa_raw.txt) as well as processed dataset (socoa_L*.csv). The directory also contains information regarding the data inventory (data_inventory.csv), and the corrections applied during the processing (corrections_*.csv). A snapshot of data from https://data.shom.fr (April 2022) is also available in the /data/socoa/data.shom.fr directory. Data files corresponding to various level of dataset is following - Level 0: No corrections applied (/data/socoa/socoa_L0.csv) Level 1: Time corrections applied, including conversion to UTC time (/data/socoa/socoa_L1.csv) Level 2: Time and height corrections applied (/data/socoa/socoa_L2.csv) Level 3: Hourly interpolated and merged with existing data (/data/socoa/socoa_L3.csv) Level 4: Hourly data additionally flagged for siltation from tidal analysis (/data/socoa/socoa_L4.csv) All datafiles are provided as standard comma-separated text files encoded in utf-8. The final Level 4 data has three columns with column header titled - Datetime, Value, and Flag, where, Datetime: The UTC timestamp of the data Value: Sea level with respect to Hydrographic Zero Flag: Data flag as described in the data paper In addition, Level 4 data contains the following information header - # Station: SAINT-JEAN-DE-LUZ_SOCOA # Longitude: -1.68162 # Latitude: 43.39524 # Organization: Shom, Pyrénées-Atlantiques # Timesystem: UTC # VerticalReference: Hydrographic Zero # Unit: m # Flag: 4-bit flags yes(1)/no(0) - [siltation][uncertain_correction][height_correction][time_correction] # DOI_DataPaper: Data: 10.5281/zenodo.7438469, Article: 10.5194/essd-2022-443 # DOI_SHOM: 10.17183/REFMAR#95 /data/auxiliary contains the auxiliary dataset used for analysis and comparison in the data paper. Brest dataset, /data/auxiliary/brest_data.shom.fr, is retrieved from https://data.shom.fr. Monthly sea level at Santander, /data/auxiliary/santander_marcos_etal.dat, comes from the dataset published by Marcos et al. (2020). 2.2 Documents (/documents) The /documents folder contains supplimentary documents related to the dataset. /documents/tidegauge_journal contains the extraction from the tide gauge journal year by year. The files are named as – YEAR_Socoa_Notes_Registres.docx where YEAR is the 4-digit year. /documents/archive_records contains the excerpts of metadata documents from the various archives. For 5 archives, 5 separate files are provided. These archives are and file names are – Service historique de la Défense (SHD) at Brest (SHD-Brest): SHD_Brest_MB3W.docx Service historique de la Défense (SHD) at Rochefort (SHD-Rochefort): SHD_Rochefort_7JJ418-7JJ1551.docx Service historique de la Défense (SHD) at Vincennes (SHD-Vincennes): SHD_Vincennes_plusieurCotes.docx Archives des Pyrénées-Atlantiques (AD64): AD64_Pau_4S 33.docx SHOM archive: Archives_Shom_plusieursCotes.docx /documents/inventory.xlsx gives an overall inventory of the historic documents catalogued. 2.3 Figures (/figures) The figures directory (/figures) contains the figures presented in the accompanying data paper organized into individual directories for each figure. The most of the figures related to the analysis is generated using python and their source-code is provided in the /notebooks directory. In case where external graphical software has been used for generating the final image is provided inside the directory for each individual figure. 2.4 Codes (/notebooks) The codes used in processing this data is provided in the `/notebooks` directory. The full code is segmented into three self-contained python/jupyter notebooks - Data processing (01_data_processing.ipynb) Buddy checking (02_buddy_checking.ipynb) Trend analysis (03_trend_analysis.ipynb) The python environment necessary for running the notebooks can be created using conda (https://www.anaconda.com/products/distribution) with the following commands - conda create -n socoa python=3.7 numpy scipy statsmodels cartopy netcdf4 pandas xarray jupyter conda activate socoa pip install utide==0.2.6 jupyter-notebook 3. Data-use information Citation: Khan, M. J. U., Van Den Beld, I., Wöppelmann, G., Testut, L., Latapy, A., and Pouvreau, N.: Extension of high temporal resolution sea level time series at Socoa (Saint Jean-de-Luz, France) back to 1875, Earth Syst. Sci. Data Discuss. [preprint], https://doi.org/10.5194/essd-2022-443, in review, 2023. Use rights: The data and source-code is freely available to anyone. Please consider citing the data paper using the citation above. License: Creative Commons Attribution 4.0 International (CC BY 4.0) 4. Related identifiers SHOM historical dataset portal: http://refmar.shom.fr/dataRescue/HTML/FR/SOCOA%20(SAINT-JEAN-DE-LUZ).html SHOM data distribution portal: http://dx.doi.org/10.17183/REFMAR#95
1. 数据集说明 本仓库包含与法国西南部圣让德吕兹（Saint Jean-de-Luz）索科阿（Socoa）地区验潮观测（tide gauge observation）的考古整理与抢救性保护相关的数据、Jupyter笔记本脚本与文档，作为题为《将法国索科阿（圣让德吕兹）的高时间分辨率海平面时间序列回溯至1875年》的配套论文（以下简称“数据论文”）的补充资源。 作者：Md·贾迈勒·乌丁·汗、英格·范登贝尔德、居伊·沃佩尔曼、洛朗·泰斯图、亚历克萨·拉塔皮、尼古拉·普夫罗。 如需获取最新海平面时间序列，请访问下文“相关标识符”部分中链接的法国海道测量局（Shom）数据分发门户。本文撰写时，1875年至今的原始采样校正有效数据被标记为“Validées temps différé”。本仓库提供的数据与源代码均为开放获取资源，若您使用本数据，请引用该数据论文，更多信息详见下文“数据使用说明”部分。 本仓库包含的文件简要结构如下，后续章节将给出详细说明： |- data |- auxiliary |- brest_data.shom.fr/ |- santander_marcos_etal.dat |- socoa |- data.shom.fr/ |- corrections.csv |- corrections_marigram.csv |- corrections_registry.csv |- data_inventory.csv |- socoa_L0.csv |- socoa_L1.csv |- socoa_L2.csv |- socoa_L2_nominal.csv |- socoa_L3.csv |- socoa_L4.csv |- socoa_raw.txt |- documents |- archive_records |- AD64__Pau_4S 33.docx |- Archives_Shom_plusieursCotes.docx |- SHD_Brest_MB3W.docx |- SHD_Rochefort_7JJ418-7JJ1551.docx |- SHD_Vincennes_plusieurCotes.docx |- tidegauge_journal |- <year>_Socoa_Notes_Registres.docx |- inventory.xlsx |- figures |- figure01 |- ... |- figure 06 |- supp |- notebooks |- 01_data_processing.ipynb |- 02_buddy_checking.ipynb |- 03_trend_analysis.ipynb |- README.md 2. 数据与代码 2.1 数据目录（/data） 数据目录（/data）包含两个子文件夹：auxiliary与socoa。/data/socoa 目录内包含原始数据（socoa_raw.txt）与处理后的数据集（socoa_L*.csv），同时存有数据清单（data_inventory.csv）以及处理过程中应用的校正参数文件（corrections_*.csv）。该目录下还存放了2022年4月从https://data.shom.fr 获取的数据集快照，位于/data/socoa/data.shom.fr 子文件夹中。 各层级数据集说明如下： 0级数据：未应用任何校正（/data/socoa/socoa_L0.csv） 1级数据：已应用时间校正，包括转换为协调世界时（UTC）（/data/socoa/socoa_L1.csv） 2级数据：已应用时间与高程校正（/data/socoa/socoa_L2.csv） 3级数据：已进行小时级插值并与现有数据合并（/data/socoa/socoa_L3.csv） 4级数据：在3级数据基础上，额外通过潮汐分析标记了淤积相关数据（/data/socoa/socoa_L4.csv） 所有数据文件均采用UTF-8编码的标准逗号分隔文本格式（CSV）。最终的4级数据包含三列，列标题分别为：Datetime、Value、Flag，各字段说明如下： - Datetime：数据对应的UTC时间戳 - Value：相对于水文基准面的海平面高度 - Flag：数据标记，具体说明详见数据论文 此外，4级数据包含以下元数据头部： # 测站：SAINT-JEAN-DE-LUZ_SOCOA # 经度：-1.68162 # 纬度：43.39524 # 所属机构：法国海道测量局（Shom），比利牛斯-大西洋省 # 时间系统：协调世界时（UTC） # 垂直基准面：水文零基准 # 单位：米（m） # 标记：4位二进制标记，1代表是、0代表否，顺序为[淤积标记][校正不确定性标记][高程校正标记][时间校正标记] # 数据论文DOI：数据集：10.5281/zenodo.7438469，论文：10.5194/essd-2022-443 # SHOM数据集DOI：10.17183/REFMAR#95 /data/auxiliary 目录存放了数据论文中用于分析与对比的辅助数据集：布雷斯特数据集（/data/auxiliary/brest_data.shom.fr）从https://data.shom.fr 获取；桑坦德月均海平面数据集（/data/auxiliary/santander_marcos_etal.dat）来自Marcos等人2020年发布的数据集。 2.2 文档目录（/documents） /documents 文件夹存放与本数据集相关的补充文档： - /documents/tidegauge_journal：按年份整理的验潮日志摘录，文件命名格式为YEAR_Socoa_Notes_Registres.docx，其中YEAR为4位年份数字。 - /documents/archive_records：来自多个档案机构的元数据文档摘录，共5个档案对应5个独立文件，具体对应关系如下： - 布雷斯特国防历史档案馆（SHD-Brest）：SHD_Brest_MB3W.docx - 罗什福尔国防历史档案馆（SHD-Rochefort）：SHD_Rochefort_7JJ418-7JJ1551.docx - 万塞讷国防历史档案馆（SHD-Vincennes）：SHD_Vincennes_plusieurCotes.docx - 比利牛斯-大西洋省档案馆（AD64）：AD64_Pau_4S 33.docx - 法国海道测量局（Shom）档案馆：Archives_Shom_plusieursCotes.docx - /documents/inventory.xlsx：本仓库收录的历史文档总清单。 2.3 图表目录（/figures） /figures 目录存放配套数据论文中展示的所有图表，每个图表对应一个独立子目录。大部分分析相关图表通过Python生成，对应的源代码存放在/notebooks 目录中；若使用外部绘图软件生成最终图表，对应的源文件将存放在对应图表的子目录内。 2.4 代码目录（/notebooks） 本数据集处理所用的代码存放在/notebooks 目录中，全部代码分为三个独立的Python/Jupyter笔记本脚本： - 数据处理（01_data_processing.ipynb） - 一致性校验（02_buddy_checking.ipynb） - 趋势分析（03_trend_analysis.ipynb） 运行这些笔记本所需的Python环境可通过Conda（https://www.anaconda.com/products/distribution）按以下命令创建： conda create -n socoa python=3.7 numpy scipy statsmodels cartopy netcdf4 pandas xarray jupyter conda activate socoa pip install utide==0.2.6 jupyter-notebook 3. 数据使用说明 引用格式：Khan, M. J. U., Van Den Beld, I., Wöppelmann, G., Testut, L., Latapy, A., and Pouvreau, N.: Extension of high temporal resolution sea level time series at Socoa (Saint Jean-de-Luz, France) back to 1875, Earth Syst. Sci. Data Discuss. [预印本], https://doi.org/10.5194/essd-2022-443, 已投稿, 2023. 使用权限：本仓库提供的数据与源代码对所有用户免费开放。请按照上述引用格式引用该数据论文。 许可协议：知识共享署名4.0国际许可（CC BY 4.0） 4. 相关标识符 法国海道测量局历史数据集门户：http://refmar.shom.fr/dataRescue/HTML/FR/SOCOA%20(SAINT-JEAN-DE-LUZ).html 法国海道测量局数据分发门户：http://dx.doi.org/10.17183/REFMAR#95
