iSCAPE Outdoor Sensor Deployment Data
收藏资源简介：
<strong>Dataset Description</strong> This dataset contains all the deployment data using low cost sensors during the iSCAPE project. The dataset is divided in a series of deployments, each of them described on a yaml file with the test name. Each csv file contains time series data of each experiment, and the yaml files contain the lists of devices used in each test. The tests are described in the comment of the yaml file, and are meant to be self explanatory. Two different types of tests are herein presented: Intervention monitoring tests (Guildford and Surrey). Two intervention monitoring results were conducted in the sites of Surrey (UoS) Living Lab and Hasselt (UH) Living Lab. The intervention in Surrey aimed at characterising the behaviour of green infrastructure and the effect on the pollutants dispersion next to traffic conditions. Two different sets of two stations were delivered and deployed, one set in the vicinity of Stoke Park, and the other in the vicinity of Sutherland Memorial Park (both in Guildford - UK). In the case of Hasselt, two Living Lab Stations were deployed. The first one was used to assess pollutant concentrations in the <em>Bassischool Kuringen</em> in Hasselt. The other station was deployed near the University of Hasselt. Sensor Calibration tests (CSIC, Dublin and Bologna). The tests conducted in Bologna (by UNIBO, 2018), Dublin (by UCD, 2019) and Barcelona (by IAAC, 2019) were intended as an assessment of the sensor technology in an outdoor environment scenario, by co-locating the iSCAPE LLSs with reference instrumentation. A complete description of these datasets and the result of their analysis is shown in D7.8 of iSCAPE which can be found in this url: https://www.iscapeproject.eu/results/. <strong>Sensors</strong> The sensors used are herein referred as Citizen Kits or Smart Citizen Kits, and the Living Lab Station or Smart Citizen Station. These are a set of modular hardware components that feature a selection of low cost sensors for environmental monitoring listed below. The Smart Citizen Station is meant to expand the capabilities of the Smart Citizen Kit, aiming to measure pollutants with more advanced sensors. The hardware is licensed under CERN Open Hardware License V1.2 and is fully described in the HardwareX Open Access publication: https://doi.org/10.1016/j.ohx.2019.e00070. The sensor documentation can be found at https://docs.smartcitizen.me and with this DOI at Zenodo: https://doi.org/10.5281/zenodo.2555029. In the list below, the different sensors for the Citizen Kits are detailed, and their [CHANNELS] in the csv files above linked. Air temperature (ºC): Sensirion SHT-31 [TEMP] Relative Humidity (%rh): Sensirion SHT-31 [HUM] Noise level (dBA): Invensense ICS-434342 [NOISE_A] Ambient light (lux): Rohm BH1721FVC [LIGHT] Barometric pressure (kPa): NXP MPL3115A26 [PRESS] Particulate Matter PM 1 / 2.5 / 10 (µg/m3) Planttower PMS 5003 [EXT_PM_1,EXT_PM_25,EXT_PM_10] In the list below, the different sensors for the Citizen Kits are detailed, and their [CHANNELS] in the csv files above linked. Air Temperature (ºC) Sensirion SHT-31 [TEMP] Relative Humidity (% REL) Sensirion SHT-31 [HUM] Noise Level (dBA) Invensense ICS-434342 [NOISE_A] Ambient Light (Lux) Rohm BH1721FVC [LIGHT] Barometric pressure and AMSL (Pa and Meters) NXP MPL3115A26 [PRESS] Carbon Monoxide (µg/m3 (Periodic Baseline Calibration Required) SGX MICS-4514 [NA] Nitrogen Dioxide (µg/m3 (Periodic Baseline Calibration Required) SGX MICS-4514 [NA] Carbon Monoxide (ppm) Alphasense CO-B4 [GB_1W, GB_1A, final calculated valueCO_DELTAS_OVL_X-XX-XX - all the same] Nitrogen Dioxide (ppb) Alphasense NO2-B43F [GB_2W, GB_2A, final calculated value NO2_DELTAS_OVL_0-30-50 or NO2_DELTAS_OVL_0-5-50] Ozone (ppb) Alphasense OX-B431 [GB_3W, GB_3A, final value O3_DELTAS_OVL_0-30-50 or O3_DELTAS_OVL_0-5-50] Gases Board Temperature (ºC) Sensirion SHT-31 [GB_TEMP] or [EXT_TEMP] Gases Board Rel. Humidity (% REL) Sensirion SHT-31 [GB_HUM] or [EXT_HUM] PM 1 (µg/m3) Plantower PMS5003 [EXT_PM_1] or [EXT_PM_A_1], [EXT_PM_B_1] for each PM sensor in the case of the Living Lab Station PM 2.5 (µg/m3) Plantower PMS5003 [EXT_PM_25] or [EXT_PM_A_25], [EXT_PM_B_25] for each PM sensor in the case of the Living Lab Station PM 10 (µg/m3) Plantower PMS5003 [EXT_PM_10] or [EXT_PM_A_10], [EXT_PM_B_10] for each PM sensor in the case of the Living Lab Station PN between 0.3um<0.5um particle size (#/l) Plantower PMS5003 [EXT_PN_03] or [EXT_PN_A_03], [EXT_PN_B_03] for each PM sensor in the case of the Living Lab Station PN between 0.5um<1um particle size (#/l) Plantower PMS5003 [EXT_PN_05] or [EXT_PN_A_05], [EXT_PN_B_05] for each PM sensor in the case of the Living Lab Station PN between 1m<2.5um particle size (#/l) Plantower PMS5003 [EXT_PN_1] or [EXT_PN_A_1], [EXT_PN_B_1] for each PM sensor in the case of the Living Lab Station PN between 2.5m<5um particle size (#/l) Plantower PMS5003 [EXT_PN_25] or [EXT_PN_A_25], [EXT_PN_B_25] for each PM sensor in the case of the Living Lab Station PN between 5m<10um particle size (#/l) Plantower PMS5003 [EXT_PN_5] or [EXT_PN_A_5], [EXT_PN_B_5] for each PM sensor in the case of the Living Lab Station PN between >10um particle size (#/l) Plantower PMS5003 [EXT_PN_10] or [EXT_PN_A_10], [EXT_PN_B_10] for each PM sensor in the case of the Living Lab Station The files with the _processed suffix, are processed files which: 1. Resample the data using pandas resampling with mean() - reference here 2. Clean NaN and wrong readings. 3. Add calculations for electrochemical sensors based on this methodology <strong>How to find the data</strong> Each yaml file contains the description of a test. Each test is comprised of recordings of several devices in the same location and during the same period. Each yaml file is comprised of the following fields: author: who has been in charge of performing the test (internal reference - not relevant) comment: describing in general terms what was done in the test, and with what purpose commit: the firmware commit (in the case of Smart Citizen devices) with which the test was performed, for development purposes only devices: a descriptor containing different fields for traceability (below) id: the test name project: within the test was performed, in this case it is always iscape report: if there is any report analysing the test type_test: indoor, oudoor test or other. <strong>Description of devices entry</strong> For each device that was used in the test, two generic types are used: low cost sensors (type: STATION or KIT) high end sensors (type: REFERENCE) For <strong>low cost Smart Citizen sensors</strong>, the fields are: alphasense: electrochemical sensors device ids, by pollutant (for manufacturer calibration) and slots in which they were placed device_id: device id in Smartcitizen API fileNameInfo: not used fileNameProc: (only if source = csv is specified) 2019-03_EXT_UCD_URBAN_BACKGROUND_API_CITY_COUNCIL_REF.csv fileNameRaw: (only if source = csv is used) raw file name frequency: original recording frequency location: for timezone correction only, not accurate max_date: last recording date min_date: first recording date name: self-explanatory pm_sensor: if there was a pm sensor connected (all of them are PMS5003 if no sensor is specified) source: api or csv type: STATION (KIT + Alphasense + PM board with two PMS5003) or KIT version: smartcitizen hardware version For <strong>high end</strong> sensors, the fields are: channels: which channels the device was recording for internal convertion names: which are the columns in the csv file pollutants: which pollutants do they respectively refer to units: the units of these pollutants equipment: the brand of the analyser fileNameProc: same as above fileNameRaw: same as above index: format in which the timeindex is done, for parsing purposes format: (example '%Y-%m-%d %H:%M:%S') frequency: frequency at which the device was recorded name: column name location: same as above name: name of the device type: REFERENCE (always for these devices) source: csv <strong>iSCAPE Dataset Reference Numbers:</strong> The datasets here presented are related to the following iSCAPE dataset reference numbers: DS_TS_049 DS_TS_050 DS_TS_051 DS_TS_052 DS_TS_053 DS_TS_055 DS_TS_056 DS_TS_057 DS_TS_058
<strong>数据集说明</strong> 本数据集涵盖了iSCAPE项目期间使用低成本传感器开展的全部部署监测数据。本数据集按一系列部署任务划分，每项任务的说明均存储于以测试名称命名的YAML文件中。每个CSV文件包含对应实验的时序数据，而YAML文件则记录了每项测试所使用的设备清单。测试说明可直接从YAML文件的注释字段获取，无需额外阐释即可清晰理解。本次数据集包含两类测试：干预监测测试（Intervention monitoring tests）与传感器校准测试（Sensor Calibration tests）。 干预监测测试：两项干预监测测试分别在萨里（UoS）生活实验室与哈瑟尔特（UH）生活实验室开展。萨里地区的测试旨在表征绿色基础设施的运行特性，以及其对交通沿线污染物扩散的影响。本次共部署两套监测站，一套位于斯托克公园（Stoke Park）周边，另一套位于萨瑟兰纪念公园（Sutherland Memorial Park）周边（两处均位于英国吉尔福德）。哈瑟尔特地区则部署了两套生活实验室监测站：第一套用于监测哈瑟尔特Kuringen基础学校（Bassischool Kuringen）内的污染物浓度，另一套部署于哈瑟尔特大学周边。 传感器校准测试：涵盖CSIC、都柏林与博洛尼亚三地测试。本次在博洛尼亚（由博洛尼亚大学（UNIBO）于2018年开展）、都柏林（由都柏林大学（UCD）于2019年开展）以及巴塞罗那（由加泰罗尼亚建筑技术学院（IAAC）于2019年开展）的校准测试，旨在通过将iSCAPE生活实验室监测站（LLSs, Living Lab Stations）与参考仪器并置部署，评估传感器技术在户外环境中的性能表现。本数据集及其分析结果的完整说明可查阅iSCAPE项目的D7.8报告，获取地址为：https://www.iscapeproject.eu/results/。 <strong>传感器说明</strong> 本次使用的传感器分为市民套件（Citizen Kits）与智能市民套件（Smart Citizen Kits），以及生活实验室监测站（Living Lab Station）与智能市民监测站（Smart Citizen Station）。上述设备均为模块化硬件组件，搭载了下述用于环境监测的低成本传感器。智能市民监测站旨在拓展智能市民套件的功能，可通过更先进的传感器开展污染物监测。本硬件采用CERN开放硬件许可V1.2（CERN Open Hardware License V1.2）进行授权，其完整说明可在HardwareX开放获取期刊中查阅：https://doi.org/10.1016/j.ohx.2019.e00070。传感器文档可通过以下地址获取：https://docs.smartcitizen.me，或通过Zenodo平台的以下DOI获取：https://doi.org/10.5281/zenodo.2555029。 下述内容详细列出了市民套件所搭载的各类传感器，及其在上述CSV文件中对应的[通道标识]： 空气温度（℃）：Sensirion SHT-31 [TEMP] 相对湿度（%rh）：Sensirion SHT-31 [HUM] 噪声级（dBA）：Invensense ICS-434342 [NOISE_A] 环境光照（lux）：Rohm BH1721FVC [LIGHT] 大气压力（kPa）：NXP MPL3115A26 [PRESS] 颗粒物PM1/2.5/10（µg/m³）：Plantower PMS 5003 [EXT_PM_1, EXT_PM_25, EXT_PM_10] 下述内容详细列出了市民套件所搭载的各类传感器，及其在上述CSV文件中对应的[通道标识]： 空气温度（℃）：Sensirion SHT-31 [TEMP] 相对湿度（%REL）：Sensirion SHT-31 [HUM] 噪声级（dBA）：Invensense ICS-434342 [NOISE_A] 环境光照（Lux）：Rohm BH1721FVC [LIGHT] 大气压力与平均海平面高度（Pa与米）：NXP MPL3115A26 [PRESS] 一氧化碳（µg/m³，需定期进行基线校准）：SGX MICS-4514 [NA] 二氧化氮（µg/m³，需定期进行基线校准）：SGX MICS-4514 [NA] 一氧化碳（ppm）：Alphasense CO-B4 [GB_1W, GB_1A, 最终计算值CO_DELTAS_OVL_X-XX-XX - 所有值一致] 二氧化氮（ppb）：Alphasense NO2-B43F [GB_2W, GB_2A, 最终计算值NO2_DELTAS_OVL_0-30-50 或 NO2_DELTAS_OVL_0-5-50] 臭氧（ppb）：Alphasense OX-B431 [GB_3W, GB_3A, 最终值O3_DELTAS_OVL_0-30-50 或 O3_DELTAS_OVL_0-5-50] 气体板温度（℃）：Sensirion SHT-31 [GB_TEMP] 或 [EXT_TEMP] 气体板相对湿度（%REL）：Sensirion SHT-31 [GB_HUM] 或 [EXT_HUM] PM1（µg/m³）：Plantower PMS5003 [EXT_PM_1] 或 [EXT_PM_A_1]、[EXT_PM_B_1]（生活实验室监测站的每台PM传感器对应一组通道） PM2.5（µg/m³）：Plantower PMS5003 [EXT_PM_25] 或 [EXT_PM_A_25]、[EXT_PM_B_25]（生活实验室监测站的每台PM传感器对应一组通道） PM10（µg/m³）：Plantower PMS5003 [EXT_PM_10] 或 [EXT_PM_A_10]、[EXT_PM_B_10]（生活实验室监测站的每台PM传感器对应一组通道） 粒径0.3μm<0.5μm的颗粒物浓度（#/l）：Plantower PMS5003 [EXT_PN_03] 或 [EXT_PN_A_03]、[EXT_PN_B_03]（生活实验室监测站的每台PM传感器对应一组通道） 粒径0.5μm<1μm的颗粒物浓度（#/l）：Plantower PMS5003 [EXT_PN_05] 或 [EXT_PN_A_05]、[EXT_PN_B_05]（生活实验室监测站的每台PM传感器对应一组通道） 粒径1μm<2.5μm的颗粒物浓度（#/l）：Plantower PMS5003 [EXT_PN_1] 或 [EXT_PN_A_1]、[EXT_PN_B_1]（生活实验室监测站的每台PM传感器对应一组通道） 粒径2.5μm<5μm的颗粒物浓度（#/l）：Plantower PMS5003 [EXT_PN_25] 或 [EXT_PN_A_25]、[EXT_PN_B_25]（生活实验室监测站的每台PM传感器对应一组通道） 粒径5μm<10μm的颗粒物浓度（#/l）：Plantower PMS5003 [EXT_PN_5] 或 [EXT_PN_A_5]、[EXT_PN_B_5]（生活实验室监测站的每台PM传感器对应一组通道） 粒径>10μm的颗粒物浓度（#/l）：Plantower PMS5003 [EXT_PN_10] 或 [EXT_PN_A_10]、[EXT_PN_B_10]（生活实验室监测站的每台PM传感器对应一组通道） 带有_processed后缀的文件为经过预处理的文件，处理流程如下： 1. 使用pandas的重采样工具以均值法对数据进行重采样； 2. 清理缺失值（NaN）与错误读数； 3. 基于既定方法为电化学传感器添加计算结果。 <strong>数据查找指南</strong> 每个YAML文件对应一项测试的说明。每项测试包含同一地点、同一时间段内多台设备的监测记录。每个YAML文件包含以下字段： - author：负责开展测试的人员（仅为内部参考，无实际意义） - comment：对测试内容与目的的一般性描述 - commit：仅用于开发目的，对应测试所用智能市民设备的固件提交版本 - devices：包含多个可追溯字段的设备描述（详见下文） - id：测试名称 - project：测试所属项目，本次数据集均为iSCAPE项目 - report：若存在针对该测试的分析报告，则记录相关信息 - type_test：测试类型，分为室内、室外测试或其他类型 <strong>设备条目说明</strong> 对于测试中使用的每台设备，通用分类分为两类：低成本传感器（类型：STATION或KIT）与高端传感器（类型：REFERENCE）。 针对<strong>智能市民低成本传感器</strong>，其包含以下字段： - alphasense：按污染物分类的电化学传感器设备ID（用于厂商校准）及其安装插槽 - device_id：Smartcitizen API中的设备ID - fileNameInfo：未使用 - fileNameProc：（仅当source指定为csv时可用）预处理后文件名，例如2019-03_EXT_UCD_URBAN_BACKGROUND_API_CITY_COUNCIL_REF.csv - fileNameRaw：（仅当source指定为csv时可用）原始文件名 - frequency：原始记录频率 - location：仅用于时区校正，不代表精确位置 - max_date：最后一条记录的时间 - min_date：第一条记录的时间 - name：设备名称（一目了然） - pm_sensor：是否连接PM传感器（若未指定传感器，则默认均为PMS5003） - source：数据来源，可选api或csv - type：设备类型，可选STATION（KIT + Alphasense + 搭载两台PMS5003的PM板）或KIT - version：智能市民硬件版本 针对<strong>高端传感器</strong>，其包含以下字段： - channels：设备记录的内部转换通道 - names：CSV文件中的列名 - pollutants：对应监测的污染物种类 - units：污染物监测单位 - equipment：分析仪品牌 - fileNameProc：同前述预处理文件名 - fileNameRaw：同前述原始文件名 - index：时间索引格式，用于解析目的 - format：示例为'%Y-%m-%d %H:%M:%S' - frequency：设备记录频率 - name：列名称 - location：同前述位置字段 - name：设备名称 - type：设备类型，固定为REFERENCE - source：数据来源，固定为csv <strong>iSCAPE数据集编号</strong> 本次呈现的数据集对应以下iSCAPE数据集编号：DS_TS_049、DS_TS_050、DS_TS_051、DS_TS_052、DS_TS_053、DS_TS_055、DS_TS_056、DS_TS_057、DS_TS_058
