iSCAPE Low Cost Sensor Development Data
收藏资源简介：
<strong>Dataset Description</strong> This dataset contains all the tests used for the low-cost sensor development during the iSCAPE project. The dataset is divided in a series of tests, each of them described on a yaml file with the test name. Each csv file contains time series data of each experiment, and the yaml files contain the lists of devices used in each test. The tests are described in the comment of the yaml file, and are meant to be self explanatory. The conditions of the test and the purpose vary, and their reports are also included. <strong>Sensors</strong> The sensors used are herein referred as Citizen Kits or Smart Citizen Kits, and the Living Lab Station or Smart Citizen Station. These are a set of modular hardware components that feature a selection of low cost sensors for environmental monitoring listed below. The Smart Citizen Station is meant to expand the capabilities of the Smart Citizen Kit, aiming to measure pollutants with more advanced sensors. The hardware is licensed under CERN Open Hardware License V1.2 and is fully described in the HardwareX Open Access publication: https://doi.org/10.1016/j.ohx.2019.e00070. The sensor documentation can be found at https://docs.smartcitizen.me and with this DOI at Zenodo: https://doi.org/10.5281/zenodo.2555029. In the list below, the different sensors for the Citizen Kits are detailed, and their [CHANNELS] in the csv files above linked. Air temperature (ºC): Sensirion SHT-31 [TEMP] Relative Humidity (%rh): Sensirion SHT-31 [HUM] Noise level (dBA): Invensense ICS-434342 [NOISE_A] Ambient light (lux): Rohm BH1721FVC [LIGHT] Barometric pressure (kPa): NXP MPL3115A26 [PRESS] Particulate Matter PM 1 / 2.5 / 10 (µg/m3) Planttower PMS 5003 [EXT_PM_1,EXT_PM_25,EXT_PM_10] In the list below, the different sensors for the Citizen Kits are detailed, and their [CHANNELS] in the csv files above linked. Air Temperature (ºC) Sensirion SHT-31 [TEMP] Relative Humidity (% REL) Sensirion SHT-31 [HUM] Noise Level (dBA) Invensense ICS-434342 [NOISE_A] Ambient Light (Lux) Rohm BH1721FVC [LIGHT] Barometric pressure and AMSL (Pa and Meters) NXP MPL3115A26 [PRESS] Carbon Monoxide (µg/m3 (Periodic Baseline Calibration Required) SGX MICS-4514 [NA] Nitrogen Dioxide (µg/m3 (Periodic Baseline Calibration Required) SGX MICS-4514 [NA] Carbon Monoxide (ppm) Alphasense CO-B4 [GB_1W, GB_1A] Nitrogen Dioxide (ppb) Alphasense NO2-B43F [GB_2W, GB_2A] Ozone (ppb) Alphasense OX-B431 [GB_3W, GB_3A] Gases Board Temperature (ºC) Sensirion SHT-31 [GB_TEMP] or [EXT_TEMP] Gases Board Rel. Humidity (% REL) Sensirion SHT-31 [GB_HUM] or [EXT_HUM] PM 1 (µg/m3) Plantower PMS5003 [EXT_PM_1] or [EXT_PM_A_1], [EXT_PM_B_1] for each PM sensor in the case of the Living Lab Station PM 2.5 (µg/m3) Plantower PMS5003 [EXT_PM_25] or [EXT_PM_A_25], [EXT_PM_B_25] for each PM sensor in the case of the Living Lab Station PM 10 (µg/m3) Plantower PMS5003 [EXT_PM_10] or [EXT_PM_A_10], [EXT_PM_B_10] for each PM sensor in the case of the Living Lab Station PN between 0.3um<0.5um particle size (#/l) Plantower PMS5003 [EXT_PN_03] or [EXT_PN_A_03], [EXT_PN_B_03] for each PM sensor in the case of the Living Lab Station PN between 0.5um<1um particle size (#/l) Plantower PMS5003 [EXT_PN_05] or [EXT_PN_A_05], [EXT_PN_B_05] for each PM sensor in the case of the Living Lab Station PN between 1m<2.5um particle size (#/l) Plantower PMS5003 [EXT_PN_1] or [EXT_PN_A_1], [EXT_PN_B_1] for each PM sensor in the case of the Living Lab Station PN between 2.5m<5um particle size (#/l) Plantower PMS5003 [EXT_PN_25] or [EXT_PN_A_25], [EXT_PN_B_25] for each PM sensor in the case of the Living Lab Station PN between 5m<10um particle size (#/l) Plantower PMS5003 [EXT_PN_5] or [EXT_PN_A_5], [EXT_PN_B_5] for each PM sensor in the case of the Living Lab Station PN between >10um particle size (#/l) Plantower PMS5003 [EXT_PN_10] or [EXT_PN_A_10], [EXT_PN_B_10] for each PM sensor in the case of the Living Lab Station <strong>How to find the data</strong> Each yaml file contains the description of a test. Each test is comprised of recordings of several devices in the same location and during the same period. Each yaml file is comprised of the following fields: author: who has been in charge of performing the test (internal reference - not relevant) comment: describing in general terms what was done in the test, and with what purpose commit: the firmware commit (in the case of Smart Citizen devices) with which the test was performed, for development purposes only devices: a descriptor containing different fields for traceability (below) id: the test name project: within the test was performed, in this case it is always iscape report: if there is any report analysing the test type_test: indoor, oudoor test or other. <strong>Description of devices entry</strong> For each device that was used in the test, two generic types are used: low cost sensors (type: STATION or KIT) high end sensors (type: REFERENCE) For <strong>low cost Smart Citizen sensors</strong>, the fields are: alphasense: electrochemical sensors device ids, by pollutant (for manufacturer calibration) and slots in which they were placed device_id: device id in Smartcitizen API fileNameInfo: not used fileNameProc: (only if source = csv is specified) 2019-03_EXT_UCD_URBAN_BACKGROUND_API_CITY_COUNCIL_REF.csv fileNameRaw: (only if source = csv is used) raw file name frequency: original recording frequency location: for timezone correction only, not accurate max_date: last recording date min_date: first recording date name: self-explanatory pm_sensor: if there was a pm sensor connected (all of them are PMS5003 if no sensor is specified) source: api or csv type: STATION (KIT + Alphasense + PM board with two PMS5003) or KIT version: smartcitizen hardware version For <strong>high end</strong> sensors, the fields are: channels: which channels the device was recording for internal convertion names: which are the columns in the csv file pollutants: which pollutants do they respectively refer to units: the units of these pollutants equipment: the brand of the analyser fileNameProc: same as above fileNameRaw: same as above index: format in which the timeindex is done, for parsing purposes format: (example '%Y-%m-%d %H:%M:%S') frequency: frequency at which the device was recorded name: column name location: same as above name: name of the device type: REFERENCE (always for these devices) source: csv <strong>iSCAPE Dataset Reference Numbers:</strong> The datasets here presented are related to the following iSCAPE dataset reference numbers: DS_TS_054 DS_TS_062 DS_TS_063 DS_TS_065 DS_TS_067 DS_TS_068 DS_TS_069 DS_TS_070 DS_TS_071 DS_TS_072 DS_TS_073 DS_TS_074 DS_TS_075 DS_TS_076 DS_TS_077 DS_TS_078 DS_TS_079 DS_TS_080 DS_TS_081 DS_TS_084 DS_TS_088 DS_TS_089 DS_TS_090 DS_TS_092
## 数据集说明 本数据集涵盖了iSCAPE项目期间用于低成本传感器开发的全部测试用例。该数据集按测试序列划分，每个测试均以YAML文件（YAML）进行描述，文件名即为测试名称。每个CSV文件（CSV）包含对应实验的时序数据，YAML文件则记录了各测试中使用的设备列表。测试细节已写入YAML文件的注释中，可自行阅读理解。测试的条件与目标各不相同，相关分析报告也已一并收录。 ## 传感器 本数据集所用传感器统称为市民套件（Citizen Kits）或智能市民套件（Smart Citizen Kits），以及实验室工作站（Living Lab Station）或智能市民工作站（Smart Citizen Station）。此类设备为模块化硬件组件集合，搭载了一系列用于环境监测的低成本传感器，详情如下。智能市民工作站旨在拓展智能市民套件的功能，可通过更先进的传感器测量污染物。该硬件采用CERN开源硬件许可证V1.2（CERN Open Hardware License V1.2）进行授权，完整技术说明可查阅《HardwareX》开源期刊论文：https://doi.org/10.1016/j.ohx.2019.e00070。传感器文档可访问https://docs.smartcitizen.me获取，亦可通过Zenodo的DOI：https://doi.org/10.5281/zenodo.2555029查阅。 以下为市民套件搭载的各类传感器及其对应CSV文件中的通道标识： 1. 空气温度（℃）：Sensirion SHT-31，对应通道[TEMP] 2. 相对湿度（%rh）：Sensirion SHT-31，对应通道[HUM] 3. 噪声级（dBA）：Invensense ICS-434342，对应通道[NOISE_A] 4. 环境光照（lux）：Rohm BH1721FVC，对应通道[LIGHT] 5. 气压（kPa）：NXP MPL3115A26，对应通道[PRESS] 6. 颗粒物PM1/2.5/10（µg/m³）：Plantower PMS 5003，对应通道[EXT_PM_1,EXT_PM_25,EXT_PM_10] 以下为更多传感器详情及其对应CSV通道： 1. 空气温度（℃）：Sensirion SHT-31，对应通道[TEMP] 2. 相对湿度（% REL）：Sensirion SHT-31，对应通道[HUM] 3. 噪声级（dBA）：Invensense ICS-434342，对应通道[NOISE_A] 4. 环境光照（Lux）：Rohm BH1721FVC，对应通道[LIGHT] 5. 气压及平均海平面高度（Pa与米）：NXP MPL3115A26，对应通道[PRESS] 6. 一氧化碳（µg/m³，需定期基线校准）：SGX MICS-4514，对应通道[NA] 7. 二氧化氮（µg/m³，需定期基线校准）：SGX MICS-4514，对应通道[NA] 8. 一氧化碳（ppm）：Alphasense CO-B4，对应通道[GB_1W, GB_1A] 9. 二氧化氮（ppb）：Alphasense NO2-B43F，对应通道[GB_2W, GB_2A] 10. 臭氧（ppb）：Alphasense OX-B431，对应通道[GB_3W, GB_3A] 11. 气板温度（℃）：Sensirion SHT-31，对应通道[GB_TEMP]或[EXT_TEMP] 12. 气板相对湿度（% REL）：Sensirion SHT-31，对应通道[GB_HUM]或[EXT_HUM] 13. PM1（µg/m³）：Plantower PMS5003，对于实验室工作站的多传感器配置，对应通道为[EXT_PM_1]或[EXT_PM_A_1]、[EXT_PM_B_1] 14. PM2.5（µg/m³）：Plantower PMS5003，对应通道[EXT_PM_25]或[EXT_PM_A_25]、[EXT_PM_B_25] 15. PM10（µg/m³）：Plantower PMS5003，对应通道[EXT_PM_10]或[EXT_PM_A_10]、[EXT_PM_B_10] 16. 粒径0.3μm<0.5μm颗粒物数浓度（#/l）：Plantower PMS5003，对应通道[EXT_PN_03]或[EXT_PN_A_03]、[EXT_PN_B_03] 17. 粒径0.5μm<1μm颗粒物数浓度（#/l）：Plantower PMS5003，对应通道[EXT_PN_05]或[EXT_PN_A_05]、[EXT_PN_B_05] 18. 粒径1μm<2.5μm颗粒物数浓度（#/l）：Plantower PMS5003，对应通道[EXT_PN_1]或[EXT_PN_A_1]、[EXT_PN_B_1] 19. 粒径2.5μm<5μm颗粒物数浓度（#/l）：Plantower PMS5003，对应通道[EXT_PN_25]或[EXT_PN_A_25]、[EXT_PN_B_25] 20. 粒径5μm<10μm颗粒物数浓度（#/l）：Plantower PMS5003，对应通道[EXT_PN_5]或[EXT_PN_A_5]、[EXT_PN_B_5] 21. 粒径>10μm颗粒物数浓度（#/l）：Plantower PMS5003，对应通道[EXT_PN_10]或[EXT_PN_A_10]、[EXT_PN_B_10] ## 数据获取方式 每个YAML文件对应一项测试。每项测试包含同一地点、同一时间段内多台设备的录制数据。YAML文件包含以下字段： - `author`：负责执行测试的人员（内部参考信息，无实际参考价值） - `comment`：概述测试内容与测试目标 - `commit`：测试所用的固件提交版本（仅针对智能市民设备，用于开发场景） - `devices`：包含多字段的设备可追溯描述（详见下文） - `id`：测试名称 - `project`：测试所属项目，本数据集内固定为`iSCAPE` - `report`：测试分析报告（若存在） - `type_test`：测试类型，包括室内、室外或其他类型 ## 设备条目说明 对于测试中使用的每台设备，采用两种通用类型分类：低成本传感器（类型：`STATION`或`KIT`）与高端传感器（类型：`REFERENCE`）。 ### 低成本智能市民传感器 此类传感器的字段说明如下： - `alphasense`：电化学传感器的设备ID（按污染物分类，用于厂商校准）及其安装插槽 - `device_id`：Smartcitizen API中的设备ID - `fileNameInfo`：未使用 - `fileNameProc`：（仅当`source`指定为`csv`时生效）处理后文件名，例如`2019-03_EXT_UCD_URBAN_BACKGROUND_API_CITY_COUNCIL_REF.csv` - `fileNameRaw`：（仅当`source`指定为`csv`时生效）原始文件名 - `frequency`：原始录制频率 - `location`：仅用于时区校正，不代表精确位置 - `max_date`：最后一条录制数据的时间戳 - `min_date`：第一条录制数据的时间戳 - `name`：设备名称（自解释） - `pm_sensor`：是否连接PM传感器（若未指定传感器，则默认均为PMS5003） - `source`：数据来源，可选`api`或`csv` - `type`：设备类型，可选`STATION`（KIT + Alphasense + 搭载双PMS5003的PM板）或`KIT` - `version`：Smartcitizen硬件版本 ### 高端传感器 此类传感器的字段说明如下： - `channels`：用于内部转换的设备录制通道 - `names`：CSV文件中的对应列名 - `pollutants`：各通道分别对应检测的污染物种类 - `units`：对应污染物的测量单位 - `equipment`：分析仪品牌 - `fileNameProc`：同前述定义 - `fileNameRaw`：同前述定义 - `index`：时间索引格式，用于数据解析 - `format`：时间格式示例：`'%Y-%m-%d %H:%M:%S'` - `frequency`：设备录制频率 - `name`：列名称 - `location`：同前述定义 - `name`：设备名称 - `type`：设备类型，固定为`REFERENCE` - `source`：数据来源，固定为`csv` ## iSCAPE数据集参考编号 本数据集包含以下iSCAPE数据集参考编号： DS_TS_054、DS_TS_062、DS_TS_063、DS_TS_065、DS_TS_067、DS_TS_068、DS_TS_069、DS_TS_070、DS_TS_071、DS_TS_072、DS_TS_073、DS_TS_074、DS_TS_075、DS_TS_076、DS_TS_077、DS_TS_078、DS_TS_079、DS_TS_080、DS_TS_081、DS_TS_084、DS_TS_088、DS_TS_089、DS_TS_090、DS_TS_092
