Dataset relating a study on Geospatial Open Data usage and metadata quality

The Open Government Data portals (OGD) thanks to the presence of thousands of geo-referenced datasets, containing spatial information, are of extreme interest for any analysis or process relating to the territory. For this to happen, users must be enabled to access these datasets and reuse them. An element often considered hindering the full dissemination of OGD data is the quality of their metadata. Starting from an experimental investigation conducted on over 160,000 geospatial datasets belonging to six national and international OGD portals, this work has as its first objective to provide an overview of the usage of these portals measured in terms of datasets views and downloads. Furthermore, to assess the possible influence of the quality of the metadata on the use of geospatial datasets, an assessment of the metadata for each dataset was carried out, and the correlation between these two variables was measured. The results obtained showed a significant underutilization of geospatial datasets and a generally poor quality of their metadata. Besides, a weak correlation was found between the use and quality of the metadata, not such as to assert with certainty that the latter is a determining factor of the former. The dataset consists of six zipped CSV files, containing the collected datasets' usage data, full metadata, and computed quality values, for about 160,000 geospatial datasets belonging to the three national and three international portals considered in the study, i.e. US (catalog.data.gov), Colombia (datos.gov.co), Ireland (data.gov.ie), HDX (data.humdata.org), EUODP (data.europa.eu), and NASA (data.nasa.gov). Data collection occurred in the period: 2019-12-19 -- 2019-12-23. The header for each CSV file is: <strong>[ ,portalid,id,downloaddate,metadata,overallq,qvalues,assessdate,dviews,downloads,engine,admindomain]</strong> where for each row (a portal's dataset) the following fields are defined as follows: <strong>portalid</strong>: portal identifier <strong>id</strong>: dataset identifier <strong>downloaddate</strong>: date of data collection <strong>metadata</strong>: the overall dataset's metadata downloaded via API from the portal according to the supporting platform schema <strong>overallq</strong>: overall quality values computed by applying the methodology presented in [1] <strong>qvalues</strong>: json object containing the quality values computed for the 17 metrics presented in [1] <strong>assessdate</strong>: date of quality assessment <strong>dviews</strong>: number of total views for the dataset <strong>downloads</strong>: number of total downloads for the dataset (made available only by the Colombia, HDX, and NASA portals) <strong>engine</strong>: identifier of the supporting portal platform: 1(CKAN), 2 (Socrata) <strong>admindomain</strong>: 1 (national), 2 (international) [1] Neumaier, S.; Umbrich, J.; Polleres, A. Automated Quality Assessment of Metadata Across Open Data Portals.J. Data and Information Quality2016,8, 2:1–2:29. doi:10.1145/2964909开放政府数据门户（Open Government Data，简称OGD）凭借数千条包含空间信息的地理参考数据集（geo-referenced datasets），在所有涉及地域的分析与应用场景中均具有极高的研究与应用价值。需确保用户能够访问并复用此类数据集，方能发挥这些数据的全部潜力。而阻碍OGD数据全面传播的常见因素之一，便是其元数据（metadata）的质量水平。 本研究基于对隶属于6个国家级和国际级OGD门户的逾16万条地理空间数据集（geospatial datasets）开展的实验性调查，首要目标是从数据集浏览量与下载量的维度，对这些门户的使用情况进行全面综述。此外，为评估元数据质量对地理空间数据集使用情况的潜在影响，研究人员对每个数据集的元数据进行了质量评估，并测算二者间的相关性。 研究结果显示，地理空间数据集存在严重的未充分利用情况，且其元数据质量普遍偏低。此外，研究发现数据集使用情况与元数据质量之间仅存在微弱相关性，无法确凿断言元数据质量是决定数据集使用情况的关键因素。 本数据集包含6个压缩CSV（Comma-Separated Values）文件，收录了本研究涉及的3个国家级、3个国际级OGD门户的约16万条地理空间数据集的使用数据、完整元数据以及计算得到的质量值。本次研究涉及的门户具体包括：美国（catalog.data.gov）、哥伦比亚（datos.gov.co）、爱尔兰（data.gov.ie）、人道主义数据交换（Humanitarian Data Exchange，HDX，data.humdata.org）、欧盟开放数据门户（EU Open Data Portal，EUODP，data.europa.eu）以及美国国家航空航天局（National Aeronautics and Space Administration，NASA，data.nasa.gov）。 数据采集时段为2019年12月19日至2019年12月23日。 每个CSV文件的表头为：<strong>[ ,portalid,id,downloaddate,metadata,overallq,qvalues,assessdate,dviews,downloads,engine,admindomain]</strong>，其中每一行对应一个门户的单条数据集，各字段定义如下： <strong>portalid</strong>：门户标识符 <strong>id</strong>：数据集标识符 <strong>downloaddate</strong>：数据采集日期 <strong>metadata</strong>：通过应用程序编程接口（Application Programming Interface，API）从对应门户按照支撑平台规范下载的完整数据集元数据 <strong>overallq</strong>：采用文献[1]提出的方法计算得到的数据集整体质量值 <strong>qvalues</strong>：包含文献[1]中提及的17项指标计算所得质量值的JSON（JavaScript Object Notation）对象 <strong>assessdate</strong>：质量评估日期 <strong>dviews</strong>：数据集总浏览量 <strong>downloads</strong>：数据集总下载量（仅哥伦比亚、HDX及NASA门户提供该字段数据） <strong>engine</strong>：支撑门户平台的标识符：1（CKAN）、2（Socrata） <strong>admindomain</strong>：门户层级标识：1（国家级门户）、2（国际级门户） [1] Neumaier, S.; Umbrich, J.; Polleres, A. Automated Quality Assessment of Metadata Across Open Data Portals. *J. Data and Information Quality* 2016, 8, 2:1–2:29. doi:10.1145/2964909