Spatial Attributes Extracted from Datasets in General-Purpose Repositories

This dataset contains results from research conducted for the bachelor's thesis Analysis of Many Records from General Repositories for Their Spatial Attributes. It is organized into several folders, reflecting the different stages of data processing, from raw metadata harvesting to refined geodata: 1_openaire graph dataset/ dataset.json_auszug_dryad.json_identifiers.pickle,dataset.json_auszug_figshare.json_identifiers.pickle,dataset.json_auszug_zenodo.json_identifiers.pickle:Each contain the identifiers extracted from the OpenAIRE Graph Dataset.(pickle) dataset.json_auszug_dryad.json_identifiers.pickle_shuffled.pickle,dataset.json_auszug_figshare.json_identifiers.pickle_shuffled.pickle,dataset.json_auszug_zenodo.json_identifiers.pickle_shuffled.pickle:Each contains the randomly shuffled identifiers.(pickle) statistics/1_statistics.json:Contains statistics that were created as part of the execution of the Jupyter notebook. (JSON) 2_result of threaded_metadata_harvester/ metadata_db.json:The original metadata records downloaded via REST API from Dryad, Figshare and Zenodo between May 13, 2025, and May 18, 2025. (TinyDB) checkpoint.pickle:A checkpoint file containing the progress and statistics of the metadata harvesting process. (pickle) 3_result of threaded_dataset_analysis/ metadata_db_vacuum.sqlite3:The primary, cleaned database. It is a converted version of the TinyDB, enriched with the results of the spatial analysis performed by geoextent. (SQLite3) metadata_db_vacuum.csv:A complete export of the SQLite database, containing all normalized metadata from the harvested datasets. (CSV) metadata_db_vacuum_processed.csv:A partial export, containing only the metadata of datasets that were processed and analyzed. metadata_db_vacuum_processed_with_bbox.csv:A partial export, containing only the metadata of datasets that were processed and analyzed and contain a bounding box. (CSV) metadata_db_vacuum.sqlite3_statistics.csv:Contains statistics of the datasets. (CSV) 4_geopackages/ metadata_db_vacuum.gpkg:Contains all datasets with their respective bounding box as polygon features. (GeoPackage) metadata_db_vacuum_center.gpkg:Contains all datasets with their geographical centroids as point features. (GeoPackage) 5_poster/ This folder contains the accompanying maps as DIN A3 posters. These images correspond to the illustrations referenced in the thesis. 01_poster_frame.pdfRepresentation of all bounding boxes with a black outline. (PDF) 02_poster_f_a(x)=x.pdfRepresentation of all bounding boxes with values scaled by $f_a(x) = x$. (PDF) 03_poster_g_a(x)=x^2.pdfRepresentation of all bounding boxes with values scaled by $g_a(x) = x^2$. (PDF) 04_poster_g_b(x)=1-x^2.pdfRepresentation of all bounding boxes with values scaled by $g_b(x) = 1 - x^2$. (PDF) 05_poster_f_b(x)=1-x.pdfRepresentation of all bounding boxes with values scaled by $f_b(x) = 1 - x$. (PDF) 06_poster_g_c(x)=(1-x)^2.pdfRepresentation of all bounding boxes with values scaled by $g_c(x) = (1 - x)^2$. (PDF) 07_poster_h_{50}(x)=1frac(50x).pdfRepresentation of all bounding boxes with values scaled by $h_{50}(x) = 1/(50x)$. (PDF) 08_poster_h_{100}(x)=1frac(100x).pdfRepresentation of all bounding boxes with values scaled by $h_{100}(x) = 1/(100x)$. (PDF) 09_poster_h_{200}(x)=1frac(200x).pdfRepresentation of all bounding boxes with values scaled by $h_{200}(x) = 1/(200x)$. (PDF) 10_poster_circles_white.pdfRepresentation of the centroids of all bounding boxes. (PDF) 11_poster_circles_diff_sizes.pdfRepresentation of all bounding boxes by colored circles of variable size at the centroids. (PDF) 12_poster_deg30.pdfRepresentation of the counted bounding boxes with grid intervals of 30°. (PDF) 13_poster_deg15.pdfRepresentation of the counted bounding boxes with grid intervals of 15°. (PDF) 14_poster_deg10.pdfRepresentation of the counted bounding boxes with grid intervals of 10°. (PDF) 15_poster_countries.pdfNumber of bounding boxes per country. (PDF) 16_poster_countries_area.pdfNumber of bounding boxes per area of the countries. (PDF) 17_poster_countries_pop.pdfNumber of bounding boxes per population of the countries. (PDF) 18_poster_countries_gdp.pdfNumber of bounding boxes per gross domestic product of the countries. (PDF)本数据集包含为学士学位论文《通用仓储多记录空间属性分析》（Analysis of Many Records from General Repositories for Their Spatial Attributes）开展的研究成果。数据集按数据处理的不同阶段划分为多个文件夹，覆盖从原始元数据采集到精细化地理数据的全流程： 1_openaire graph dataset/ 该文件夹包含以下内容： 1. 原始标识符文件：`dataset.json_auszug_dryad.json_identifiers.pickle`、`dataset.json_auszug_figshare.json_identifiers.pickle`、`dataset.json_auszug_zenodo.json_identifiers.pickle`，均存储从OpenAIRE图数据集（OpenAIRE Graph Dataset）中提取的标识符（Pickle格式）。 2. 打乱后的标识符文件：`dataset.json_auszug_dryad.json_identifiers.pickle_shuffled.pickle`、`dataset.json_auszug_figshare.json_identifiers.pickle_shuffled.pickle`、`dataset.json_auszug_zenodo.json_identifiers.pickle_shuffled.pickle`，均存储经过随机打乱的标识符（Pickle格式）。 `statistics/1_statistics.json`：包含通过Jupyter Notebook运行过程中生成的统计数据（JSON格式）。 2_result of threaded_metadata_harvester/ `metadata_db.json`：2025年5月13日至5月18日期间，通过REST API从Dryad、Figshare和Zenodo平台下载的原始元数据记录（TinyDB格式）。 `checkpoint.pickle`：存储元数据采集进程的进度与统计信息的检查点文件（Pickle格式）。 3_result of threaded_dataset_analysis/ `metadata_db_vacuum.sqlite3`：经过清洗的核心数据库，由TinyDB转换而来，并补充了geoextent工具执行空间分析得到的结果（SQLite3格式）。 `metadata_db_vacuum.csv`：SQLite数据库的完整导出文件，包含采集到的所有标准化元数据（CSV格式）。 `metadata_db_vacuum_processed.csv`：部分导出文件，仅包含已完成处理与分析的数据集元数据。 `metadata_db_vacuum_processed_with_bbox.csv`：部分导出文件，仅包含已完成处理、分析且包含边界框（bounding box）的数据集元数据（CSV格式）。 `metadata_db_vacuum.sqlite3_statistics.csv`：包含数据集的统计信息（CSV格式）。 4_geopackages/ `metadata_db_vacuum.gpkg`：包含所有数据集及其对应边界框的多边形要素数据（地理数据包GeoPackage格式）。 `metadata_db_vacuum_center.gpkg`：包含所有数据集的地理质心的点要素数据（地理数据包GeoPackage格式）。 5_poster/ 该文件夹包含配套的DIN A3幅面海报地图，对应论文中提及的各类插图。 `01_poster_frame.pdf`：以黑色轮廓绘制所有边界框的可视化效果图（PDF格式）。 `02_poster_f_a(x)=x.pdf`：以函数$f_a(x) = x$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `03_poster_g_a(x)=x^2.pdf`：以函数$g_a(x) = x^2$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `04_poster_g_b(x)=1-x^2.pdf`：以函数$g_b(x) = 1 - x^2$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `05_poster_f_b(x)=1-x.pdf`：以函数$f_b(x) = 1 - x$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `06_poster_g_c(x)=(1-x)^2.pdf`：以函数$g_c(x) = (1 - x)^2$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `07_poster_h_{50}(x)=1/(50x).pdf`：以函数$h_{50}(x) = 1/(50x)$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `08_poster_h_{100}(x)=1/(100x).pdf`：以函数$h_{100}(x) = 1/(100x)$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `09_poster_h_{200}(x)=1/(200x).pdf`：以函数$h_{200}(x) = 1/(200x)$对边界框数值进行缩放后的可视化效果图（PDF格式）。 `10_poster_circles_white.pdf`：绘制所有边界框质心的可视化效果图（PDF格式）。 `11_poster_circles_diff_sizes.pdf`：以不同尺寸的彩色圆形在质心位置绘制所有边界框的可视化效果图（PDF格式）。 `12_poster_deg30.pdf`：以30°网格间隔统计边界框数量的可视化效果图（PDF格式）。 `13_poster_deg15.pdf`：以15°网格间隔统计边界框数量的可视化效果图（PDF格式）。 `14_poster_deg10.pdf`：以10°网格间隔统计边界框数量的可视化效果图（PDF格式）。 `15_poster_countries.pdf`：按国家统计边界框数量的可视化效果图（PDF格式）。 `16_poster_countries_area.pdf`：按国家国土面积统计边界框数量的可视化效果图（PDF格式）。 `17_poster_countries_pop.pdf`：按国家人口数量统计边界框数量的可视化效果图（PDF格式）。 `18_poster_countries_gdp.pdf`：按国家国内生产总值（GDP）统计边界框数量的可视化效果图（PDF格式）。