遇见数据集

Intermediate JSONL for Softcite Extractions from the Open Access Literature

收藏
Zenodo2025-04-04 更新2026-05-26 收录
官方服务:

资源简介:

Check documentation at https://github.com/softcite/softcite-extractions-oa This archive is an intermediate resource used in the pipeline that created the parquet files available at https://doi.org/10.5281/zenodo.15066399 While this archive is ~26 GiB the parquet files are much easier to handle at about 5 GiB and are better documented. As I create this seems to me that the only reason that one would be working with these files is to understand conversion issues, to work with the extractions from non-PDF files, or to access additional metadata extracted by GROBID (although the only additional metadata not in the parquet files should be accessible from the article DOI via cross-ref). Note, though, that those extractions are sparse and some files incomplete. See additional details in the README inside the archive or at https://github.com/softcite/softcite-extractions-oa/blob/main/EXTRACTING_TABLES.md This work used JetStream 2 at Indiana through allocation CIS220172 from the Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) program, which is supported by National Science Foundation grants #2138259, #2138286, #2138307, #2137603, and #2138296. The authors acknowledge the Texas Advanced Computing Center (TACC) at The University of Texas at Austin for providing computational resources that have contributed to the creation and processing of this research dataset. URL: http://www.tacc.utexas.edu Version Notes v 1.0.1 Removed files restrictions v 1 Initial upload and beta testing

详细文档请访问:https://github.com/softcite/softcite-extractions-oa 本归档文件为生成Parquet(帕科)文件的数据流水线的中间资源,相关Parquet文件可通过https://doi.org/10.5281/zenodo.15066399获取。 本归档文件大小约为26 GiB,而Parquet文件仅约5 GiB,不仅更易于处理,还附带更完善的文档说明。 依我之见,使用此类文件的场景仅包括以下几类:排查格式转换问题、处理非PDF文件的提取结果,或获取由GROBID提取的额外元数据(尽管Parquet文件中未收录的额外元数据,均可通过CrossRef(交叉引用服务)基于文章DOI获取)。需注意,此类提取结果较为零散,且部分文件存在不完整的情况。更多细节可参阅归档文件内的README文档,或访问https://github.com/softcite/softcite-extractions-oa/blob/main/EXTRACTING_TABLES.md查看。 本研究依托印第安纳大学的JetStream 2集群开展,使用了由高级网络基础设施协调生态系统:服务与支持(ACCESS)计划分配的编号为CIS220172的计算资源,该计划由美国国家科学基金会资助,资助编号为#2138259、#2138286、#2138307、#2137603及#2138296。作者感谢德克萨斯大学奥斯汀分校德克萨斯高级计算中心(TACC)提供的计算资源,其为本研究数据集的构建与处理提供了支持。相关网址:http://www.tacc.utexas.edu 版本说明 v1.0.1:移除文件访问限制 v1.0:首次上传并开展beta测试

提供机构:
Zenodo
创建时间:
2025-04-04
二维码
社区交流群
二维码
科研交流群
商业服务