five

unarXive: All arXiv Publications Pre-Processed for NLP, Including Structured Full-Text and Citation Network (full)

收藏
Zenodo2023-11-03 更新2026-05-26 收录
下载链接:
https://zenodo.org/doi/10.5281/zenodo.7752754
下载链接
链接失效反馈
官方服务:
资源简介:
Description unarXive is a scholarly data set containing publications' structured full-text, annotated in-text citations, linked non-text content (mathematical notation, figure/table captions) and a citation network. The data is generated from all LaTeX sources on arXiv and therefore of higher quality than data generated from PDF files. Typical uses are Training of ML models (citation recommendation, summarization, LLMs) Citation context analysis Bibliographic analyses Access ┏━━━━━━━━━━━━━━━━━━━━━━━━━━┓┃  D O W N L O A D   S A M P L E   ┃┗━━━━━━━━━━━━━━━━━━━━━━━━━━┛ To download the whole data set send an access request and note the following: Note: this Zenodo record is the "full" version of unarXive, which was generated from all of arXiv.org including non-permissively licensed papers. Make sure that your use of the data is compliant with the paper's licensing terms.¹Alternatively you can use the unarXive open subset. ¹ For information on papers' licenses use arXiv's bulk metadata access. The code for generating the data set is publicly available.
提供机构:
Zenodo
创建时间:
2023-03-27
二维码
社区交流群
二维码
科研交流群
商业服务