unarXive: All arXiv Publications Pre-Processed for NLP, Including Structured Full-Text and Citation Network (open subset)

Description
unarXive is a scholarly data set containing publications' structured full-text, annotated in-text citations, linked non-text content (mathematical notation, figure/table captions) and a citation network.
The data is generated from all LaTeX sources on arXiv and therefore of higher quality than data generated from PDF files.
Typical uses are

Training of ML models (citation recommendation, summarization, LLMs)
Citation context analysis
Bibliographic analyses
Access
┏━━━━━━━━━━━━━━━━━━━━━━━━━━┓┃  D O W N L O A D   S A M P L E   ┃┗━━━━━━━━━━━━━━━━━━━━━━━━━━┛
Regarding the full data set, please note the following:

Note: this Zenodo record is the "open subset" of unarXive, which contains all permissively licensed papers from arXiv.org. You can find the full version here.
The code used for generating the data set is publicly available.

### 数据集说明
unarXive 是一款学术数据集，收录了出版物的结构化全文、带标注的文内引用、关联的非文本内容（数学公式、图表题注）以及引用网络。
该数据集源自 arXiv 平台上的全部 LaTeX 源码，因此其质量优于从 PDF 文件生成的同类数据集。
其典型应用场景包括：
1. 机器学习模型训练（涵盖引用推荐、文本摘要、大语言模型（Large Language Model）训练）
2. 引用上下文分析
3. 文献计量分析

#### 数据集获取
┏━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ 下载示例 ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━┛

关于完整数据集，请留意以下说明：
注意：本 Zenodo 记录为 unarXive 的"开放子集"，包含 arXiv.org 上所有获得宽松许可的论文。完整数据集可通过此处获取。
用于生成该数据集的代码已对外公开。