Gredora/arxiv_pretrain

这是一个包含了多个字段的数据集，其中包括提交者信息、作者、标题、评论、期刊引用、DOI编号、报告编号、分类、许可证、文本内容、版本信息、更新日期、解析后的作者信息、摘要中的token数量等。数据集分为训练集、验证集和测试集三个部分，分别用于不同的训练和评估需求。

This dataset includes multiple fields such as submitter information, authors, title, comments, journal references, DOI numbers, report numbers, categories, licenses, text content, version information, update dates, parsed author information, and the number of tokens in the abstract. The dataset is divided into three parts: training set, validation set, and test set, which are used for different training and evaluation purposes.