Andyrasika/arXiv-Dataset

For nearly 30 years, ArXiv has served the public and research communities by providing open access to scholarly articles, from the vast branches of physics to the many subdisciplines of computer science to everything in between, including math, statistics, electrical engineering, quantitative biology, and economics. This rich corpus of information offers significant, but sometimes overwhelming depth.

In these times of unique global challenges, efficient extraction of insights from data is essential. To help make the arXiv more accessible, we present a free, open pipeline on Kaggle to the machine-readable arXiv dataset: a repository of 1.7 million articles, with relevant features such as article titles, authors, categories, abstracts, full text PDFs, and more.

Our hope is to empower new use cases that can lead to the exploration of richer machine learning techniques that combine multi-modal features towards applications like trend analysis, paper recommender engines, category prediction, co-citation networks, knowledge graph construction and semantic search interfaces.

The dataset is freely available via Google Cloud Storage buckets (more info here). Stay tuned for weekly updates to the dataset!

ArXiv is a collaboratively funded, community-supported resource founded by Paul Ginsparg in 1991 and maintained and operated by Cornell University.

原始信息汇总

数据集概述

数据集内容

• 包含1.7百万篇学术文章。
• 文章涵盖特征包括：标题、作者、分类、摘要、全文PDF等。

数据集用途

• 支持趋势分析、论文推荐引擎、分类预测、共引网络、知识图谱构建和语义搜索接口等应用。

数据集访问

• 免费开放，可通过Google Cloud Storage buckets获取。
• 每周更新数据集。

数据集维护

• 由Cornell University维护和运营。