marin-community/ar5iv-no-problem-markdown
收藏Hugging Face2025-05-16 更新2025-07-05 收录
下载链接:
https://hf-mirror.com/datasets/marin-community/ar5iv-no-problem-markdown
下载链接
链接失效反馈官方服务:
资源简介:
Markdownified Ar5iv是一个将arXiv上的学术论文转换成Markdown格式的数据集,包含2.74B个token,分为两个部分。这个数据集通过一系列复杂的技术流程将原始的HTML格式转换为高质量的Markdown,保留了学术论文的内容并便于语言模型训练。
Markdownified Ar5iv is a dataset that transforms academic papers from arXiv into Markdown format, containing 2.74B tokens across two splits. This dataset preserves the content of academic papers and is suitable for language model training through a sophisticated conversion process from raw HTML.
提供机构:
marin-community



