common-pile/comma_v0.1_training_dataset
收藏Hugging Face2025-06-06 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/common-pile/comma_v0.1_training_dataset
下载链接
链接失效反馈官方服务：
资源简介：
Comma v0.1数据集是一个经过修改和整合的Common Pile v0.1 filtered数据集，用于训练Comma v0.1-1T和Comma v0.1-2T模型。数据集包含多个来源，如arxiv摘要、论文、GitHub存档、维基媒体等，并在训练中分别对主阶段和冷却阶段的每个来源设置了不同的混合比例和重复率。
The Comma v0.1 dataset is a slightly modified and consolidated version of the Common Pile v0.1 filtered data, used for training the Comma v0.1-1T and Comma v0.1-2T models. The dataset includes multiple sources such as arXiv abstracts, papers, GitHub archives, Wikimedia, etc., with different mixing rates and repetition rates set for each source in both the main and cooldown stages of training.
提供机构：
common-pile
