allenai/dolma3_mix-5.5T-1125
收藏Hugging Face2025-12-17 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/allenai/dolma3_mix-5.5T-1125
下载链接
链接失效反馈官方服务：
资源简介：
Dolma 3 Mix (5.5T)是在预训练阶段用于训练Olmo-3-1125-32B模型的数据集。该数据集包含约5.5万亿个token，数据来源多样，包括网页内容、学术出版物、代码等，其中大部分数据来自Common Crawl。
The Dolma 3 Mix (5.5T) is the collection of data used during the pretraining stage to train the Olmo-3-1125-32B model. This dataset is made up of ~5.5 trillion tokens from a diverse mix of web content, academic publications, code, and more. The majority of this dataset comes from Common Crawl.
提供机构：
allenai
