skymizer/dolma-v1_7-50B-2-of-2
收藏Hugging Face2025-01-15 更新2025-02-15 收录
下载链接:
https://hf-mirror.com/datasets/skymizer/dolma-v1_7-50B-2-of-2
下载链接
链接失效反馈官方服务:
资源简介:
该数据集是一个大型文本数据集,包含文本内容、文本唯一标识符以及文本中的token数量。数据集仅包含训练集部分,共有大约3427万条文本示例,整个数据集大小约为103.5TB。
This dataset is a large-scale text dataset, including text content, unique identifiers for each text, and the token count within the text. The dataset contains only the training set, with a total of approximately 34.27 million text examples, and the entire dataset is about 103.5TB in size.
提供机构:
skymizer



