PatrickHaller/cosmopedia-v2-1B
收藏Hugging Face2024-12-05 更新2024-12-14 收录
下载链接:
https://hf-mirror.com/datasets/PatrickHaller/cosmopedia-v2-1B
下载链接
链接失效反馈官方服务:
资源简介:
该数据集是smollm-corpus cosmopedia-v2子集的一个子样本,通过特定的采样逻辑从训练数据集中选取文本,并根据文本的token数量进行采样,直到达到目标token数量。数据集包含一个名为text的字符串类型字段,且只有一个训练分割,包含1,391,659个例子和5,224,508,677字节的数据。
This dataset is a subsample of the smollm-corpus cosmopedia-v2 subset, selected from the training dataset using a specific sampling logic based on the number of tokens in the text until the target number of tokens is reached. The dataset includes a field named text of string type and has only one training split, containing 1,391,659 examples and 5,224,508,677 bytes of data.
提供机构:
PatrickHaller



