juniorrios/fineweb-2-10M-tokenized-2048smollm
收藏Hugging Face2025-01-29 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/juniorrios/fineweb-2-10M-tokenized-2048smollm
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含三个特征：input_ids, labels, 和 ppl。input_ids和labels分别为int32和int64类型的序列数据，ppl为float16类型的序列数据。数据集分为训练集，大小为14664838420字节，共有511255个样本。提供默认配置，指定了训练集的数据文件路径。
The dataset includes three features: input_ids, labels, and ppl. input_ids and labels are sequences of int32 and int64 types, respectively, and ppl is a sequence of float16 type. The dataset is split into a training set, which is 14664838420 bytes in size and contains 511255 samples. A default configuration is provided, specifying the path to the data files for the training set.
提供机构：
juniorrios
