tommyp111/fineweb-2m-tokenized
收藏官方服务：
资源简介：
该数据集包含一个名为tokens的序列特征，数据类型为int64。数据集分为训练集，包含1,321,876个示例，总大小为10,834,095,696字节。数据集的下载大小为2,662,306,622字节，总数据集大小与训练集相同。配置信息指出，默认配置下的数据文件路径为data/train-*。
The dataset includes a sequence feature named tokens with a data type of int64. It is divided into a training set containing 1,321,876 examples, with a total size of 10,834,095,696 bytes. The download size of the dataset is 2,662,306,622 bytes, and the total dataset size is the same as the training set. Configuration information indicates that the data file path under the default configuration is data/train-*.
提供机构：
tommyp111
