skymizer/pretraining-5B-tokenized-padded-packed-2048
收藏官方服务：
资源简介：
该数据集包含两个主要特征：input_ids和labels，分别使用int32和int64数据类型表示。数据集被分割为训练集，包含2,249,006个样本，总大小为55,289,563,504字节。下载大小为17,509,052,900字节。
The dataset includes two main features: input_ids and labels, represented by int32 and int64 data types respectively. The dataset is split into a training set containing 2,249,006 samples, with a total size of 55,289,563,504 bytes. The download size is 17,509,052,900 bytes.
提供机构：
skymizer
