lebeda/processed_small_openwebtext

该数据集包含用于训练的数据，主要特征包括input_ids和attention_mask，均为序列类型，分别使用int32和int8数据类型。数据集被分割为训练集，包含1,210,147个样本，总大小为6,203,017,151字节。下载大小为2,410,585,155字节。

This dataset contains data for training, with main features including input_ids and attention_mask, both of which are sequence types using int32 and int8 data types respectively. The dataset is split into a training set containing 1,210,147 samples, with a total size of 6,203,017,151 bytes. The download size is 2,410,585,155 bytes.