SmallDoge/stable_dataset_processed

该数据集包含两个特征序列：input_ids和attention_mask，由整数和8位整数构成。它分为训练集和测试集，其中训练集有3200万个示例，测试集有1000个示例。数据集的下载大小为115GB，总大小为298GB。提供了默认配置，指定了数据文件的路径。

The dataset includes two feature sequences: input_ids and attention_mask, consisting of integer and 8-bit integer sequences. It is divided into a training set with 32 million examples and a test set with 1,000 examples. The download size of the dataset is 115GB, and the total size is 298GB. A default configuration is provided, specifying the paths to the data files.