kp7742/YALM-pretrain1-tokenized-envy1

该数据集包含两个特征：input_ids和attention_mask。input_ids是int32类型的序列数据，attention_mask是int8类型的序列数据。数据集分为训练集和测试集，其中训练集包含8092096个示例，大小为82927799808字节；测试集包含16481个示例，大小为168897288字节。数据集的总下载大小为29514634550字节，总大小为83096697096字节。

The dataset includes two features: input_ids and attention_mask. input_ids are sequence data of type int32, and attention_mask are sequence data of type int8. The dataset is divided into training and test sets, with the training set containing 8092096 examples and a size of 82927799808 bytes; the test set contains 16481 examples and a size of 168897288 bytes. The total download size of the dataset is 29514634550 bytes, and the total size is 83096697096 bytes.