Ba2han/merged-multi-tokenized
收藏官方服务：
资源简介：
该数据集包含了两个分割的数据部分，分别为split_0和split_1。每个部分都由input_ids和attention_mask两种类型的特征构成，其中input_ids是整数列表，attention_mask是字节数据列表。split_0包含大约1802万个示例，split_1包含约519万个示例。
The dataset consists of two splits, split_0 and split_1. Each split includes features of input_ids and attention_mask, where input_ids are lists of integers and attention_mask are lists of bytes. split_0 contains approximately 18.02 million examples, and split_1 contains about 5.19 million examples.
提供机构：
Ba2han
