joey00072/pretokenized__JeanKaddour_minipile__EleutherAI__gpt-neo-125m

该数据集包含两个主要特征：input_ids和attention_mask，分别用于表示输入序列的标识符和注意力掩码。数据集被分为训练集和验证集，训练集包含494,347个样本，验证集包含238个样本。数据集的下载大小约为1.12GB，总大小约为1.94GB。

The dataset includes two main features: input_ids and attention_mask, which represent the identifiers of input sequences and attention masks, respectively. The dataset is divided into a training set and a validation set, with the training set containing 494,347 samples and the validation set containing 238 samples. The download size of the dataset is approximately 1.12GB, and the total size is approximately 1.94GB.