morphpiece/fineweb_gpt2

该数据集包含两个主要分割：训练集和测试集。训练集包含58,372,726个样本，占用239,328,148,932字节；测试集包含58,319个样本，占用239,107,900字节。整个数据集的下载大小为117,076,798,666字节，总大小为239,567,256,832字节。数据集的特征包括input_ids，其类型为int32的序列。

The dataset includes two main splits: train and test. The train split contains 58,372,726 samples, occupying 239,328,148,932 bytes; the test split contains 58,319 samples, occupying 239,107,900 bytes. The total download size of the dataset is 117,076,798,666 bytes, and the total dataset size is 239,567,256,832 bytes. The features of the dataset include input_ids, which is a sequence of int32.