timaeus/dsir-pile-13m-filtered-for-pubmed-abstracts

该数据集包含三个主要特征：contents（内容，数据类型为字符串）、metadata（元数据，包含一个名为pile_set_name的字符串序列）和id（标识符，数据类型为int64）。数据集分为一个训练集（train），包含294,546个样本，总大小为468,391,687.57字节。下载大小为296,482,810字节。配置信息显示数据集的默认配置包含一个训练集文件路径。

The dataset contains three main features: contents (content, data type is string), metadata (metadata, containing a sequence of strings named pile_set_name), and id (identifier, data type is int64). The dataset is divided into a training set (train) containing 294,546 samples, with a total size of 468,391,687.57 bytes. The download size is 296,482,810 bytes. The configuration information shows that the default configuration of the dataset includes a training set file path.