timaeus/dsir-pile-13m-filtered-for-freelaw

该数据集包含三个主要特征：contents（内容，数据类型为字符串）、metadata（元数据，包含一个名为pile_set_name的字符串序列）和id（ID，数据类型为int64）。数据集分为一个训练集（train），包含1,467,628个样本，总大小为2,333,845,157.1210465字节。下载大小为1,338,671,296字节。配置部分指定了默认配置下的数据文件路径。

The dataset contains three main features: contents (content, data type is string), metadata (metadata, containing a sequence of strings named pile_set_name), and id (ID, data type is int64). The dataset is divided into a training set (train) containing 1,467,628 samples, with a total size of 2,333,845,157.1210465 bytes. The download size is 1,338,671,296 bytes. The configuration section specifies the data file path under the default configuration.