hails/validation-pile_nih-exporter

该数据集包含两个主要特征：meta和tokenized_text。meta特征包含一个名为pile_set_name的字符串字段，而tokenized_text特征包含两个序列字段：attention_mask和input_ids，数据类型分别为int64。数据集包含一个名为validation的分割，该分割有1825个示例，文件大小为46389904.317324266字节。数据集的下载大小为1557111字节，总大小为46389904.317324266字节。配置部分指定了默认配置，数据文件路径为data/train-*。

The dataset contains two main features: meta and tokenized_text. The meta feature includes a string field named pile_set_name, while the tokenized_text feature includes two sequence fields: attention_mask and input_ids, with data types of int64. The dataset includes a split named validation, which contains 1825 examples and has a file size of 46389904.317324266 bytes. The download size of the dataset is 1557111 bytes, and the total size is 46389904.317324266 bytes. The configuration section specifies the default configuration, with the data file path being data/train-*.