monology/pile-uncopyrighted-parquet

该数据集包含文本字段和元信息字段，其中文本字段为字符串类型，元信息字段包含集合名称等信息。数据集提供了一个训练集分割，包含大约1.77亿个示例和大约993GB的数据。数据集的总大小与其下载大小不同，表明可能经过了压缩处理。

The dataset includes a text field and a metadata field, with the text field being of string type and the metadata field containing information such as set names. The dataset provides a training set split, containing approximately 177 million examples and about 993GB of data. The total size of the dataset differs from the download size, indicating that the dataset may have been compressed.