anyasims/openwwebtext-gpt2-50257-standard

这是一个包含序列化整数ID和长度信息的文本数据集，分为训练集和验证集。训练集包含7933631个示例，大小为71,698,894,572字节，验证集包含80138个示例，大小为717,407,416字节。数据集的总大小为72,416,301,988字节，下载大小为17,382,152,326字节。

This is a text dataset containing serialized integer IDs and length information, split into training and validation sets. The training set consists of 7,933,631 examples and is 71,698,894,572 bytes in size, while the validation set consists of 80,138 examples and is 717,407,416 bytes in size. The total size of the dataset is 72,416,301,988 bytes, with a download size of 17,382,152,326 bytes.