TwinDoc/dataset-pt-corpus-redwhale-35m

该数据集包含一个名为text的字符串类型字段。数据集被分为训练集和测试集，其中训练集包含34,586,285个样本，占用45,796,511,963字节；测试集包含1,000个样本，占用21,396,706字节。数据集的下载大小为23,299,294,661字节，总大小为45,817,908,669字节。数据文件路径分别为train-*和test-*。

The dataset contains a field named text of string type. The dataset is divided into a training set and a test set, with the training set containing 34,586,285 samples and occupying 45,796,511,963 bytes, and the test set containing 1,000 samples and occupying 21,396,706 bytes. The download size of the dataset is 23,299,294,661 bytes, and the total size is 45,817,908,669 bytes. The data file paths are train-* and test-* respectively.