raddwolf/BookCorpus-1M-tokenized
收藏Hugging Face2024-09-28 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/raddwolf/BookCorpus-1M-tokenized
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含两个主要特征：input_ids和attention_mask，分别以int32和int8的序列形式存储。数据集分为一个训练集（train），包含1,000,000个示例，总大小为1,288,000,000字节。数据集的下载大小为40,665,240字节，总大小为1,288,000,000字节。默认配置下的数据文件路径为data/train-*。
The dataset includes two main features: input_ids and attention_mask, stored as sequences of int32 and int8, respectively. The dataset is divided into a training set (train) containing 1,000,000 examples, with a total size of 1,288,000,000 bytes. The download size of the dataset is 40,665,240 bytes, and the total size is 1,288,000,000 bytes. The data file path under the default configuration is data/train-*.
提供机构：
raddwolf
