noname0202/tokenized-pretraining-dataset
收藏Hugging Face2025-03-25 更新2025-04-12 收录
下载链接:
https://hf-mirror.com/datasets/noname0202/tokenized-pretraining-dataset
下载链接
链接失效反馈官方服务:
资源简介:
该数据集是一个未具体描述的数据集,包含序列化的整数ID、注意力掩码和长度信息作为特征。数据集分为训练集,训练集大小为42,637,098,039字节,共有95,431,739个示例。数据集遵循MIT许可。
This dataset is not specifically described, containing features such as serialized integer IDs, attention masks, and length information. The dataset is split into a training set, which is 42,637,098,039 bytes in size and has 95,431,739 examples. The dataset is licensed under the MIT License.
提供机构:
noname0202



