gabrielaltay/wikipedia-20231101-en-tokenized-o200k_harmony
收藏Hugging Face2025-09-11 更新2025-10-25 收录
下载链接：
https://hf-mirror.com/datasets/gabrielaltay/wikipedia-20231101-en-tokenized-o200k_harmony
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含id、url、title、text和token_ids等字段，分为训练集和测试集。训练集有约6343万条数据，测试集有约6万4千条数据，总大小约为56.2GB。
The dataset includes fields such as id, url, title, text, and token_ids, and is divided into training and test sets. The training set has approximately 63.43 million examples, and the test set has approximately 64,000 examples, with a total size of about 56.2GB.
提供机构：
gabrielaltay
