gabrielaltay/wikipedia-20231101-en-tokenized-o200k_harmony
收藏数据链接：
官方服务：
资源简介：
该数据集包含id、url、title、text和token_ids等字段，分为训练集和测试集。训练集有约6343万条数据，测试集有约6万4千条数据，总大小约为56.2GB。
The dataset includes fields such as id, url, title, text, and token_ids, and is divided into training and test sets. The training set has approximately 63.43 million examples, and the test set has approximately 64,000 examples, with a total size of about 56.2GB.
提供机构：
gabrielaltay
