nobody12321/tokenizer
收藏Hugging Face2024-08-22 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/nobody12321/tokenizer
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含两个主要字段：text和json，均为字符串类型。数据集分为训练集和测试集，训练集包含约900万条数据，测试集包含约100万条数据。数据文件路径分别为train-*和test-*。
The dataset contains two main fields: text and json, both of which are string types. The dataset is divided into a training set and a test set, with the training set containing approximately 9 million entries and the test set containing approximately 1 million entries. The data file paths are train-* and test-* respectively.
提供机构：
nobody12321
