pccl-org/Skylion007-openwebtext-tokenizer-gpt2-1024
收藏Hugging Face2024-07-13 更新2024-07-22 收录
下载链接：
https://hf-mirror.com/datasets/pccl-org/Skylion007-openwebtext-tokenizer-gpt2-1024
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含了名为input_ids的整数序列特征，数据集被划分为训练集，共有约883万样本，总大小为36213.9552GB。数据集的下载大小为17.7504623GB。提供了默认配置，且数据文件以train-*的模式命名。
The dataset includes integer sequence features named input_ids, is split into a training set with approximately 8.83 million samples, and has a total size of 36213.9552 GB. The download size of the dataset is 17.7504623 GB. A default configuration is provided, and the data files are named in the pattern train-*.
提供机构：
pccl-org
