skymizer/pretraining-50B
收藏Hugging Face2024-11-12 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/skymizer/pretraining-50B
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含文本和标记计数两个特征，分别对应字符串和整数类型。数据集分为训练集和测试集，训练集包含57,251,823个样本，测试集包含1,141个样本。数据集的下载大小为124,620,706,648字节，总大小为212,803,129,326.6493字节。数据文件路径分别为train-*和test-*。
The dataset contains two features: text (string) and token_count (integer). It is divided into a training set with 57,251,823 examples and a test set with 1,141 examples. The download size of the dataset is 124,620,706,648 bytes, and the total size is 212,803,129,326.6493 bytes. The data files are located at train-* and test-*.
提供机构：
skymizer
