skymizer/pretraining-100B
收藏Hugging Face2024-11-12 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/skymizer/pretraining-100B
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含两个主要特征：text（文本）和token_count（标记计数）。数据集被分为训练集和测试集，其中训练集包含114,057,604个样本，测试集包含1,141个样本。数据集的下载大小为248,294,529,726字节，总大小为423,944,127,383字节。
The dataset includes two main features: text and token_count. It is divided into a training set and a test set, with the training set containing 114,057,604 samples and the test set containing 1,141 samples. The download size of the dataset is 248,294,529,726 bytes, and the total size is 423,944,127,383 bytes.
提供机构：
skymizer
