skymizer/pretraining-5B-tokenized-padded-packed-2048
收藏Hugging Face2024-11-15 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/skymizer/pretraining-5B-tokenized-padded-packed-2048
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含两个主要特征：input_ids和labels，分别使用int32和int64数据类型表示。数据集被分割为训练集，包含2,249,006个样本，总大小为55,289,563,504字节。下载大小为17,509,052,900字节。
The dataset includes two main features: input_ids and labels, represented by int32 and int64 data types respectively. The dataset is split into a training set containing 2,249,006 samples, with a total size of 55,289,563,504 bytes. The download size is 17,509,052,900 bytes.
提供机构：
skymizer
