skymizer/pretraining-50B-llama3.2-tokenized-padded-packed-2048
收藏Hugging Face2024-11-16 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/skymizer/pretraining-50B-llama3.2-tokenized-padded-packed-2048
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含两个主要特征：input_ids和labels，分别使用int32和int64类型的序列。数据集仅包含训练集，共有22,487,079个示例，总大小为552,822,350,136字节。下载大小为175,046,122,032字节。默认配置下的数据文件路径为data/train-*。
The dataset contains two main features: input_ids and labels, which are sequences of int32 and int64 types, respectively. The dataset includes only a training set with 22,487,079 examples, totaling 552,822,350,136 bytes. The download size is 175,046,122,032 bytes. The data file path under the default configuration is data/train-*.
提供机构：
skymizer
