xfxcwynlc/fineweb-edu-packed2
收藏Hugging Face2025-04-04 更新2025-04-12 收录
下载链接：
https://hf-mirror.com/datasets/xfxcwynlc/fineweb-edu-packed2
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含三个字段：input_ids，labels，attention_mask，其中input_ids和attention_mask为int32和int8类型的整数序列，labels为int64类型的整数序列。数据集被划分为训练集，包含超过一亿一千一百三十三万个示例，总文件大小约为603GB。具体应用场景和数据集内容描述未在README中给出。
The dataset includes three fields: input_ids, labels, and attention_mask, with input_ids and attention_mask being sequences of int32 and int8 integers respectively, and labels being sequences of int64 integers. The dataset is split into a training set with over 113 million examples, with a total file size of approximately 603GB. The specific application scenario and content description of the dataset are not provided in the README.
提供机构：
xfxcwynlc
