ssumin/fineweb-edu-long
收藏Hugging Face2025-02-25 更新2025-04-12 收录
下载链接：
https://hf-mirror.com/datasets/ssumin/fineweb-edu-long
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含三个特征：input_ids、attention_mask和token_count。input_ids和attention_mask是序列形式的整数数组，token_count是一个整数。数据集分为训练集、验证集和测试集，其中训练集包含1121445个示例，验证集包含300个示例，测试集包含1000个示例。数据集的总大小为261,327,336,112字节，下载大小为30,244,989,574字节。具体的数据集内容和用途未在README中描述。
The dataset includes three features: input_ids, attention_mask, and token_count. input_ids and attention_mask are integer arrays in sequence form, and token_count is an integer. The dataset is divided into three parts: training set, validation set, and test set, containing 1,121,445, 300, and 1,000 examples respectively. The total size of the dataset is 261,327,336,112 bytes, and the download size is 30,244,989,574 bytes. The specific content and purpose of the dataset are not described in the README.
提供机构：
ssumin
