NoahEJ/fineweb-sample-100BT_over-1024-tokens-subset
收藏Hugging Face2025-04-23 更新2025-10-25 收录
下载链接：
https://hf-mirror.com/datasets/NoahEJ/fineweb-sample-100BT_over-1024-tokens-subset
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含了文本内容、唯一标识符、URL、日期、文件路径、语言类型、语言置信度得分和词数等字段。训练集包含约2050万条示例，数据集总大小约为110GB。数据集按照默认配置进行组织，训练数据存储在特定路径下。
The dataset includes fields such as text content, unique identifier, URL, date, file path, language type, language confidence score, and token count. The training set contains about 20.5 million examples, and the total size of the dataset is about 110GB. The dataset is organized according to the default configuration, with training data stored in specific paths.
提供机构：
NoahEJ
