Finnish-NLP/Fineweb2_Finnish_fineweb_edu_predicted
收藏Hugging Face2025-06-05 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/Finnish-NLP/Fineweb2_Finnish_fineweb_edu_predicted
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含多个字段，如文本内容、唯一标识符、URL链接、日期、文件路径、文本语言、语言评分、语言脚本、最小哈希聚类大小、主要语言和文本嵌入向量等。数据集被划分为训练集，其中包含大约3316万个示例，大小约为220GB。数据集配置中提供了默认配置，指定了训练集的数据文件路径。
The dataset includes multiple fields such as text content, unique identifiers, URL links, dates, file paths, text languages, language scores, language scripts, minimum hash cluster sizes, primary languages, and text embedding vectors. The dataset is split into a training set, which contains approximately 33,162,591 examples and is about 220GB in size. The dataset configuration provides a default setting, specifying the data file paths for the training set.
提供机构：
Finnish-NLP
