skymizer/fineweb-edu-dedup-test-4K-rows
收藏Hugging Face2024-12-23 更新2025-04-12 收录
下载链接：
https://hf-mirror.com/datasets/skymizer/fineweb-edu-dedup-test-4K-rows
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含文本内容、唯一标识符以及元数据信息，其中元数据包括网页转存内容、URL、时间戳、文件路径、语言类型、语言评分、词计数、得分和整数得分等字段。数据集被划分为测试集，共有4338个示例，大小为22,599,636字节。
The dataset includes text content, unique identifiers, and metadata information, where metadata consists of fields such as page dump, URL, timestamp, file path, language type, language score, token count, score, and integer score. The dataset is split into a test set, which contains 4338 examples and is 22,599,636 bytes in size.
提供机构：
skymizer
