semran1/FW-edu-dedup-2-5B
收藏Hugging Face2025-01-13 更新2025-02-15 收录
下载链接:
https://hf-mirror.com/datasets/semran1/FW-edu-dedup-2-5B
下载链接
链接失效反馈官方服务:
资源简介:
该数据集包含文本内容、唯一标识符和元数据等信息。元数据中记录了dump信息、url、日期、文件路径、语言、语言评分、词计数、评分和整数评分。数据集划分为训练集,并提供了详细的文件大小和示例数量。数据集配置默认为default。
The dataset includes text content, unique identifiers, and metadata. The metadata contains information such as dump details, URL, date, file path, language, language score, token count, score, and integer score. The dataset is split into a training set with detailed file size and example count provided. The dataset configuration is set to default.
提供机构:
semran1



