semran1/FW-edu-dedup-1-3B
收藏Hugging Face2025-01-13 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/semran1/FW-edu-dedup-1-3B
下载链接
链接失效反馈官方服务：
资源简介：
这是一个包含文本数据的训练集，其中每个数据点都有一个唯一标识符和一系列元数据。元数据包括源URL、日期、文件路径、文本语言、语言评分、token数量、分数和整数分数等。数据集总大小为15GB，训练集包含约315万条数据。
This dataset is a training set containing text data, with each data point having a unique identifier and a series of metadata. The metadata includes source URL, date, file path, text language, language score, token count, score, and integer score, etc. The total size of the dataset is 15GB, and the training set contains approximately 3.15 million data points.
提供机构：
semran1
