semran1/dclm-edu-3-500k

这是一个包含文本数据的数据集，每个数据点包括文本内容、唯一标识符、教育程度分数（包括整数和浮点数两种形式）、fasttext分数、语言类型、语言分数以及文本的URL链接。数据集分为训练集，共有500,000个示例，总大小为约3GB。数据集支持默认配置，并提供了训练数据文件的路径。

This dataset contains text data, with each data point including text content, a unique identifier, education level scores (in both integer and floating-point formats), fasttext scores, language type, language scores, and the URL link to the text. The dataset is split into a training set, which consists of 500,000 examples and has a total size of approximately 3GB. The dataset supports a default configuration and provides the path to the training data files.