minpeter/fineweb-2-edu-korean

这是一个文本数据集，包含了文本内容、唯一标识符、文件路径、语言信息、语言分数、语言脚本、最小哈希簇大小、主要语言和得分等字段。数据集被划分为训练集，可用于语言识别、文本分类等NLP任务。

This is a text dataset that includes fields such as text content, unique identifier, file path, language information, language score, language script, minimum hash cluster size, main languages, and score. The dataset is split into a training set and can be used for NLP tasks such as language detection and text classification.