mrm8488/fineweb-2-spa-1m

该数据集包含文本内容、唯一标识符、路径、URL、日期、文件路径、语言信息、语言评分、语言脚本、最小哈希簇大小和顶级语言等信息。数据集被划分为训练集(train)，其中包含100万条示例，总字节数为3,761,062,584字节。The dataset includes text content, unique identifiers, paths, URLs, dates, file paths, language information, language scores, language scripts, minimum hash cluster sizes, and top languages. The dataset is split into a training set (train) containing 1,000,000 examples, with a total of 3,761,062,584 bytes.