mrm8488/fineweb-2-spa-5m-wikipedia-2m

这是一个包含文本数据的训练集，数据集中的每个样本都包含了文本内容、ID、URL、日期、文件路径、语言信息、语言评分、语言脚本、最小哈希簇大小、主要语言和标题等字段。数据集的总大小为25482771746字节，训练集包含6991766个示例。

This is a training dataset containing text data, with each sample including fields such as text content, ID, URL, date, file path, language information, language score, language script, minimum hash cluster size, primary languages, and title. The total size of the dataset is 25482771746 bytes, and the training set contains 6991766 examples.