zerostratos/fineweb-2-vie-2022

这是一个包含文本数据的数据集，每个数据点包含文本内容、唯一标识符、URL、日期、文件路径、语言信息、语言分数、语言脚本、最小哈希簇大小和顶级语言等信息。数据集主要用于训练机器学习模型，特别是那些需要处理文本和语言信息的模型。This is a dataset containing text data, with each data point including text content, unique identifier, URL, date, file path, language information, language score, language script, minimum hash cluster size, and top-level languages. The dataset is primarily intended for training machine learning models, especially those that require processing text and language information.