Reubencf/PolyglotText

PolyglotText是一个多语言文本预训练语料库，包含多种语言的文本数据及其可能的翻译。数据集包含sentence_id、lang、text和translations等特征，主要用于预训练目的。数据集仅包含一个训练集分割，包含13,351,688个示例。

PolyglotText is a multilingual text pre-training corpus containing text data in multiple languages and possibly their translations. The dataset includes features such as sentence_id, lang, text, and translations, primarily intended for pre-training purposes. The dataset consists of a single train split with 13,351,688 examples.