prakod/gcm_enhi_filtred_1500000

该数据集包含多语言代码混合的文本数据，主要用于语言识别和代码混合研究。数据集的特征包括索引、第一语言、第二语言、候选代码混合、候选代码混合的音译以及基于Unicode的语言识别分数。数据集仅包含训练集，共有1,172,444个样本，总大小为352,995,475字节。

This dataset contains multilingual code-mixed text data, primarily used for language identification and code-mixing research. The features of the dataset include index, first language, second language, code-mixed candidates, transliterated code-mixed candidates, and Unicode-based language identification scores. The dataset includes only a training set with 1,172,444 samples, totaling 352,995,475 bytes.