Punchwe/ted_talk_multi_parallel

该数据集包含多个字段，主要涉及两个句子（sent1和sent2）及其对应的语言标识（sent1_lang和sent2_lang），以及一个示例ID（example_id）。数据集被分为训练集（train）、开发集（dev）和测试集（test），分别包含871152、22812和23664个示例。这些数据可能用于自然语言处理任务，如句子对比较或语言识别。

The dataset includes several fields, primarily involving two sentences (sent1 and sent2) and their corresponding language identifiers (sent1_lang and sent2_lang), along with an example ID (example_id). The dataset is divided into training (train), development (dev), and test (test) sets, containing 871152, 22812, and 23664 examples respectively. These data may be used for natural language processing tasks such as sentence pair comparison or language identification.