Opusparcus

Opusparcus 是六种欧洲语言的释义语料库：德语、英语、芬兰语、法语、俄语和瑞典语。释义是从 OpenSubtitles2016 语料库中提取的，其中包含电影和电视节目的字幕。对于每种目标语言，Opusparcus 数据都被划分为三种类型的数据集：训练集、开发集和测试集。训练集很大，由数百万个句子对组成，并且是在概率排序函数的帮助下自动编译的。开发和测试集由人工注释的句子对组成；每组包含大约 1000 个句子对，已被两个注释者验证为可接受的释义。

Opusparcus is a paraphrastic corpus covering six European languages: German, English, Finnish, French, Russian, and Swedish. The paraphrases are extracted from the OpenSubtitles2016 corpus, which contains subtitles for movies and television programs. For each target language, the Opusparcus dataset is divided into three types of datasets: training set, development set, and test set. The training set is large, consisting of millions of sentence pairs, and was automatically compiled with the assistance of a probabilistic ranking function. The development and test sets are composed of manually annotated sentence pairs; each set contains approximately 1,000 sentence pairs that have been verified as acceptable paraphrases by two annotators.