Parallel sense-annotated corpus ELEXIS-WSD 1.1

This corpus is a parallel sense-annotated corpus in which content words (nouns, adjectives, verbs, and adverbs) have been assigned senses. Version 1.1 contains sentences for 10 languages: Bulgarian, Danish, English, Spanish, Estonian, Hungarian, Italian, Dutch, Portuguese, and Slovene.
The corpus was compiled by automatically extracting a set of sentences from WikiMatrix (Schwenk et al., 2019), a large open-access collection of parallel sentences derived from Wikipedia, using an automatic approach based on multilingual sentence embeddings. The sentences were manually validated according to specific formal, lexical and semantic criteria (e.g. by removing incorrect punctuation, morphological errors, notes in square brackets and etymological information typically provided in Wikipedia pages). To obtain a satisfying semantic coverage, we filtered out sentences with less than 5 words and less than 2 polysemous words were filtered out. Subsequently, in order to obtain datasets in the other nine target languages, for each selected sentence in English, the corresponding WikiMatrix translation into each of the other languages was retrieved. If no translation was available, the English sentence was translated manually. The resulting corpus is comprised of 2,024 sentences for each language.
The sentences were tokenized, lemmatized, and tagged with POS tags using [UDPipe v2.6](https://lindat.mff.cuni.cz/services/udpipe/). Senses were annotated using [LexTag,/a\>: each content word (noun, verb, adjective, and adverb) was assigned a sense from among the available senses from the sense inventory selected for the language (see below) or BabelNet. Sense inventories were also updated with new senses during annotation.
This corpus is available for download from the CLARIN.SI repository.](https://elexis.babelscape.com/)

本语料库为带词义标注的平行语料库，其中实词（名词、形容词、动词及副词）均已分配词义。1.1版包含10种语言的语料句子：保加利亚语、丹麦语、英语、西班牙语、爱沙尼亚语、匈牙利语、意大利语、荷兰语、葡萄牙语及斯洛文尼亚语。
本语料库基于多语言句子嵌入的自动方法，从维基矩阵（WikiMatrix，Schwenk等人，2019）中自动抽取句子集合构建而成；维基矩阵是源自维基百科的大型开放获取平行句对集合。随后依据特定形式、词汇及语义标准对句子进行人工校验：例如移除错误标点、形态错误、方括号内的注释以及维基百科页面中常见的词源信息。
为获得良好的语义覆盖范围，我们过滤掉了词长不足5个单词以及多义词数量少于2个的句子。随后，为获取其余9种目标语言的数据集，我们针对每一条选中的英语句子，检索其在维基矩阵中对应的其他9种语言的译文；若无可用译文，则人工翻译该英语句子。
最终构建的语料库中，每种语言均包含2024条句子。
本语料库使用UDPipe v2.6工具（https://lindat.mff.cuni.cz/services/udpipe/）完成句子的分词、词形还原及词性标注。词义标注环节使用LexTag工具完成：为每个实词（名词、动词、形容词及副词）从该语言所选用的词义标注集（详见下文）或巴别网（BabelNet）的可用词义中分配一个词义。标注过程中还会向词义标注集新增词义。
本语料库可从CLARIN.SI知识库下载获取，下载链接：https://elexis.babelscape.com/