German Noun-Noun Compounds Dataset for Compositionality Tests
收藏DataCite Commons2024-05-19 更新2024-07-13 收录
下载链接:
https://fdat.uni-tuebingen.de/records/fvkqr-k0v25
下载链接
链接失效反馈官方服务:
资源简介:
The compounds in this dataset were extracted from the list of 54759 German compounds in GermaNet version 9.0, available at http://www.sfs.uni-tuebingen.de/lsd/compounds.shtml.
As specified on the GermaNet page, the list of compound data is free for academic research as defined in GermaNet's academic research licence agreement (http://www.sfs.uni-tuebingen.de/lsd/licenses.shtml). For any other intended purposes, please contact the GermaNet team.
The following paper describes the automatic compound splitting that is performed before the manual post-correction. If you want to use the split compounds in the context of scientific or research work, please refer to the paper:
Verena Henrich and Erhard Hinrichs: Determining Immediate Constituents of Compounds in GermaNet. In Proceedings of Recent Advances in Natural Language Processing (RANLP 2011), Hissar, Bulgaria, September 2011, pp. 420-426. [Download paper: http://www.aclweb.org/anthology/R11-1058]
The initial compound list was filtered to only those compounds that had a minimum frequency of 500 in the DECOW14AX corpus (https://webcorpora.org/), resulting in a list of 34497 compounds, which were split into the train, test and dev splits (with 24147, 6901 and 3449 compounds respectively). The words in the dataset are lowercased, but the original casing can be recovered if needed by consulting the GermaNet database.
The dataset was also filtered only for noun-noun compounds, using the part-of-speech information available in GermaNet. The filtering was done per split, and resulted 18796, 5410 and 2655 compounds in the training, test and dev splits (26861 compounds in total).
The train/test/dev files have the following format: modifier head compound (e.g. basis tunnel basistunnel)
The dataset is referred to as the "nn-only" dataset in chapter 5 of Dima (2019).
本数据集所收录的复合词提取自9.0版德语词网GermaNet中的54759条德语复合词列表,该列表可通过以下网址获取:http://www.sfs.uni-tuebingen.de/lsd/compounds.shtml。
如GermaNet官网所述,本复合词数据列表可免费用于学术研究,具体使用条款遵循GermaNet学术研究许可协议(http://www.sfs.uni-tuebingen.de/lsd/licenses.shtml);若需将其用于其他用途,请联系GermaNet团队。
下述文献阐述了本数据集在手动后修正环节前执行的自动复合词拆分方法。若需在学术或研究工作中使用本数据集的拆分复合词,请引用该文献:
Verena Henrich与Erhard Hinrichs:《Determining Immediate Constituents of Compounds in GermaNet》(《德语词网中复合词直接成分的确定》),收录于《Proceedings of Recent Advances in Natural Language Processing (RANLP 2011)》(《2011年自然语言处理最新进展会议论文集》),保加利亚希萨尔,2011年9月,第420-426页。[论文下载地址:http://www.aclweb.org/anthology/R11-1058]
初始复合词列表经筛选后,仅保留在DECOW14AX语料库(https://webcorpora.org/)中出现频次不低于500的复合词,最终得到包含34497条复合词的列表,并将其划分为训练集、测试集与开发集,三者分别包含24147、6901与3449条复合词。本数据集中的词汇均为小写形式,若有需要,可通过查阅GermaNet数据库恢复原始大小写格式。
本数据集还基于GermaNet提供的词性标注信息,仅保留名词-名词型复合词。该筛选按数据集划分分别执行,最终训练集、测试集与开发集分别包含18796、5410与2655条复合词,总计26861条。
训练集/测试集/开发集文件的格式如下:修饰语 中心语 复合词(示例:basis tunnel basistunnel,即德语“基础隧道”)
本数据集在Dima(2019)的第5章中被称为"nn-only"数据集。
创建时间:
2024-05-19
搜集汇总
数据集介绍

背景与挑战
背景概述
该数据集是一个专门用于组合性测试的德语名词-名词复合词数据集,包含26861个复合词,从GermaNet 9.0中提取并基于DECOW14AX语料库频率过滤得到。数据集分为训练、测试和开发集,格式为修饰词-头部词-复合词,所有单词小写,适用于自然语言处理研究。
以上内容由遇见数据集搜集并总结生成



