LeiKo

LeiKo is a comparable corpus of German easy-to-read news texts. This freely available resource is systematically compiled and linguistically annotated for linguistic and computational linguistic research. LeiKo consists of 216 news and newspaper texts (approx. 56,600 tokens) and their meta data structured in four subcorpora according to the websites they were published on. All texts are tokenized, lemmatized, part-of-speech tagged and dependency parsed and can be queried in ANNIS (Krause/Zeldes 2016). A core corpus of 40 texts is manually corrected.<br> <br> Version 0.9 contains only the core corpus with lemma and pos annotations and can be queried here: https://corpora.uni-hamburg.de/hzsk/de/hzsk_access/annis/leiko<br> <br> Version 1.0 comprises all 216 texts and not only lemma and pos annotations, but also syntactic annotations and metadata. The corpus is provided in the annis format, which can be directly imported into ANNIS Kickstarter. Version 1.1 is identical to version 1.0, but in addition to the annis files contains all corpus texts in the conll format. In version 1.3, some parts in the tazleicht subcorpus were added that were missing due to a mistake in the Python script written to gather the texts from the websites. In addition, the syntactic segmentation for lists was revised and the URL for each text was added to the set of meta data. Version 1.4 contains additional coreference annotations. Version 1.5 contains corrected meta data annotations as well as annotations of discourse relations according to the Penn Discourse Treebank guidelines (Webber et al. 2019) in separate csv files (currently not searchable in ANNIS).<br> <br> Further versions with additional manual annotation levels will follow. If you use the corpus, please cite: Jablotschkin, Sarah / Heike Zinsmeister (2020): „LeiKo: A corpus of easy-to-read German“. Poster presentation at the Computational Linguistics Poster Session in the course of the 42nd annual conference of the Deutsche Gesellschaft für Sprachwissenschaft (DGfS) in Hamburg. (The version of the poster you find in the download section was corrected for typos.)LeiKo是一款德语易懂新闻文本可比语料库。该免费资源经过系统性汇编与语言学标注，旨在服务于语言学及计算语言学研究。LeiKo包含216篇新闻与报纸文本（约56600个Token（tokens））及其元数据，按文本发布的网站分为四个子语料库。所有文本均经过Token化、词形还原、词性标注与依存句法分析，可通过ANNIS（ANNIS，Krause/Zeldes 2016）进行查询。其中包含40篇文本的核心语料库已完成人工校正。 版本0.9仅包含带有词形还原与词性标注的核心语料库，可通过以下链接查询：https://corpora.uni-hamburg.de/hzsk/de/hzsk_access/annis/leiko 版本1.0涵盖全部216篇文本，不仅包含词形还原与词性标注，还包含句法标注及元数据。该语料库以ANNIS格式提供，可直接导入ANNIS Kickstarter。版本1.1与1.0内容一致，但除ANNIS格式文件外，还提供了所有语料文本的CoNLL格式（CoNLL）版本。版本1.3补充了因Python脚本抓取网站文本时出错而遗漏的tazleicht子语料库部分内容；此外，修订了列表的句法切分规则，并为每条元数据添加了对应文本的URL。版本1.4新增了共指标注。版本1.5包含校正后的元数据标注，以及依照Penn话语树库（Penn Discourse Treebank，Webber et al. 2019）规范生成的话语关系标注，相关内容存储于独立的CSV文件中（目前暂不支持在ANNIS中检索）。 后续版本将新增更多人工标注层级。若使用该语料库，请引用如下文献：Jablotschkin, Sarah / Heike Zinsmeister (2020): "LeiKo: A corpus of easy-to-read German". 于汉堡举办的第42届德国语言学会（Deutsche Gesellschaft für Sprachwissenschaft，简称DGfS）年会期间的计算语言学海报专场进行海报展示。（下载专区中的海报版本已修正排版错误）