Lexica corpus (v2.0)

Second release of the lexica corpus: a corpus for German text simplification, total size now 3270 files. The corpus consists of approximately 3300 texts from three Wiki-based lexica in German language: MiniKlexikon, Klexikon and Wikipedia. The articles in the Wikis are created by volunteers and can be written, discussed, and improved upon collaboratively. Klexikon is aimed specifically at children aged between 6 and 12 and MiniKlexikon is designed for children who are beginner readers, and is therefore an even simpler version of the Klexikon. We make the assumption that the three different sub-corpora represent three different levels of conceptual complexity due to the target groups they are written for: younger children, children and adults. As Wikipedia articles can be extremely long, in comparison to the other two lexica, only the introduction or abstract was taken for this corpus. This repository contains the corpora from the original study (295 texts per sub-corpus in the orig_files folder), extended versions with 1090 texts (as of March 2022) per sub-corpus and a script to update the extended version as new articles are added to the Klexikon and MiniKlexikon.

词汇语料库（lexica corpus）第二版发布：该语料库面向德语文本简化任务，当前总文件量达3270个。该语料库共收录约3300篇文本，均源自三个德语维基类词汇库：MiniKlexikon、Klexikon与维基百科（Wikipedia）。上述维基平台的词条均由志愿者创作，支持协同编写、讨论与迭代优化。Klexikon的目标受众为6至12岁儿童，而MiniKlexikon专为初学阅读的儿童设计，因此是比Klexikon更为精简的版本。我们假设，由于三个子语料库分别针对低龄儿童、普通儿童与成人这三类目标群体创作，它们各自对应不同层级的概念复杂度。鉴于维基百科词条相较于另外两个词汇库篇幅普遍过长，本语料库仅选取其引言或摘要部分作为收录内容。本仓库包含原始研究使用的语料（orig_files文件夹中每个子语料库含295篇文本）、截至2022年3月的扩展版语料（每个子语料库含1090篇文本），以及用于在Klexikon和MiniKlexikon新增词条时更新扩展版语料的配套脚本。

搜集汇总

背景与挑战

背景概述

Lexica corpus (v2.0) 是一个德语文本简化语料库，包含3270个文件，来源于MiniKlexikon、Klexikon和Wikipedia三个维基类词典，分别针对初学者、儿童和成人，代表不同的文本复杂度级别。该数据集主要用于文本简化、文本复杂度分析和计算语言学研究。