Bretagne/leipzig_corpora_br

Leipzig Corpora Collection提供了不同语言的语料库，这些语料库使用相同的格式和可比较的来源。所有数据以纯文本文件形式提供，并可以通过提供的导入脚本导入MySQL数据库。这些语料库旨在供语料库语言学家进行科学研究，以及用于知识提取程序等应用。语料库在格式上相同，在大小和内容上相似。它们包含随机选择的句子，句子数量从10,000到1百万不等，来源为报纸或网络文本。文本被分割成句子，去除了非句子和外语材料。由于单词共现信息对许多应用有用，这些数据也预先计算并包含在内。对于每个单词，提供了最显著的左右邻居或同一句子中的其他单词。数据集自动收集自公共来源，内容未经详细审查。

The Leipzig Corpora Collection presents corpora in different languages using the same format and comparable sources. All data are available as plain text files and can be imported into a MySQL database by using the provided import script. They are intended both for scientific use by corpus linguists as well as for applications such as knowledge extraction programs. The corpora are identical in format and similar in size and content. They contain randomly selected sentences in the language of the corpus and are available in sizes from 10,000 sentences up to 1 million sentences. The sources are either newspaper texts or texts randomly collected from the web. The texts are split into sentences. Non-sentences and foreign language material was removed. Because word co-occurrence information is useful for many applications, these data are precomputed and included as well. For each word, the most significant words appearing as immediate left or right neighbor or appearing anywhere within the same sentence are given. The corpora are automatically collected from carefully selected public sources without considering in detail the content of the contained text.