Old Newspapers

The HC Corpora was a great resource that contains natural language text from various newspapers, social media posts and blog pages in multiple languages. This is a cleaned version of the raw data from newspaper subset of the HC corpus. Originally, this subset was created for a language identification task for similar languages.

搜集汇总

背景与挑战

背景概述

该数据集是HC Corpora的清理版本，包含来自67种语言报纸的16,806,041个句子或段落，以.tsv文件格式存储，每行包括语言、来源、日期和文本列。它最初为相似语言的识别任务而创建，适用于语言检测和语料库语言学探索。