arabic_billion_words

Abu el-khair语料库是一个阿拉伯语文本语料库，其中包括500万多篇报纸文章。它总共包含超过十亿个半单词，其中大约有300万个独特的单词。语料库编码有两种类型的编码，即: UTF-8和Windows CP-1256。它还标记了两种标记语言，即: SGML和XML。

The Abu el-khair Corpus is an Arabic text corpus containing over 5 million newspaper articles. It has a total of more than one billion half-words, with approximately 3 million unique words. The corpus is encoded in two formats: UTF-8 and Windows CP-1256. It is also marked up using two markup languages: SGML and XML.

搜集汇总

背景与挑战

背景概述

arabic_billion_words是一个阿拉伯语文本语料库，包含超过500万篇报纸文章，总词数达十亿半，其中约300万个单词是独特的。数据集采用UTF-8和Windows CP-1256编码，并支持SGML和XML标记语言，由米尼亚大学于2016年发布。