laion/Wikipedia-Exotic

Wikipedia Exotic是一个广泛的数据集，专为不常见的欧洲和宗教语言提供维基百科语料库。该数据集包括在各自国家广泛使用但在全球范围内认可度较低的语言，以及东南亚和宗教语言如希伯来语。数据集的目的是激励研究人员开发特定领域的模型，并使用这些语言进行研究，使其更容易被更广泛的学术界访问。

Wikipedia Exotic is an extensive dataset designed to provide Wikipedia corpus in uncommon European and religious languages. It includes languages widely spoken in their native countries but with limited global recognition, as well as languages from Southeast Asia and religious languages such as Hebrew. The aim of the dataset is to inspire researchers to develop domain-specific models and conduct research using these languages, making them more accessible to the broader academic community.