Omartificial-Intelligence-Space/FineWeb2-Moroccan-Arabic

FineWeb2 Moroccan Arabic数据集包含摩洛哥阿拉伯语文本，使用阿拉伯字母，属于亚非语系。数据集分为训练集和测试集，训练集包含69,181,074个样本，测试集包含404,456个样本。数据集的下载大小为8,643,492,886字节，总大小为16,933,034,615字节。数据集的目的是为研究人员和开发者提供摩洛哥阿拉伯语的自然语言处理（NLP）项目数据，简化数据访问，促进研究，支持阿拉伯语处理，并鼓励合作。数据集遵循Open Data Commons Attribution License (ODC-By) v1.0许可，并需遵守CommonCrawl的使用条款。

This is the Moroccan Arabic portion of the FineWeb2 dataset. Moroccan Arabic, belonging to the Afro-Asiatic language family and using the Arabic script, is represented by the ISO 639-3 code ary. The dataset contains over 1.7 billion words distributed across more than 6.1 million documents, collectively occupying a disk size of approximately 5.79 GB. The purpose of this dataset is to simplify access to the Arabic portion, promote research, support Arabic language processing, and encourage community collaboration. The dataset is released under the Open Data Commons Attribution License (ODC-By) v1.0.