MAGHREB-HOF: A Large-Scale Annotated Corpus for Hate and Offensive Language Detection in Maghrebi Arabic

MAGHREB-HOF: A Large-Scale Corpus for Hate and Offensive Language Detection in Maghrebi Arabic MAGHREB-HOF is a large-scale annotated corpus for hate and offensive language (HOF) detection in Maghrebi Arabic social-media text. The dataset includes dialectal Arabic, Arabizi, and code-mixed Arabic–French/English content commonly observed in North African online discussions. It is designed to support reproducible benchmarking for hate speech detection in noisy dialectal environments characterized by spelling variation, dialect mixing, and transliteration. What this record contains This Zenodo record provides: The annotated corpus of Maghrebi social-media comments (fully anonymized). The annotation guidelines used during the labeling process (PDF). Annotation label definitions and metadata to enable reproducible experiments. The official split-index file used in the experiments (xlsx) . A README file describing the official partitions (md). The partition file supports reproducibility for both experimental tracks reported in the companion paper: - Sparse linear models: stratified 70/30 holdout split and five-fold cross-validation where applicable.- Neural sequence models: stratified 70/15/15 train/validation/test split. Source and Data Collection Comments were collected from public social-media pages and posts relevant to the Maghrebi region. The dataset focuses on topics that frequently generate online discussions and potentially hostile interactions (e.g., politics, identity issues, sports rivalries). All released data are fully anonymized and do not include direct personal identifiers. Annotation and Labels Each comment is annotated for hate and offensive language. Binary classification labels: 0 — Clean / non-offensive 1 — Hate or offensive content Fine-grained categories: Clean Hate Insult Profanity Additional metadata columns may be included to support analysis and reproducibility. See LABELS.md and the annotation guidelines for detailed definitions. Core Columns Typical dataset fields include: ID — unique internal comment identifier Comments_origine — raw text label — binary label (0/1) label_multi — multi-class label (Clean / Hate / Insult / Profanity) Comments_Date Annotation_Date Page Post Hub Post_Date City — Obtained with pretrained model in huggin face (https://huggingface.co/Ammar-alhaj-ali/arabic-MARBERT-dialect-identification-city) Score— Obtained with pretrained model in huggin face (https://huggingface.co/Ammar-alhaj-ali/arabic-MARBERT-dialect-identification-city) The dialect-identification metadata were produced using the following Hugging Face model: https://huggingface.co/Ammar-alhaj-ali/arabic-MARBERT-dialect-identification-city These dialect predictions are provided as descriptive metadata and should not be interpreted as manually validated dialect annotations. Recommended Use The dataset can be used to train and evaluate models for: hate and offensive language detection toxicity detection dialect-robust NLP for Maghrebi Arabic Arabizi processing code-mixed Arabic–French/English social-media text Typical evaluation protocols include cross-validation or fixed train/test splits as described in the companion paper. Ethical Considerations This dataset contains potentially harmful language, including insults and hate speech. It is released solely for research purposes to support the development of systems for detecting and mitigating harmful content. All comments are anonymized, and direct identifiers have been removed. Users of the dataset should comply with applicable ethical guidelines and regulations governing research on social-media data. License Dataset license: Creative Commons Attribution 4.0 International (CC BY 4.0) Users must provide appropriate credit and cite the companion paper and this Zenodo dataset record. Access and Embargo This Zenodo record is published with an embargo. Files will become publicly available on the date of publication of the companion article. Dataset metadata and DOI remain visible during the embargo period. Related Publication Companion article:Word and Character Models for Maghrebi Hate and Offensive Language Detection: A Large-Scae Facebook Corpus Dataset Statistics Dashboard An interactive dashboard with descriptive statistics (label distribution, metadata summaries, and exploratory views) is available at: http://magh-arabic-hof.duckdns.org:3000/public/dashboard/4a359fc9-bfe5-498b-93f6-957335e5ccf1/page Note: The dashboard is provided for exploration and reporting and does not grant access to embargoed files. Annotation Demo (Doccano) To support peer review and demonstrate the annotation workflow, a Doccano instance is available for reviewers to explore the labeling interface on a small demo project. Doccano login page:http://magh-arabic-hof.duckdns.org:8800/auth Reviewer username:provided privately to reviewers upon request. Password: provided privately to reviewers upon request. Contact For questions or embargo-related access requests during peer review: Ahmed Zoubir MessaltiDepartment of Computer ScienceFerhat Abbas University, Sétif 1, Algeria Email: [e-mail] Keywords Maghrebi Arabic; Arabizi; code-mixing; hate speech; offensive language; toxicity detection; NLP; social media corpus; Deep Learning; Machine Learning.