samihyounes/Moroccan-Codeswitching

---
pretty_name: Moroccan Darija Code-Switched Corpus (Moroccan Arabic)
language:
- ary
- ar
- fr
- en
- tzm
multilinguality: multilingual
license: apache-2.0
task_categories:
- text-classification
tags:
- code-switching
- language-identification
- moroccan-arabic
- darija
- arabic
- french
- english
- forums
- blogs
size_categories:
- 10K<n<100K
---

# Moroccan Darija Code-Switched Corpus (Sentence-level TSV)

## Dataset Summary
This dataset contains sentence/post-level **code-switched Moroccan Darija** text with a **single label per text unit**. It is intended to support NLP research on Moroccan Darija (Darija), an under-resourced Arabic variety, and on sentence-level code-switching / language identification in Moroccan online text.

## Languages
The corpus may contain Moroccan Darija (often `ary`) and code-switching with:
- Modern Standard Arabic (`ar`)
- French (`fr`)
- English (`en`)
- Berber (tmz)

## Dataset Structure

### Data Format
The dataset is provided as **TSV** (tab-separated) files with a header row and **three columns**:

- `sentence_id` (string/int): Unique identifier for the text unit
- `text` (string): Raw code-switched text (may contain Arabic + Latin scripts)
- `label` (string): Sentence-level label (one label per row)

#### Example

```tsv
sentence_id words labels
0 حتی lang2
0 الأجر lang2
0 ديالك lang2
0 و lang2
0 ديال lang2
0 الوزراء lang2
0 و lang2
0 النواب lang2
0 و lang2
0 المستشارين lang2
0 و lang2
0 التعويضات lang2
0 الخيالية lang2
0 ديالكم lang2
0 ما lang2
0 كيستافدش lang2
0 منها lang2
0 المواطن lang2
0 العادي lang2
0 . other
```

## Reference/ Source:
```
@inproceedings{samih-maier-2016-arabic,
title = "An {A}rabic-{M}oroccan {D}arija Code-Switched Corpus", author = "Samih, Younes andMaier, Wolfgang",
editor = "Calzolari, Nicoletta and
Choukri, Khalid and
Declerck, Thierry and
Goggi, Sara and
Grobelnik, Marko and
Maegaard, Bente and
Mariani, Joseph and
Mazo, Helene and
Moreno, Asuncion and
Odijk, Jan and
Piperidis, Stelios",
booktitle = "Proceedings of the Tenth International Conference on Language Resources and Evaluation ({LREC}'16)",
month = may,
year = "2016",
address = "Portoro{\v{z}}, Slovenia",
publisher = "European Language Resources Association (ELRA)",
url = "https://aclanthology.org/L16-1658/",
pages = "4170--4175",
abstract = "In this paper, we describe our effort in the development and annotation of a large scale corpus containing code-switched data. Until recently, very limited effort has been devoted to develop computational approaches or even basic linguistic resources to support research into the processing of Moroccan Darija."
}
```