wikipedia-monthly

# 🚀 Wikipedia Monthly

*Last updated: August 05, 2025, 10:15 UTC*

This repository provides **monthly, multilingual dumps of Wikipedia**, processed and prepared for easy use in NLP projects.

## 📊 Current Statistics

| Metric | Current Export (August 2025) | All Exports (Total) |
|--------|------------|----------|
| **Languages** | 297 | 341 |
| **Articles** | 53.9M | 118.4M |
| **Dataset Size** | 67.9 GB | 536.5 GB |

---

## Why Use This Dataset?

1. **Freshness**: We run our pipeline monthly to capture the latest versions of all articles.
2. **Clean & Ready**: We handle the messy parts of parsing MediaWiki markup. You get clean plain text ready for use.
3. **Easy Access**: Load any language with a single line of code using 🤗 `datasets`.

[Learn about the Wikipedia Monthly project in this blog post](https://omarkama.li/blog/wikipedia-monthly-fresh-clean-dumps-nlp-ai-research).

## Usage

```python
from datasets import load_dataset

# Load the English dataset from the latest dump
dataset = load_dataset("omarkamali/wikipedia-monthly", "latest.en", split="train", streaming=True)
```

---

## 🌍 Language Subsets

This dataset is organized into configurations, one for each language dump. The table below lists all available subsets. For new languages, the article count will show as "Processing..." until the first full run is complete.

| Language Code | Date of last export | Articles | Size |
|---|---|---|---|
| `ab` | 2025-08-01 | 6.5K | 12.9 MB |
| `ace` | 2025-08-01 | 13.1K | 4.2 MB |
| `ady` | 2025-08-01 | 729 | 509.5 KB |
| `af` | 2025-08-01 | 125.6K | 165.8 MB |
| `ak` | 2025-08-01 | 1 | 3.5 KB |
| `als` | 2025-07-01 | 31.2K | 258.6 MB |
| `alt` | 2025-08-01 | 1.1K | 6.7 MB |
| `am` | 2025-08-01 | 14.1K | 49.3 MB |
| `ami` | 2025-08-01 | 1.8K | 11.8 MB |
| `an` | 2025-08-01 | 49.7K | 56.1 MB |
| `ang` | 2025-08-01 | 5.0K | 2.7 MB |
| `ann` | 2025-08-01 | 488 | 342.6 KB |
| `anp` | 2025-08-01 | 3.1K | 4.8 MB |
| `ar` | 2025-08-01 | 1.3M | 1.6 GB |
| `arc` | 2025-08-01 | 2.0K | 599.2 KB |
| `ary` | 2025-08-01 | 10.7K | 20.2 MB |
| `arz` | 2025-08-01 | 1.6M | 367.6 MB |
| `as` | 2025-08-01 | 19.4K | 105.6 MB |
| `ast` | 2025-08-01 | 137.5K | 329.3 MB |
| `atj` | 2025-08-01 | 2.1K | 829.8 KB |
| `av` | 2025-08-01 | 3.7K | 4.2 MB |
| `avk` | 2025-08-01 | 29.8K | 14.6 MB |
| `awa` | 2025-08-01 | 3.7K | 2.1 MB |
| `ay` | 2025-08-01 | 5.4K | 4.6 MB |
| `az` | 2025-08-01 | 206.4K | 287.4 MB |
| `azb` | 2025-08-01 | 244.3K | 66.5 MB |
| `ba` | 2025-08-01 | 63.9K | 167.4 MB |
| `ban` | 2025-08-01 | 31.5K | 20.1 MB |
| `bar` | 2025-08-01 | 27.3K | 41.0 MB |
| `bbc` | 2025-08-01 | 1.2K | 5.7 MB |
| `bcl` | 2025-08-01 | 20.9K | 42.1 MB |
| `bdr` | 2025-08-01 | 669 | 129.9 KB |
| `be` | 2025-08-01 | 255.1K | 355.5 MB |
| `bew` | 2025-08-01 | 3.2K | 1.9 MB |
| `bg` | 2025-08-01 | 305.2K | 611.5 MB |
| `bh` | 2025-08-01 | 8.9K | 11.5 MB |
| `bi` | 2025-08-01 | 1.6K | 407.8 KB |
| `bjn` | 2025-08-01 | 11.4K | 10.9 MB |
| `blk` | 2025-08-01 | 3.2K | 11.7 MB |
| `bm` | 2025-08-01 | 1.3K | 757.2 KB |
| `bn` | 2025-08-01 | 174.4K | 524.4 MB |
| `bo` | 2025-08-01 | 13.6K | 86.1 MB |
| `bpy` | 2025-08-01 | 25.2K | 12.8 MB |
| `br` | 2025-08-01 | 89.2K | 71.1 MB |
| `bs` | 2025-08-01 | 95.6K | 156.8 MB |
| `btm` | 2025-08-01 | 1.3K | 1.4 MB |
| `bug` | 2025-08-01 | 16.0K | 2.6 MB |
| `bxr` | 2025-08-01 | 2.9K | 4.7 MB |
| `ca` | 2025-08-01 | 781.1K | 1.3 GB |
| `cdo` | 2025-08-01 | 16.7K | 4.8 MB |
| `ce` | 2025-08-01 | 602.0K | 96.9 MB |
| `ceb` | 2025-08-01 | 6.1M | 955.9 MB |
| `ch` | 2025-08-01 | 607 | 106.8 KB |
| `cho` | 2025-08-01 | 13 | 10.8 KB |
| `chr` | 2025-08-01 | 1.1K | 595.3 KB |
| `chy` | 2025-08-01 | 829 | 94.0 KB |
| `ckb` | 2025-08-01 | 79.3K | 73.6 MB |
| `co` | 2025-08-01 | 8.5K | 12.9 MB |
| `cr` | 2025-08-01 | 25 | 24.5 KB |
| `crh` | 2025-08-01 | 29.7K | 6.9 MB |
| `cs` | 2025-07-01 | 572.1K | 5.4 GB |
| `csb` | 2025-08-01 | 5.5K | 4.6 MB |
| `cu` | 2025-08-01 | 1.3K | 921.2 KB |
| `cv` | 2025-08-01 | 58.1K | 46.0 MB |
| `cy` | 2025-08-01 | 282.3K | 145.4 MB |
| `da` | 2025-08-01 | 310.0K | 396.2 MB |
| `dag` | 2025-08-01 | 14.9K | 48.9 MB |
| `de` | 2025-08-01 | 3.0M | 6.8 GB |
| `dga` | 2025-08-01 | 3.2K | 4.8 MB |
| `din` | 2025-08-01 | 511 | 362.3 KB |
| `diq` | 2025-08-01 | 42.4K | 13.8 MB |
| `dsb` | 2025-08-01 | 3.4K | 2.9 MB |
| `dtp` | 2025-08-01 | 1.9K | 4.6 MB |
| `dty` | 2025-08-01 | 3.9K | 4.4 MB |
| `dv` | 2025-08-01 | 4.6K | 6.9 MB |
| `dz` | 2025-08-01 | 1.1K | 6.6 MB |
| `ee` | 2025-08-01 | 1.4K | 1.7 MB |
| `el` | 2025-08-01 | 256.4K | 803.3 MB |
| `eml` | 2025-08-01 | 12.8K | 3.4 MB |
| `en` | 2025-07-02 | 7.0M | 30.6 GB |
| `eo` | 2025-08-01 | 373.4K | 359.4 MB |
| `es` | 2025-08-01 | 2.0M | 4.1 GB |
| `et` | 2025-08-01 | 254.1K | 323.6 MB |
| `eu` | 2025-08-01 | 459.8K | 357.2 MB |
| `ext` | 2025-08-01 | 4.1K | 5.1 MB |
| `fa` | 2025-08-01 | 1.1M | 947.4 MB |
| `fat` | 2025-08-01 | 1.8K | 3.0 MB |
| `ff` | 2025-08-01 | 20.6K | 32.2 MB |
| `fi` | 2025-08-01 | 599.2K | 817.0 MB |
| `fj` | 2025-08-01 | 1.6K | 810.7 KB |
| `fo` | 2025-08-01 | 14.2K | 21.8 MB |
| `fon` | 2025-08-01 | 2.8K | 1.3 MB |
| `fr` | 2025-08-01 | 2.7M | 5.3 GB |
| `frp` | 2025-08-01 | 5.8K | 5.3 MB |
| `frr` | 2025-08-01 | 20.2K | 13.6 MB |
| `fur` | 2025-08-01 | 4.9K | 3.6 MB |
| `fy` | 2025-08-01 | 57.5K | 114.9 MB |
| `ga` | 2025-08-01 | 62.1K | 53.0 MB |
| `gag` | 2025-08-01 | 3.2K | 2.2 MB |
| `gan` | 2025-08-01 | 6.8K | 3.3 MB |
| `gcr` | 2025-08-01 | 2.4K | 1.9 MB |
| `gd` | 2025-08-01 | 16.1K | 17.2 MB |
| `gl` | 2025-08-01 | 225.6K | 367.5 MB |
| `glk` | 2025-08-01 | 48.4K | 10.2 MB |
| `gn` | 2025-08-01 | 5.9K | 9.3 MB |
| `gom` | 2025-08-01 | 4.3K | 13.7 MB |
| `gor` | 2025-08-01 | 15.5K | 5.9 MB |
| `got` | 2025-08-01 | 1.1K | 1.3 MB |
| `gpe` | 2025-08-01 | 4.1K | 13.2 MB |
| `gu` | 2025-08-01 | 30.7K | 65.0 MB |
| `guc` | 2025-08-01 | 898 | 709.8 KB |
| `gur` | 2025-08-01 | 3.2K | 4.5 MB |
| `guw` | 2025-08-01 | 1.7K | 2.2 MB |
| `gv` | 2025-08-01 | 6.9K | 8.8 MB |
| `ha` | 2025-08-01 | 67.4K | 139.8 MB |
| `hak` | 2025-08-01 | 10.5K | 6.3 MB |
| `haw` | 2025-08-01 | 3.0K | 1.8 MB |
| `he` | 2025-08-01 | 369.8K | 1.1 GB |
| `hi` | 2025-08-01 | 168.6K | 291.9 MB |
| `hif` | 2025-08-01 | 12.0K | 10.0 MB |
| `ho` | 2025-08-01 | 3 | 7.3 KB |
| `hr` | 2025-08-01 | 213.5K | 336.1 MB |
| `hsb` | 2025-08-01 | 14.1K | 18.6 MB |
| `ht` | 2025-08-01 | 72.2K | 32.6 MB |
| `hu` | 2025-08-01 | 559.7K | 1.1 GB |
| `hy` | 2025-08-01 | 321.3K | 674.5 MB |
| `hyw` | 2025-08-01 | 12.8K | 70.3 MB |
| `ia` | 2025-08-01 | 30.3K | 18.1 MB |
| `iba` | 2025-08-01 | 1.7K | 2.7 MB |
| `id` | 2025-08-01 | 733.1K | 782.5 MB |
| `ie` | 2025-08-01 | 13.3K | 9.2 MB |
| `ig` | 2025-08-01 | 50.5K | 106.7 MB |
| `igl` | 2025-08-01 | 1.0K | 3.5 MB |
| `ii` | 2025-08-01 | 14 | 18.2 KB |
| `ik` | 2025-08-01 | 897 | 159.8 KB |
| `ilo` | 2025-08-01 | 15.4K | 18.6 MB |
| `inh` | 2025-08-01 | 2.3K | 2.4 MB |
| `io` | 2025-08-01 | 57.7K | 27.4 MB |
| `is` | 2025-08-01 | 60.5K | 75.6 MB |
| `it` | 2025-08-01 | 1.9M | 3.4 GB |
| `iu` | 2025-08-01 | 541 | 243.5 KB |
| `ja` | 2025-08-01 | 1.5M | 4.6 GB |
| `jam` | 2025-08-01 | 1.8K | 1.3 MB |
| `jbo` | 2025-08-01 | 1.4K | 1.5 MB |
| `jv` | 2025-08-01 | 75.1K | 51.4 MB |
| `ka` | 2025-08-01 | 184.6K | 308.6 MB |
| `kaa` | 2025-08-01 | 10.5K | 30.2 MB |
| `kab` | 2025-08-01 | 6.1K | 6.4 MB |
| `kbd` | 2025-08-01 | 1.7K | 2.3 MB |
| `kbp` | 2025-08-01 | 2.0K | 2.8 MB |
| `kcg` | 2025-08-01 | 1.8K | 1.7 MB |
| `kg` | 2025-08-01 | 1.6K | 957.6 KB |
| `kge` | 2025-08-01 | 2.8K | 851.6 KB |
| `ki` | 2025-08-01 | 2.1K | 1.4 MB |
| `kj` | 2025-08-01 | 5 | 9.6 KB |
| `kk` | 2025-08-01 | 243.1K | 217.9 MB |
| `kl` | 2025-08-01 | 300 | 197.5 KB |
| `km` | 2025-08-01 | 13.2K | 91.0 MB |
| `kn` | 2025-08-01 | 34.8K | 245.5 MB |
| `knc` | 2025-08-01 | 2.0K | 2.6 MB |
| `ko` | 2025-08-01 | 715.8K | 1.0 GB |
| `koi` | 2025-08-01 | 3.5K | 2.9 MB |
| `krc` | 2025-08-01 | 2.6K | 4.6 MB |
| `ks` | 2025-08-01 | 7.1K | 5.8 MB |
| `ksh` | 2025-08-01 | 3.0K | 2.7 MB |
| `ku` | 2025-08-01 | 90.5K | 34.7 MB |
| `kus` | 2025-08-01 | 1.5K | 6.2 MB |
| `kv` | 2025-08-01 | 6.0K | 9.3 MB |
| `kw` | 2025-08-01 | 7.1K | 5.9 MB |
| `ky` | 2025-08-01 | 76.4K | 78.8 MB |
| `la` | 2025-07-02 | 140.3K | 458.2 MB |
| `lad` | 2025-08-01 | 3.9K | 3.9 MB |
| `lb` | 2025-08-01 | 65.5K | 73.4 MB |
| `lbe` | 2025-08-01 | 1.3K | 654.6 KB |
| `lez` | 2025-08-01 | 4.4K | 5.5 MB |
| `lfn` | 2025-08-01 | 5.1K | 24.4 MB |
| `lg` | 2025-08-01 | 4.7K | 6.3 MB |
| `li` | 2025-07-02 | 15.1K | 73.5 MB |
| `lij` | 2025-08-01 | 11.4K | 19.5 MB |
| `lld` | 2025-08-01 | 180.8K | 15.6 MB |
| `lmo` | 2025-07-02 | 77.5K | 130.3 MB |
| `ln` | 2025-08-01 | 5.1K | 5.1 MB |
| `lo` | 2025-08-01 | 5.7K | 13.6 MB |
| `lrc` | 2025-08-01 | 1 | 3.3 KB |
| `lt` | 2025-08-01 | 220.7K | 240.0 MB |
| `ltg` | 2025-08-01 | 1.1K | 1.2 MB |
| `lv` | 2025-07-02 | 136.4K | 853.8 MB |
| `mad` | 2025-08-01 | 2.2K | 4.7 MB |
| `mai` | 2025-07-02 | 15.0K | 79.4 MB |
| `mdf` | 2025-08-01 | 7.7K | 6.5 MB |
| `mg` | 2025-07-02 | 100.5K | 249.2 MB |
| `mh` | 2025-08-01 | 8 | 15.3 KB |
| `mhr` | 2025-08-01 | 11.4K | 18.3 MB |
| `mi` | 2025-07-02 | 8.0K | 14.7 MB |
| `min` | 2025-08-01 | 228.7K | 31.1 MB |
| `mk` | 2025-08-01 | 154.6K | 372.1 MB |
| `ml` | 2025-07-02 | 88.0K | 1.3 GB |
| `mn` | 2025-08-01 | 29.3K | 84.7 MB |
| `mni` | 2025-07-02 | 11.1K | 29.2 MB |
| `mnw` | 2025-08-01 | 3.4K | 19.7 MB |
| `mos` | 2025-08-01 | 1.6K | 5.6 MB |
| `mr` | 2025-08-01 | 100.4K | 117.4 MB |
| `mrj` | 2025-08-01 | 10.5K | 9.5 MB |
| `ms` | 2025-08-01 | 431.2K | 285.8 MB |
| `mt` | 2025-08-01 | 7.5K | 53.8 MB |
| `mus` | 2025-08-01 | 2 | 5.1 KB |
| `mwl` | 2025-07-02 | 4.5K | 46.5 MB |
| `my` | 2025-08-01 | 111.5K | 106.5 MB |
| `myv` | 2025-08-01 | 8.0K | 9.2 MB |
| `mzn` | 2025-08-01 | 66.2K | 14.3 MB |
| `nah` | 2025-08-01 | 4.6K | 3.0 MB |
| `nap` | 2025-08-01 | 15.0K | 7.5 MB |
| `nds` | 2025-08-01 | 85.7K | 64.7 MB |
| `ne` | 2025-08-01 | 30.2K | 67.0 MB |
| `new` | 2025-07-02 | 73.1K | 367.5 MB |
| `ng` | 2025-08-01 | 18 | 41.7 KB |
| `nia` | 2025-08-01 | 1.8K | 2.2 MB |
| `nl` | 2025-08-01 | 2.2M | 1.7 GB |
| `nn` | 2025-08-01 | 175.2K | 164.0 MB |
| `no` | 2025-08-01 | 653.9K | 715.7 MB |
| `nov` | 2025-08-01 | 2.0K | 1.1 MB |
| `nqo` | 2025-07-02 | 1.7K | 17.3 MB |
| `nr` | 2025-08-01 | 402 | 463.6 KB |
| `nrm` | 2025-08-01 | 5.1K | 4.0 MB |
| `nso` | 2025-08-01 | 8.9K | 2.3 MB |
| `nup` | 2025-08-01 | 797 | 330.7 KB |
| `nv` | 2025-08-01 | 22.6K | 6.6 MB |
| `ny` | 2025-08-01 | 1.2K | 2.0 MB |
| `oc` | 2025-08-01 | 90.1K | 85.4 MB |
| `olo` | 2025-08-01 | 4.9K | 2.3 MB |
| `om` | 2025-08-01 | 2.4K | 3.9 MB |
| `or` | 2025-07-02 | 19.7K | 224.8 MB |
| `os` | 2025-08-01 | 21.1K | 11.8 MB |
| `pa` | 2025-08-01 | 59.1K | 129.1 MB |
| `pag` | 2025-08-01 | 2.7K | 830.4 KB |
| `pam` | 2025-08-01 | 10.4K | 16.1 MB |
| `pap` | 2025-08-01 | 4.8K | 5.5 MB |
| `pcd` | 2025-08-01 | 6.1K | 8.5 MB |
| `pcm` | 2025-07-02 | 1.8K | 6.9 MB |
| `pdc` | 2025-08-01 | 2.2K | 1.1 MB |
| `pfl` | 2025-08-01 | 2.8K | 3.2 MB |
| `pi` | 2025-08-01 | 2.9K | 356.3 KB |
| `pih` | 2025-08-01 | 1 | 5.6 KB |
| `pl` | 2025-08-01 | 1.7M | 2.0 GB |
| `pms` | 2025-07-02 | 70.4K | 109.2 MB |
| `pnb` | 2025-08-01 | 75.0K | 185.3 MB |
| `pnt` | 2025-08-01 | 542 | 278.7 KB |
| `ps` | 2025-08-01 | 22.6K | 102.2 MB |
| `pt` | 2025-08-01 | 1.2M | 2.0 GB |
| `pwn` | 2025-08-01 | 452 | 581.4 KB |
| `qu` | 2025-07-03 | 24.4K | 69.7 MB |
| `rm` | 2025-08-01 | 3.9K | 14.2 MB |
| `rmy` | 2025-07-03 | 839 | 1.7 MB |
| `rn` | 2025-08-01 | 973 | 408.8 KB |
| `ro` | 2025-08-01 | 515.9K | 611.0 MB |
| `rsk` | 2025-07-03 | 758 | 12.3 MB |
| `ru` | 2025-08-01 | 2.1M | 5.4 GB |
| `rue` | 2025-08-01 | 10.1K | 23.8 MB |
| `rw` | 2025-08-01 | 10.2K | 27.1 MB |
| `sa` | 2025-08-01 | 12.6K | 61.4 MB |
| `sah` | 2025-08-01 | 17.9K | 47.7 MB |
| `sat` | 2025-08-01 | 14.2K | 51.7 MB |
| `sc` | 2025-07-03 | 7.8K | 33.5 MB |
| `scn` | 2025-08-01 | 26.3K | 17.7 MB |
| `sco` | 2025-08-01 | 34.4K | 38.6 MB |
| `sd` | 2025-08-01 | 20.0K | 44.6 MB |
| `se` | 2025-07-03 | 8.1K | 11.2 MB |
| `sg` | 2025-07-03 | 590 | 633.4 KB |
| `sh` | 2025-08-01 | 461.1K | 290.6 MB |
| `shi` | 2025-08-01 | 10.9K | 11.2 MB |
| `shn` | 2025-07-03 | 14.4K | 89.3 MB |
| `si` | 2025-07-03 | 26.5K | 412.5 MB |
| `simple` | 2025-08-01 | 271.9K | 218.1 MB |
| `sk` | 2025-08-01 | 249.2K | 298.2 MB |
| `skr` | 2025-07-03 | 24.2K | 223.9 MB |
| `sl` | 2025-08-01 | 194.3K | 356.1 MB |
| `sm` | 2025-08-01 | 1.2K | 1.2 MB |
| `smn` | 2025-08-01 | 6.3K | 9.7 MB |
| `sn` | 2025-07-03 | 11.9K | 22.4 MB |
| `so` | 2025-08-01 | 9.6K | 15.5 MB |
| `sq` | 2025-07-03 | 113.9K | 704.3 MB |
| `sr` | 2025-08-01 | 742.8K | 1.2 GB |
| `srn` | 2025-08-01 | 1.2K | 440.6 KB |
| `ss` | 2025-07-03 | 1.3K | 3.9 MB |
| `st` | 2025-08-01 | 1.8K | 2.2 MB |
| `stq` | 2025-08-01 | 4.2K | 4.0 MB |
| `su` | 2025-08-01 | 62.0K | 27.8 MB |
| `sv` | 2025-08-01 | 2.6M | 1.1 GB |
| `sw` | 2025-08-01 | 100.6K | 57.0 MB |
| `syl` | 2025-08-01 | 1.1K | 1.0 MB |
| `szl` | 2025-08-01 | 58.7K | 12.6 MB |
| `szy` | 2025-07-03 | 5.3K | 32.4 MB |
| `ta` | 2025-07-03 | 176.5K | 2.3 GB |
| `tay` | 2025-08-01 | 2.9K | 2.9 MB |
| `tcy` | 2025-07-03 | 3.1K | 45.1 MB |
| `tdd` | 2025-07-03 | 519 | 2.8 MB |
| `te` | 2025-08-01 | 114.8K | 344.6 MB |
| `tet` | 2025-07-03 | 1.5K | 5.4 MB |
| `tg` | 2025-08-01 | 115.8K | 66.4 MB |
| `th` | 2025-07-03 | 174.9K | 3.4 GB |
| `ti` | 2025-07-03 | 523 | 2.6 MB |
| `tig` | 2025-08-01 | 371 | 2.5 MB |
| `tk` | 2025-08-01 | 8.0K | 12.0 MB |
| `tl` | 2025-08-01 | 48.8K | 81.1 MB |
| `tly` | 2025-08-01 | 11.6K | 3.9 MB |
| `tn` | 2025-08-01 | 3.1K | 9.2 MB |
| `to` | 2025-08-01 | 1.9K | 859.6 KB |
| `tpi` | 2025-07-03 | 1.4K | 1.8 MB |
| `tr` | 2025-08-01 | 643.7K | 729.2 MB |
| `trv` | 2025-08-01 | 2.0K | 4.4 MB |
| `ts` | 2025-08-01 | 1.1K | 1.8 MB |
| `tt` | 2025-08-01 | 503.4K | 153.9 MB |
| `tum` | 2025-08-01 | 18.9K | 12.8 MB |
| `tw` | 2025-07-03 | 5.0K | 28.8 MB |
| `ty` | 2025-08-01 | 1.4K | 304.4 KB |
| `tyv` | 2025-08-01 | 3.8K | 9.2 MB |
| `udm` | 2025-08-01 | 5.7K | 7.4 MB |
| `ug` | 2025-07-03 | 9.8K | 95.7 MB |
| `uk` | 2025-08-01 | 1.4M | 2.7 GB |
| `ur` | 2025-07-03 | 228.7K | 1.6 GB |
| `uz` | 2025-08-01 | 294.8K | 240.2 MB |
| `ve` | 2025-08-01 | 953 | 250.1 KB |
| `vec` | 2025-08-01 | 69.5K | 21.9 MB |
| `vep` | 2025-08-01 | 7.1K | 14.9 MB |
| `vi` | 2025-08-01 | 1.3M | 854.6 MB |
| `vls` | 2025-07-03 | 8.2K | 29.9 MB |
| `vo` | 2025-08-01 | 43.9K | 12.6 MB |
| `wa` | 2025-08-01 | 12.7K | 19.3 MB |
| `war` | 2025-08-01 | 1.3M | 158.0 MB |
| `wo` | 2025-08-01 | 1.8K | 3.5 MB |
| `wuu` | 2025-08-01 | 46.3K | 25.3 MB |
| `xal` | 2025-07-03 | 1.8K | 3.0 MB |
| `xh` | 2025-08-01 | 2.7K | 4.8 MB |
| `xmf` | 2025-08-01 | 21.1K | 28.2 MB |
| `yi` | 2025-08-01 | 15.3K | 33.7 MB |
| `yo` | 2025-08-01 | 36.1K | 19.0 MB |
| `za` | 2025-08-01 | 3.1K | 953.7 KB |
| `zea` | 2025-08-01 | 6.9K | 5.6 MB |
| `zgh` | 2025-08-01 | 11.7K | 16.2 MB |
| `zh` | 2025-07-03 | 1.5M | 11.7 GB |
| `zu` | 2025-08-01 | 12.2K | 11.8 MB |

---

## Dataset Creation Process

Our pipeline is designed for transparency and robustness:
1. **Download**: We fetch the latest `pages-articles.xml.bz2` dump for each language directly from the official [Wikimedia dumps server](https://dumps.wikimedia.org/).
2. **Filter**: We stream the dump and process **only main articles** (namespace `0`), filtering out user pages, talk pages, and other metadata.
3. **Process**: Using `mwparserfromhell`, we parse the MediaWiki syntax to extract clean, readable content.
4. **Format**: We generate a plain text representation by applying additional post-processing on the output from `mwparserfromhell`.
5. **Upload**: The resulting dataset is uploaded to the Hugging Face Hub with a configuration name corresponding to the dump date and language (e.g., `20250710.en`).

---

## Data Fields

Each row in the dataset corresponds to a single Wikipedia article and contains the following fields:

* `id`: The unique Wikipedia page ID (`string`).
* `url`: The URL to the live article (`string`).
* `title`: The title of the article (`string`).
* `text`: The clean, plain text content of the article (`string`).
* `raw_mediawiki`: The original, unprocessed MediaWiki source content (`string`).

## Maintainer

Wikipedia Monthly is compiled, processed and published by [Omar Kamali](https://omarkama.li) based on the official Wikipedia dumps.

## License

Wikipedia Monthly is built on top of the incredible work by the Wikimedia Foundation and the open-source community. All content maintains the original CC-BY-SA-4.0 license.