electricsheepafrica/africa-wfp-food-security-indicators-for-malawi

---
annotations_creators:
- no-annotation
language_creators:
- found
language:
- en
license: cc-by-4.0
multilinguality:
- monolingual
size_categories:
- 1K<n<10K
source_datasets:
- original
task_categories:
- tabular-regression
- other
task_ids: []
tags:
- africa
- humanitarian
- hdx
- electric-sheep-africa
- food-security
- hxl
- indicators
- mwi
pretty_name: "Malawi - Food Security Indicators"
dataset_info:
splits:
- name: train
num_examples: 7758
- name: test
num_examples: 1939
---

# Malawi - Food Security Indicators

**Publisher:** WFP - World Food Programme · **Source:** [HDX](https://data.humdata.org/dataset/wfp-food-security-indicators-for-malawi) · **License:** `cc-by-igo` · **Updated:** 2024-09-13

---

## Abstract

The World Food Programme (WFP) launched the mobile Vulnerability Analysis and Mapping (mVAM) project in 2013, beginning in DRC and Somalia. mVAM uses mobile technology to track food security trends in real-time, providing high-frequency data that supports humanitarian decision-making. Data collection methods are tailored to the needs of each country that mVAM operates in. This dataset contains data from the [mVAM databank](http://vam.wfp.org/sites/mvam_monitoring/) covering various indicators (one per resource).

Each row in this dataset represents time-series observations. Temporal coverage is indicated by the `svydate` column(s). Geographic scope: **MWI**.

*Curated into ML-ready Parquet format by [Electric Sheep Africa](https://huggingface.co/electricsheepafrica).*

---

## Dataset Characteristics

| | |
|---|---|
| **Domain** | Food security and nutrition |
| **Unit of observation** | Time-series observations |
| **Rows (total)** | 9,698 |
| **Columns** | 9 (1 numeric, 7 categorical, 1 datetime) |
| **Train split** | 7,758 rows |
| **Test split** | 1,939 rows |
| **Geographic scope** | MWI |
| **Publisher** | WFP - World Food Programme |
| **HDX last updated** | 2024-09-13 |

---

## Variables

**Geographic** — `svydate`, `adminstrata` (Mzimba-Karonga-Rumphi, Lilongwe, Machinga-Mangochi).

**Identifier / Metadata** — `adm0_name` (Malawi, #country+name), `esa_source` (HDX), `esa_processed` (2026-04-05).

**Other** — `variable` (rCSI>=1, rCSI, LimitPortionSize>=1), `variabledescription` (prevalence-->equals to 1 if household uses this strategy 1 or more times per week, # of days household using this coping strategy per week, reduced coping strategy), `demographic` (F, M, Cement), `mean` (range -0.6679–1188.193).

---

## Quick Start

```python
from datasets import load_dataset

ds = load_dataset("electricsheepafrica/africa-wfp-food-security-indicators-for-malawi")
train = ds["train"].to_pandas()
test = ds["test"].to_pandas()

print(train.shape)
train.head()
```

---

## Schema

| Column | Type | Null % | Range / Sample Values |
|---|---|---|---|
| `svydate` | datetime64[ns] | 0.0% | |
| `adm0_name` | object | 0.0% | Malawi, #country+name |
| `adminstrata` | object | 34.0% | Mzimba-Karonga-Rumphi, Lilongwe, Machinga-Mangochi |
| `variable` | object | 0.0% | rCSI>=1, rCSI, LimitPortionSize>=1 |
| `variabledescription` | object | 7.6% | prevalence-->equals to 1 if household uses this strategy 1 or more times per week, # of days household using this coping strategy per week, reduced coping strategy |
| `demographic` | object | 39.2% | F, M, Cement |
| `mean` | float64 | 0.0% | -0.6679 – 1188.193 (mean 39.5177) |
| `esa_source` | object | 0.0% | HDX |
| `esa_processed` | object | 0.0% | 2026-04-05 |

---

## Numeric Summary

| Column | Min | Max | Mean | Median |
|---|---|---|---|---|
| `mean` | -0.6679 | 1188.193 | 39.5177 | 0.9768 |

---

## Curation

Raw data was downloaded from HDX via the CKAN API and converted to Parquet. Column names were lowercased and standardised to snake_case. Common missing-value markers (`N/A`, `null`, `none`, `-`, `unknown`, `no data`, `#N/A`) were unified to `NaN`. 2 column(s) with >80% missing values were removed: `adm1_name`, `adm2_name`. 97 exact duplicate rows were removed. 2 column(s) were cast from string to numeric or datetime based on parse-success rate (>85% threshold). The dataset was split 80/20 into train and test partitions using a fixed random seed (42) and saved as Snappy-compressed Parquet.

---

## Limitations

- Data originates from WFP - World Food Programme and has not been independently validated by ESA.
- Automated cleaning cannot correct for misreported values, definitional inconsistencies, or sampling bias in the original collection.
- The following columns have >20% missing values and should be treated with caution in modelling: `adminstrata`, `demographic`.
- Refer to the [original HDX dataset page](https://data.humdata.org/dataset/wfp-food-security-indicators-for-malawi) for the publisher's own methodology notes and caveats.

---

## Citation

```bibtex
@dataset{hdx_africa_wfp_food_security_indicators_for_malawi,
title = {Malawi - Food Security Indicators},
author = {WFP - World Food Programme},
year = {2024},
url = {https://data.humdata.org/dataset/wfp-food-security-indicators-for-malawi},
note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)}
}
```

---

*[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — Africa's ML dataset infrastructure. Lagos, Nigeria.*

annotations_creators:
- 无注释
language_creators:
- 采集获取
language:
- 英语
license: 知识共享署名4.0（CC BY 4.0）
multilinguality:
- 单语言
size_categories:
- 1000 < 样本量 < 10000
source_datasets:
- 原创数据集
task_categories:
- 表格回归（tabular-regression）
- 其他
task_ids: []
tags:
- 非洲
- 人道主义
- 人道主义数据交换（HDX，Humanitarian Data Exchange）
- Electric Sheep Africa
- 粮食安全
- 人道主义交换语言（HXL，Humanitarian Exchange Language）
- 指标
- 马拉维（MWI，Malawi）
pretty_name: "马拉维——粮食安全指标"
dataset_info:
splits:
- name: 训练集
num_examples: 7758
- name: 测试集
num_examples: 1939
---

# 马拉维——粮食安全指标

**发布方:** 世界粮食计划署（WFP，World Food Programme） · **来源:** [HDX（人道主义数据交换，Humanitarian Data Exchange）](https://data.humdata.org/dataset/wfp-food-security-indicators-for-malawi) · **许可证:** `cc-by-igo`（知识共享署名-政府间组织许可） · **更新:** 2024-09-13

---

## 摘要

世界粮食计划署（WFP，World Food Programme）于2013年启动了移动脆弱性分析与制图（mVAM，mobile Vulnerability Analysis and Mapping）项目，最初在刚果（金）和索马里开展。mVAM依托移动技术实时追踪粮食安全趋势，提供高频次数据以支撑人道主义决策制定。数据收集方法会根据mVAM运营所在的每个国家的需求进行定制。本数据集包含来自[mVAM数据库](http://vam.wfp.org/sites/mvam_monitoring/)的各类指标数据（每份资源对应一项指标）。

本数据集的每一行均代表时序观测数据。时间覆盖范围由`svydate`（调查日期）列标注。地理覆盖范围：**马拉维（MWI，Malawi）**。

*本数据集由[Electric Sheep Africa](https://huggingface.co/electricsheepafrica)整理为适用于机器学习的Parquet格式（Parquet）。*

---

## 数据集特征

| | |
|---|---|
| **领域** | 粮食安全与营养 |
| **观测单元** | 时序观测数据 |
| **总行数** | 9698条 |
| **列数** | 9列（1列数值型、7列分类型、1列日期时间型） |
| **训练集划分** | 7758条数据 |
| **测试集划分** | 1939条数据 |
| **地理覆盖范围** | 马拉维（MWI） |
| **发布方** | 世界粮食计划署（WFP） |
| **HDX最后更新时间** | 2024-09-13 |

---

## 变量

**地理相关** — `svydate`（调查日期）、`adminstrata`（行政区域：姆津巴-卡龙加-伦皮、利隆圭、马钦加-曼戈奇）。

**标识符 / 元数据** — `adm0_name`（马拉维，#country+name）、`esa_source`（HDX）、`esa_processed`（2026-04-05）。

**其他** — `variable`（rCSI≥1、rCSI、LimitPortionSize≥1）、`variabledescription`（患病率——若家庭每周使用该策略1次及以上则取值为1；家庭每周采用该应对策略的天数、简化应对策略）、`demographic`（F、M、Cement）、`mean`（取值范围：-0.6679–1188.193）。

---

## 快速上手

python
from datasets import load_dataset

ds = load_dataset("electricsheepafrica/africa-wfp-food-security-indicators-for-malawi")
train = ds["train"].to_pandas()
test = ds["test"].to_pandas()

print(train.shape)
train.head()

---

## 数据结构

| 列名 | 数据类型 | 缺失率 | 取值范围/示例值 |
|---|---|---|---|
| `svydate` | datetime64[ns] | 0.0% | 无 |
| `adm0_name` | object | 0.0% | 马拉维，#country+name |
| `adminstrata` | object | 34.0% | 姆津巴-卡龙加-伦皮、利隆圭、马钦加-曼戈奇 |
| `variable` | object | 0.0% | rCSI≥1、rCSI、LimitPortionSize≥1 |
| `variabledescription` | object | 7.6% | 患病率——若家庭每周使用该策略1次及以上则取值为1；家庭每周采用该应对策略的天数、简化应对策略 |
| `demographic` | object | 39.2% | F、M、Cement |
| `mean` | float64 | 0.0% | -0.6679 – 1188.193（均值为39.5177） |
| `esa_source` | object | 0.0% | HDX |
| `esa_processed` | object | 0.0% | 2026-04-05 |

---

## 数值统计摘要

| 列名 | 最小值 | 最大值 | 均值 | 中位数 |
|---|---|---|---|---|
| `mean` | -0.6679 | 1188.193 | 39.5177 | 0.9768 |

---

## 数据整理流程

原始数据通过CKAN API从HDX下载，并转换为Parquet格式（Parquet）。列名统一转为小写并采用蛇形命名法（snake_case）进行标准化。将常见的缺失值标记（`N/A`、`null`、`none`、`-`、`unknown`、`no data`、`#N/A`）统一替换为`NaN`。移除了2列缺失值占比超过80%的字段：`adm1_name`、`adm2_name`。删除了97条完全重复的行。根据解析成功率（阈值为85%），将2列从字符串类型转换为数值型或日期时间型。本数据集采用固定随机种子（42）以80/20的比例划分为训练集与测试集，并保存为Snappy压缩（Snappy）的Parquet格式。

---

## 局限性说明

- 数据源自世界粮食计划署（WFP），未由Electric Sheep Africa进行独立验证。
- 自动化清洗流程无法修正原始数据收集中的错报值、定义不一致或抽样偏差问题。
- 以下列的缺失值占比超过20%，在建模过程中需谨慎使用：`adminstrata`、`demographic`。
- 如需了解发布方提供的方法学说明与注意事项，请参阅[原始HDX数据集页面](https://data.humdata.org/dataset/wfp-food-security-indicators-for-malawi)。

---

## 引用格式

bibtex
@dataset{hdx_africa_wfp_food_security_indicators_for_malawi,
title = {Malawi - Food Security Indicators},
author = {WFP - World Food Programme},
year = {2024},
url = {https://data.humdata.org/dataset/wfp-food-security-indicators-for-malawi},
note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)}
}

---

*[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — 非洲的机器学习数据集基础设施。尼日利亚拉各斯。*