electricsheepafrica/africa-climate-egypt

---
annotations_creators:
- no-annotation
language_creators:
- found
language:
- en
license: other
multilinguality:
- monolingual
size_categories:
- 10K<n<100K
source_datasets:
- original
task_categories:
- tabular-classification
- other
task_ids: []
tags:
- africa
- humanitarian
- hdx
- electric-sheep-africa
- baseline-population
- climate-weather
- conflict-violence
- economics
- education
- food-security
- funding
- hazards-and-risk
- egy
pretty_name: "HDX HAPI Data for Egypt"
dataset_info:
splits:
- name: train
num_examples: 34954
- name: test
num_examples: 8738
---

# HDX HAPI Data for Egypt

**Publisher:** HDX Humanitarian API Data · **Source:** [HDX](https://data.humdata.org/dataset/hdx-hapi-egy) · **License:** `hdx-other` · **Updated:** 2026-02-18

---

## Abstract

This dataset contains data obtained from the
[HDX Humanitarian API](https://hapi.humdata.org/) (HDX HAPI),
which provides standardized humanitarian indicators designed
for seamless interoperability from multiple sources.
The data facilitates automated workflows and visualizations
to support humanitarian decision making.
For more information, please see the HDX HAPI
[landing page](https://data.humdata.org/hapi)
and
[documentation](https://hdx-hapi.readthedocs.io/en/latest/).

Each row in this dataset represents geolocated point observations. Temporal coverage is indicated by the `reference_period_start`, `reference_period_end` column(s). Geographic scope: **EGY**.

*Curated into ML-ready Parquet format by [Electric Sheep Africa](https://huggingface.co/electricsheepafrica).*

---

## Dataset Characteristics

| | |
|---|---|
| **Domain** | Food security and nutrition |
| **Unit of observation** | Geolocated point observations |
| **Rows (total)** | 43,693 |
| **Columns** | 16 (3 numeric, 7 categorical, 2 datetime) |
| **Train split** | 34,954 rows |
| **Test split** | 8,738 rows |
| **Geographic scope** | EGY |
| **Publisher** | HDX Humanitarian API Data |
| **HDX last updated** | 2026-02-18 |

---

## Variables

**Geographic** — `origin_location_code` (EGY, SDN, COD), `asylum_location_code` (EGY, LBN, JOR), `asylum_has_hrp`, `asylum_in_gho`, `population_group` (ASY, REF, OOC) and 2 others.

**Temporal** — `reference_period_start`, `reference_period_end`.

**Demographic** — `gender` (f, m, all), `age_range` (all, 0-4, 5-11), `min_age` (range 0.0–60.0).

**Identifier / Metadata** — `esa_source` (HDX), `esa_processed` (2026-04-20).

**Other** — `origin_has_hrp`, `origin_in_gho`.

---

## Quick Start

```python
from datasets import load_dataset

ds = load_dataset("electricsheepafrica/africa-climate-egypt")
train = ds["train"].to_pandas()
test = ds["test"].to_pandas()

print(train.shape)
train.head()
```

---

## Schema

| Column | Type | Null % | Range / Sample Values |
|---|---|---|---|
| `origin_location_code` | object | 0.0% | EGY, SDN, COD |
| `origin_has_hrp` | bool | 0.0% | |
| `origin_in_gho` | bool | 0.0% | |
| `asylum_location_code` | object | 0.0% | EGY, LBN, JOR |
| `asylum_has_hrp` | bool | 0.0% | |
| `asylum_in_gho` | bool | 0.0% | |
| `population_group` | object | 0.0% | ASY, REF, OOC |
| `gender` | object | 0.0% | f, m, all |
| `age_range` | object | 0.0% | all, 0-4, 5-11 |
| `min_age` | float64 | 23.1% | 0.0 – 60.0 (mean 19.0) |
| `max_age` | float64 | 38.5% | 4.0 – 59.0 (mean 22.75) |
| `population` | int64 | 0.0% | 0.0 – 575006.0 (mean 379.6415) |
| `reference_period_start` | datetime64[ns] | 0.0% | |
| `reference_period_end` | datetime64[ns] | 0.0% | |
| `esa_source` | object | 0.0% | HDX |
| `esa_processed` | object | 0.0% | 2026-04-20 |

---

## Numeric Summary

| Column | Min | Max | Mean | Median |
|---|---|---|---|---|
| `min_age` | 0.0 | 60.0 | 19.0 | 12.0 |
| `max_age` | 4.0 | 59.0 | 22.75 | 14.0 |
| `population` | 0.0 | 575006.0 | 379.6415 | 0.0 |

---

## Curation

Raw data was downloaded from HDX via the CKAN API and converted to Parquet. Column names were lowercased and standardised to snake_case. Common missing-value markers (`N/A`, `null`, `none`, `-`, `unknown`, `no data`, `#N/A`) were unified to `NaN`. 2 column(s) were cast from string to numeric or datetime based on parse-success rate (>85% threshold). The dataset was split 80/20 into train and test partitions using a fixed random seed (42) and saved as Snappy-compressed Parquet.

---

## Limitations

- Data originates from HDX Humanitarian API Data and has not been independently validated by ESA.
- Automated cleaning cannot correct for misreported values, definitional inconsistencies, or sampling bias in the original collection.
- The following columns have >20% missing values and should be treated with caution in modelling: `min_age`, `max_age`.
- Refer to the [original HDX dataset page](https://data.humdata.org/dataset/hdx-hapi-egy) for the publisher's own methodology notes and caveats.

---

## Citation

```bibtex
@dataset{hdx_africa_climate_egypt,
title = {HDX HAPI Data for Egypt},
author = {HDX Humanitarian API Data},
year = {2026},
url = {https://data.humdata.org/dataset/hdx-hapi-egy},
note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)}
}
```

---

*[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — Africa's ML dataset infrastructure. Lagos, Nigeria.*

annotations_creators:
- 无标注（no-annotation）
language_creators:
- 公开抓取（found）
language:
- 英语（en）
license:
- 其他
multilinguality:
- 单语言（monolingual）
size_categories:
- 10000 < 样本数 < 100000
source_datasets:
- 原创数据集
task_categories:
- 表格分类（tabular-classification）、其他
task_ids:
- 无
tags:
- 非洲、人道主义、HDX、Electric Sheep Africa、基线人口、气候与天气、冲突与暴力、经济、教育、粮食安全、资助、灾害与风险、埃及（EGY）
pretty_name: "埃及HDX人道主义API数据集"
dataset_info:
splits:
- name: train
num_examples: 34954
- name: test
num_examples: 8738

# 埃及HDX人道主义API数据集

**发布方：** HDX人道主义API数据团队 · **来源：** [人道主义数据交换平台（Humanitarian Data Exchange，简称HDX）](https://data.humdata.org/dataset/hdx-hapi-egy) · **许可证：** `hdx-other` · **最后更新：** 2026-02-18

---

## 摘要

本数据集源自**人道主义数据交换平台（Humanitarian Data Exchange，简称HDX）**的人道主义API（HDX HAPI，HDX Humanitarian API），该接口提供标准化的人道主义指标，支持多源数据的无缝互通。本数据集可助力自动化工作流与可视化构建，以支撑人道主义决策工作。如需了解更多信息，请访问HDX HAPI的[落地页](https://data.humdata.org/hapi)与[官方文档](https://hdx-hapi.readthedocs.io/en/latest/)。

本数据集的每一行均代表一个带地理定位的点位观测数据，时间覆盖范围由`reference_period_start`（参考周期起始）与`reference_period_end`（参考周期结束）两列标识。地理覆盖范围：**埃及（EGY）**。

*本数据集由[Electric Sheep Africa](https://huggingface.co/electricsheepafrica)整理为适配机器学习的Parquet格式。*

---

## 数据集特征

| | |
|---|---|
| **研究领域** | 粮食安全与营养 |
| **观测单元** | 带地理定位的点位观测数据 |
| **总数据行数** | 43693 |
| **列数** | 16（其中3列为数值型、7列为分类型、2列为日期时间型） |
| **训练集划分** | 34954行 |
| **测试集划分** | 8738行 |
| **地理覆盖范围** | 埃及（EGY） |
| **发布方** | HDX人道主义API数据团队 |
| **HDX平台最后更新时间** | 2026-02-18 |

---

## 变量分类

**地理类字段** — `origin_location_code`（取值为EGY、SDN、COD，即埃及、苏丹、刚果（金））、`asylum_location_code`（取值为EGY、LBN、JOR，即埃及、黎巴嫩、约旦）、`asylum_has_hrp`、`asylum_in_gho`、`population_group`（取值为ASY、REF、OOC，即寻求庇护者、难民、境外流离失所者）以及另外2个字段。

**时间类字段** — `reference_period_start`（参考周期起始）、`reference_period_end`（参考周期结束）。

**人口统计类字段** — `gender`（取值为f、m、all，即女性、男性、全部）、`age_range`（取值为all、0-4、5-11）、`min_age`（取值范围0.0–60.0）。

**标识符与元数据类字段** — `esa_source`（取值为HDX）、`esa_processed`（处理时间为2026-04-20）。

**其他字段** — `origin_has_hrp`、`origin_in_gho`。

---

## 快速上手

python
from datasets import load_dataset

# 加载本数据集
ds = load_dataset("electricsheepafrica/africa-climate-egypt")
# 将训练集转换为Pandas DataFrame格式
train = ds["train"].to_pandas()
# 将测试集转换为Pandas DataFrame格式
test = ds["test"].to_pandas()

# 打印训练集的形状
print(train.shape)
# 查看训练集前5行数据
train.head()

---

## 数据Schema

| 列名 | 数据类型 | 缺失率 | 取值范围/示例值 |
|---|---|---|---|
| `origin_location_code` | 字符型 | 0.0% | EGY、SDN、COD |
| `origin_has_hrp` | 布尔型 | 0.0% | 无 |
| `origin_in_gho` | 布尔型 | 0.0% | 无 |
| `asylum_location_code` | 字符型 | 0.0% | EGY、LBN、JOR |
| `asylum_has_hrp` | 布尔型 | 0.0% | 无 |
| `asylum_in_gho` | 布尔型 | 0.0% | 无 |
| `population_group` | 字符型 | 0.0% | ASY、REF、OOC |
| `gender` | 字符型 | 0.0% | f、m、all |
| `age_range` | 字符型 | 0.0% | all、0-4、5-11 |
| `min_age` | 浮点型 | 23.1% | 0.0 – 60.0（均值为19.0） |
| `max_age` | 浮点型 | 38.5% | 4.0 – 59.0（均值为22.75） |
| `population` | 整型 | 0.0% | 0.0 – 575006.0（均值为379.6415） |
| `reference_period_start` | 日期时间型[ns] | 0.0% | 无 |
| `reference_period_end` | 日期时间型[ns] | 0.0% | 无 |
| `esa_source` | 字符型 | 0.0% | HDX |
| `esa_processed` | 字符型 | 0.0% | 2026-04-20 |

---

## 数值型字段统计摘要

| 列名 | 最小值 | 最大值 | 均值 | 中位数 |
|---|---|---|---|---|
| `min_age` | 0.0 | 60.0 | 19.0 | 12.0 |
| `max_age` | 4.0 | 59.0 | 22.75 | 14.0 |
| `population` | 0.0 | 575006.0 | 379.6415 | 0.0 |

---

## 数据整理流程

原始数据通过CKAN API从HDX平台下载，并转换为Parquet格式。对列名进行了小写转换与蛇形命名法标准化处理。将常见的缺失值标记（`N/A`、`null`、`none`、`-`、`unknown`、`no data`、`#N/A`）统一替换为`NaN`。根据解析成功率（阈值为85%），将2列从字符型转换为数值型或日期时间型。本数据集以固定随机种子（42）按照80/20的比例划分为训练集与测试集，并保存为Snappy压缩的Parquet格式。

---

## 局限性说明

1. 本数据源自HDX人道主义API数据团队，未经Electric Sheep Africa独立验证。
2. 自动化清洗流程无法修正原始数据收集中的错报值、定义不一致或采样偏差问题。
3. 以下两列的缺失率超过20%，在建模时需谨慎使用：`min_age`、`max_age`。
4. 如需了解发布方的方法论说明与注意事项，请参阅[原始HDX数据集页面](https://data.humdata.org/dataset/hdx-hapi-egy)。

---

## 引用格式

bibtex
@dataset{hdx_africa_climate_egypt,
title = {HDX HAPI Data for Egypt},
author = {HDX Humanitarian API Data},
year = {2026},
url = {https://data.humdata.org/dataset/hdx-hapi-egy},
note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)}
}

---

*[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — 非洲机器学习数据集基础设施平台，尼日利亚拉各斯。*