electricsheepafrica/africa-unhcr-population-data-for-eth

--- annotations_creators: - no-annotation language_creators: - found language: - en license: cc-by-4.0 multilinguality: - monolingual size_categories: - 1K<n<10K source_datasets: - original task_categories: - tabular-classification - tabular-regression task_ids: [] tags: - africa - humanitarian - hdx - electric-sheep-africa - asylum-seekers - internally-displaced-persons-idp - population - refugees - stateless-persons - eth pretty_name: "Ethiopia - Data on forcibly displaced populations and stateless persons" dataset_info: splits: - name: train num_examples: 2018 - name: test num_examples: 504 --- # Ethiopia - Data on forcibly displaced populations and stateless persons **Publisher:** UNHCR - The UN Refugee Agency · **Source:** [HDX](https://data.humdata.org/dataset/unhcr-population-data-for-eth) · **License:** `cc-by-igo` · **Updated:** 2026-02-25 --- ## Abstract Data collated by UNHCR, containing information about forcibly displaced populations and stateless persons, spanning across more than 70 years of statistical activities. The data includes the countries / territories of asylum and origin. Specific resources are available for end-year population totals, demographics, asylum applications, decisions, and solutions availed by refugees and IDPs (resettlement, naturalisation or returns). Each row in this dataset represents first-level administrative unit observations. Data was last updated on HDX on 2026-02-25. Geographic scope: **ETH**. *Curated into ML-ready Parquet format by [Electric Sheep Africa](https://huggingface.co/electricsheepafrica).* --- ## Dataset Characteristics | | | |---|---| | **Domain** | Demographics and population | | **Unit of observation** | First-level administrative unit observations | | **Rows (total)** | 2,523 | | **Columns** | 14 (8 numeric, 6 categorical, 0 datetime) | | **Train split** | 2,018 rows | | **Test split** | 504 rows | | **Geographic scope** | ETH | | **Publisher** | UNHCR - The UN Refugee Agency | | **HDX last updated** | 2026-02-25 | --- ## Variables **Geographic** — `year` (range 1967.0–2025.0), `country_of_origin_code` (ETH), `country_of_asylum_code` (SDN, KEN, DJI), `country_of_origin_name` (Ethiopia), `country_of_asylum_name` (Sudan, Kenya, Djibouti) and 4 others. **Identifier / Metadata** — `refugees` (range 0.0–2000000.0), `esa_source` (HDX), `esa_processed` (2026-04-04). **Other** — `other_people_in_need_of_international_protection` (range 0.0–0.0), `others_of_concern_to_unhcr` (range 0.0–3634.0). --- ## Quick Start ```python from datasets import load_dataset ds = load_dataset("electricsheepafrica/africa-unhcr-population-data-for-eth") train = ds["train"].to_pandas() test = ds["test"].to_pandas() print(train.shape) train.head() ``` --- ## Schema | Column | Type | Null % | Range / Sample Values | |---|---|---|---| | `year` | int64 | 0.0% | 1967.0 – 2025.0 (mean 2008.8835) | | `country_of_origin_code` | object | 0.0% | ETH | | `country_of_asylum_code` | object | 0.0% | SDN, KEN, DJI | | `country_of_origin_name` | object | 0.0% | Ethiopia | | `country_of_asylum_name` | object | 0.0% | Sudan, Kenya, Djibouti | | `refugees` | int64 | 0.0% | 0.0 – 2000000.0 (mean 9845.0682) | | `asylum_seekers` | int64 | 0.0% | 0.0 – 51288.0 (mean 732.4836) | | `other_people_in_need_of_international_protection` | int64 | 0.0% | 0.0 – 0.0 (mean 0.0) | | `internally_displaced_persons` | int64 | 0.0% | 0.0 – 3646267.0 (mean 8406.7047) | | `stateless_persons` | int64 | 0.0% | 0.0 – 0.0 (mean 0.0) | | `others_of_concern_to_unhcr` | int64 | 0.0% | 0.0 – 3634.0 (mean 19.9651) | | `host_community` | int64 | 0.0% | 0.0 – 1876986.0 (mean 2199.8708) | | `esa_source` | object | 0.0% | HDX | | `esa_processed` | object | 0.0% | 2026-04-04 | --- ## Numeric Summary | Column | Min | Max | Mean | Median | |---|---|---|---|---| | `year` | 1967.0 | 2025.0 | 2008.8835 | 2010.0 | | `refugees` | 0.0 | 2000000.0 | 9845.0682 | 33.0 | | `asylum_seekers` | 0.0 | 51288.0 | 732.4836 | 5.0 | | `other_people_in_need_of_international_protection` | 0.0 | 0.0 | 0.0 | 0.0 | | `internally_displaced_persons` | 0.0 | 3646267.0 | 8406.7047 | 0.0 | | `stateless_persons` | 0.0 | 0.0 | 0.0 | 0.0 | | `others_of_concern_to_unhcr` | 0.0 | 3634.0 | 19.9651 | 0.0 | | `host_community` | 0.0 | 1876986.0 | 2199.8708 | 0.0 | --- ## Curation Raw data was downloaded from HDX via the CKAN API and converted to Parquet. Column names were lowercased and standardised to snake_case. Common missing-value markers (`N/A`, `null`, `none`, `-`, `unknown`, `no data`, `#N/A`) were unified to `NaN`. The dataset was split 80/20 into train and test partitions using a fixed random seed (42) and saved as Snappy-compressed Parquet. --- ## Limitations - Data originates from UNHCR - The UN Refugee Agency and has not been independently validated by ESA. - Automated cleaning cannot correct for misreported values, definitional inconsistencies, or sampling bias in the original collection. - Refer to the [original HDX dataset page](https://data.humdata.org/dataset/unhcr-population-data-for-eth) for the publisher's own methodology notes and caveats. --- ## Citation ```bibtex @dataset{hdx_africa_unhcr_population_data_for_eth, title = {Ethiopia - Data on forcibly displaced populations and stateless persons}, author = {UNHCR - The UN Refugee Agency}, year = {2026}, url = {https://data.humdata.org/dataset/unhcr-population-data-for-eth}, note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)} } ``` --- *[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — Africa's ML dataset infrastructure. Lagos, Nigeria.*annotations_creators: - 无注释 language_creators: - 采集自现有资源 language: - 英语 license: - CC-BY-4.0 multilinguality: - 单语言 size_categories: - 1K<n<10K source_datasets: - 原创 task_categories: - 表格分类 - 表格回归 task_ids: [] tags: - 非洲 - 人道主义 - HDX - Electric Sheep Africa - 寻求庇护者 - 境内流离失所者（IDP） - 人口 - 难民 - 无国籍人士 - ETH pretty_name: "埃塞俄比亚——被迫流离失所人口与无国籍人士数据" dataset_info: splits: - name: train num_examples: 2018 - name: test num_examples: 504 # 埃塞俄比亚——被迫流离失所人口与无国籍人士数据 **发布方：** 联合国难民署（UNHCR） · **来源：** [HDX（人道主义数据交换平台）](https://data.humdata.org/dataset/unhcr-population-data-for-eth) · **许可协议：** `cc-by-igo` · **最后更新：** 2026-02-25 --- ## 摘要 本数据集由联合国难民署（UNHCR）整理，涵盖超过70年的统计活动数据，内容涉及被迫流离失所人口与无国籍人士的相关信息。数据包含庇护国与原籍国/地区信息，可获取的具体内容包括年末人口总数、人口结构、庇护申请、审批结果以及为难民和境内流离失所者（IDP）提供的解决方案（重新安置、入籍或返国）。 数据集的每一行代表一级行政单元的观测数据。本数据集最后一次在HDX平台更新时间为2026年2月25日。地理范围：**ETH（埃塞俄比亚）**。 *本数据集由[Electric Sheep Africa](https://huggingface.co/electricsheepafrica)整理为机器学习可用的Parquet格式。* --- ## 数据集特征 | | | |---|---| | **领域** | 人口与人口统计学 | | **观测单元** | 一级行政单元观测数据 | | **总样本数** | 2523条 | | **列数** | 14列（8个数值型、6个分类型、0个日期型） | | **训练集样本数** | 2018条 | | **测试集样本数** | 504条 | | **地理范围** | ETH（埃塞俄比亚） | | **发布方** | 联合国难民署（UNHCR） | | **HDX平台最后更新时间** | 2026年2月25日 | --- ## 变量 **地理类变量** —— `year`（年份，取值范围1967.0至2025.0）、`country_of_origin_code`（原籍国代码，取值为ETH）、`country_of_asylum_code`（庇护国代码，取值为SDN、KEN、DJI）、`country_of_origin_name`（原籍国名称，为埃塞俄比亚）、`country_of_asylum_name`（庇护国名称，包括苏丹、肯尼亚、吉布提）及另外4个变量。 **标识符与元数据类变量** —— `refugees`（难民数量，取值范围0.0至2000000.0）、`esa_source`（数据来源，为HDX）、`esa_processed`（数据处理日期，为2026-04-04）。 **其他类变量** —— `other_people_in_need_of_international_protection`（其他需要国际保护的人群，取值范围0.0至0.0）、`others_of_concern_to_unhcr`（联合国难民署关注的其他人群，取值范围0.0至3634.0）。 --- ## 快速上手 python from datasets import load_dataset ds = load_dataset("electricsheepafrica/africa-unhcr-population-data-for-eth") train = ds["train"].to_pandas() test = ds["test"].to_pandas() print(train.shape) train.head() --- ## 数据模式 | 列名 | 数据类型 | 空值占比 | 取值范围/示例值 | |---|---|---|---| | `year` | int64 | 0.0% | 1967.0 – 2025.0（均值为2008.8835） | | `country_of_origin_code` | object | 0.0% | ETH | | `country_of_asylum_code` | object | 0.0% | SDN、KEN、DJI | | `country_of_origin_name` | object | 0.0% | 埃塞俄比亚 | | `country_of_asylum_name` | object | 0.0% | 苏丹、肯尼亚、吉布提 | | `refugees` | int64 | 0.0% | 0.0 – 2000000.0（均值为9845.0682） | | `asylum_seekers` | int64 | 0.0% | 0.0 – 51288.0（均值为732.4836） | | `other_people_in_need_of_international_protection` | int64 | 0.0% | 0.0 – 0.0（均值为0.0） | | `internally_displaced_persons` | int64 | 0.0% | 0.0 – 3646267.0（均值为8406.7047） | | `stateless_persons` | int64 | 0.0% | 0.0 – 0.0（均值为0.0） | | `others_of_concern_to_unhcr` | int64 | 0.0% | 0.0 – 3634.0（均值为19.9651） | | `host_community` | int64 | 0.0% | 0.0 – 1876986.0（均值为2199.8708） | | `esa_source` | object | 0.0% | HDX | | `esa_processed` | object | 0.0% | 2026-04-04 | --- ## 数值型变量统计摘要 | 列名 | 最小值 | 最大值 | 均值 | 中位数 | |---|---|---|---|---| | `year` | 1967.0 | 2025.0 | 2008.8835 | 2010.0 | | `refugees` | 0.0 | 2000000.0 | 9845.0682 | 33.0 | | `asylum_seekers` | 0.0 | 51288.0 | 732.4836 | 5.0 | | `other_people_in_need_of_international_protection` | 0.0 | 0.0 | 0.0 | 0.0 | | `internally_displaced_persons` | 0.0 | 3646267.0 | 8406.7047 | 0.0 | | `stateless_persons` | 0.0 | 0.0 | 0.0 | 0.0 | | `others_of_concern_to_unhcr` | 0.0 | 3634.0 | 19.9651 | 0.0 | | `host_community` | 0.0 | 1876986.0 | 2199.8708 | 0.0 | --- ## 数据整理流程 原始数据通过CKAN API从HDX平台下载，并转换为Parquet格式。列名统一转换为小写并标准化为蛇形命名法。将常见的缺失值标记（`N/A`、`null`、`none`、`-`、`unknown`、`no data`、`#N/A`）统一替换为`NaN`。采用固定随机种子（42）将数据集按80/20比例划分为训练集与测试集，并保存为Snappy压缩的Parquet格式文件。 --- ## 局限性 - 本数据集源自联合国难民署（UNHCR），未经过Electric Sheep Africa的独立验证。 - 自动化清洗流程无法修正原始数据收集中的错报值、定义不一致或采样偏差问题。 - 请参阅[原始HDX数据集页面](https://data.humdata.org/dataset/unhcr-population-data-for-eth)获取发布方提供的方法说明与注意事项。 --- ## 引用格式 bibtex @dataset{hdx_africa_unhcr_population_data_for_eth, title = {埃塞俄比亚——被迫流离失所人口与无国籍人士数据}, author = {联合国难民署（UNHCR）}, year = {2026}, url = {https://data.humdata.org/dataset/unhcr-population-data-for-eth}, note = {由Electric Sheep Africa（https://huggingface.co/electricsheepafrica）重新打包为机器学习可用格式} } --- *[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — 非洲的机器学习数据集基础设施。尼日利亚拉各斯。*