electricsheepafrica/africa-south-sudan-2015-5w-response-data-by-cluster-and-indicator
收藏资源简介：
--- annotations_creators: - no-annotation language_creators: - found language: - en license: cc-by-4.0 multilinguality: - monolingual size_categories: - 10K<n<100K source_datasets: - original task_categories: - tabular-classification - tabular-regression task_ids: [] tags: - africa - humanitarian - hdx - electric-sheep-africa - humanitarian-needs-overview-hno - who-is-doing-what-and-where-3w-4w-5w - ssd pretty_name: "South Sudan 2015 5W response data by cluster and indicator" dataset_info: splits: - name: train num_examples: 10449 - name: test num_examples: 2612 --- # South Sudan 2015 5W response data by cluster and indicator **Publisher:** OCHA South Sudan · **Source:** [HDX](https://data.humdata.org/dataset/south-sudan-2015-5w-response-data-by-cluster-and-indicator) · **License:** `cc-by` · **Updated:** 2023-09-20 --- ## Abstract This is humanitarian response data compiled in 2015 for South Sudan. It represents cluster information which was compiled on monthly basis from the 5W submissions shared with OCHA by the clusters. Each row in this dataset represents first-level administrative unit observations. Temporal coverage is indicated by the `month` column(s). Geographic scope: **SSD**. *Curated into ML-ready Parquet format by [Electric Sheep Africa](https://huggingface.co/electricsheepafrica).* --- ## Dataset Characteristics | | | |---|---| | **Domain** | Humanitarian and development data | | **Unit of observation** | First-level administrative unit observations | | **Rows (total)** | 13,062 | | **Columns** | 10 (3 numeric, 6 categorical, 1 datetime) | | **Train split** | 10,449 rows | | **Test split** | 2,612 rows | | **Geographic scope** | SSD | | **Publisher** | OCHA South Sudan | | **HDX last updated** | 2023-09-20 | --- ## Variables **Geographic** — `state` (Jonglei, Upper Nile, Unity), `county` (Juba, Bor South, Malakal). **Temporal** — `month`. **Demographic** — `total_female` (range -11.0–361085.32), `total_male` (range 0.0–447293.0). **Outcome / Measurement** — `total_beneficiaries` (range 0.0–3461154.2). **Identifier / Metadata** — `esa_source` (HDX), `esa_processed` (2026-04-19). **Other** — `cluster` (Nutrition, CCCM, WASH), `indicators` (Number of children, adolescents who have received critical child protection services, Number of boys and girls aged 0-59 months with SAM admitted for treatment, Number of pregnant and lactating women and caretakers of children 0-23 months reached with IYCF counselling). --- ## Quick Start ```python from datasets import load_dataset ds = load_dataset("electricsheepafrica/africa-south-sudan-2015-5w-response-data-by-cluster-and-indicator") train = ds["train"].to_pandas() test = ds["test"].to_pandas() print(train.shape) train.head() ``` --- ## Schema | Column | Type | Null % | Range / Sample Values | |---|---|---|---| | `state` | object | 0.0% | Jonglei, Upper Nile, Unity | | `county` | object | 0.1% | Juba, Bor South, Malakal | | `cluster` | object | 0.0% | Nutrition, CCCM, WASH | | `indicators` | object | 0.0% | Number of children, adolescents who have received critical child protection services, Number of boys and girls aged 0-59 months with SAM admitted for treatment, Number of pregnant and lactating women and caretakers of children 0-23 months reached with IYCF counselling | | `month` | datetime64[ns] | 0.0% | | | `total_beneficiaries` | float64 | 13.3% | 0.0 – 3461154.2 (mean 14686.8997) | | `total_female` | float64 | 60.5% | -11.0 – 361085.32 (mean 5063.6677) | | `total_male` | float64 | 65.8% | 0.0 – 447293.0 (mean 4957.5488) | | `esa_source` | object | 0.0% | HDX | | `esa_processed` | object | 0.0% | 2026-04-19 | --- ## Numeric Summary | Column | Min | Max | Mean | Median | |---|---|---|---|---| | `total_beneficiaries` | 0.0 | 3461154.2 | 14686.8997 | 1492.0 | | `total_female` | -11.0 | 361085.32 | 5063.6677 | 443.0 | | `total_male` | 0.0 | 447293.0 | 4957.5488 | 515.0 | --- ## Curation Raw data was downloaded from HDX via the CKAN API and converted to Parquet. Column names were lowercased and standardised to snake_case. Common missing-value markers (`N/A`, `null`, `none`, `-`, `unknown`, `no data`, `#N/A`) were unified to `NaN`. 16 column(s) with >80% missing values were removed: `total_households`, `0_5_yrs`, `6_12_yrs`, `13_18yrs`, `19_30_yrs`, `31_59_yrs`.... 359 exact duplicate rows were removed. 2 column(s) were cast from string to numeric or datetime based on parse-success rate (>85% threshold). The dataset was split 80/20 into train and test partitions using a fixed random seed (42) and saved as Snappy-compressed Parquet. --- ## Limitations - Data originates from OCHA South Sudan and has not been independently validated by ESA. - Automated cleaning cannot correct for misreported values, definitional inconsistencies, or sampling bias in the original collection. - The following columns have >20% missing values and should be treated with caution in modelling: `total_female`, `total_male`. - Refer to the [original HDX dataset page](https://data.humdata.org/dataset/south-sudan-2015-5w-response-data-by-cluster-and-indicator) for the publisher's own methodology notes and caveats. --- ## Citation ```bibtex @dataset{hdx_africa_south_sudan_2015_5w_response_data_by_cluster_and_indicator, title = {South Sudan 2015 5W response data by cluster and indicator}, author = {OCHA South Sudan}, year = {2023}, url = {https://data.humdata.org/dataset/south-sudan-2015-5w-response-data-by-cluster-and-indicator}, note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)} } ``` --- *[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — Africa's ML dataset infrastructure. Lagos, Nigeria.*
--- annotations_creators: - 无注释 language_creators: - 采集自现有资源 language: - 英语 license: cc-by-4.0 multilinguality: - 单语言 size_categories: - 10K<n<100K source_datasets: - 原始数据集 task_categories: - 表格分类 - 表格 regression task_ids: [] tags: - 非洲 - 人道主义 - 人道主义数据交换平台（Humanitarian Data Exchange，HDX） - Electric Sheep Africa - 人道主义需求概述（HNO） - 谁在何处做什么（3W/4W/5W） - SSD pretty_name: "南苏丹2015年按集群与指标划分的5W响应数据" dataset_info: splits: - name: train num_examples: 10449 - name: test num_examples: 2612 --- # 南苏丹2015年按集群与指标划分的5W响应数据 **发布方**：南苏丹联合国人道主义事务协调厅（Office for the Coordination of Humanitarian Affairs，OCHA） · **来源**：[人道主义数据交换平台（Humanitarian Data Exchange，HDX）](https://data.humdata.org/dataset/south-sudan-2015-5w-response-data-by-cluster-and-indicator) · **许可证**：`cc-by` · **更新时间**：2023-09-20 --- ## 摘要 本数据集为2015年针对南苏丹编制的人道主义响应数据，涵盖各集群按月向OCHA提交的5W报告汇总的集群相关信息。 数据集中每一行代表一级行政单元的观测记录，时间覆盖范围由`month`列标注。地理覆盖范围：**SSD**。 *本数据集已由[Electric Sheep Africa](https://huggingface.co/electricsheepafrica)整理为适配机器学习的Parquet格式。* --- ## 数据集特征 | | | |---|---| | **领域** | 人道主义与发展数据 | | **观测单元** | 一级行政单元观测记录 | | **总数据行数** | 13062 | | **列数** | 10（3个数值型、6个分类型、1个日期时间型） | | **训练集划分** | 10449行 | | **测试集划分** | 2612行 | | **地理覆盖范围** | SSD | | **发布方** | OCHA南苏丹办事处 | | **HDX最后更新时间** | 2023-09-20 | --- ## 变量 **地理类** — `state`（琼莱州、上尼罗河州、Unity州），`county`（朱巴、博尔南部、马拉卡勒）。 **时间类** — `month`。 **人口统计类** — `total_female`（取值范围：-11.0~361085.32），`total_male`（取值范围：0.0~447293.0）。 **结果/测量类** — `total_beneficiaries`（取值范围：0.0~3461154.2）。 **标识符/元数据类** — `esa_source`（HDX），`esa_processed`（2026-04-19）。 **其他类** — `cluster`（营养、营地协调与营地管理（Camp Coordination and Camp Management，CCCM）、水、卫生与个人卫生（Water, Sanitation and Hygiene，WASH）），`indicators`（儿童及青少年接受关键儿童保护服务的数量、0-59个月重症急性营养不良（Severe Acute Malnutrition，SAM）患儿收治人数、接受婴幼儿喂养（Infant and Young Child Feeding，IYCF）咨询的孕妇、哺乳期妇女及0-23个月儿童照料者人数）。 --- ## 快速入门 python from datasets import load_dataset ds = load_dataset("electricsheepafrica/africa-south-sudan-2015-5w-response-data-by-cluster-and-indicator") train = ds["train"].to_pandas() test = ds["test"].to_pandas() print(train.shape) train.head() --- ## 数据结构 | 列名 | 数据类型 | 缺失占比 | 取值范围/示例值 | |---|---|---|---| | `state` | 字符型 | 0.0% | 琼莱州、上尼罗河州、Unity州 | | `county` | 字符型 | 0.1% | 朱巴、博尔南部、马拉卡勒 | | `cluster` | 字符型 | 0.0% | 营养、CCCM、WASH | | `indicators` | 字符型 | 0.0% | 儿童及青少年接受关键儿童保护服务的数量、0-59个月SAM患儿收治人数、接受IYCF咨询的孕妇、哺乳期妇女及0-23个月儿童照料者人数 | | `month` | datetime64[ns] | 0.0% | 无 | | `total_beneficiaries` | float64 | 13.3% | 0.0 ~ 3461154.2（均值14686.8997） | | `total_female` | float64 | 60.5% | -11.0 ~ 361085.32（均值5063.6677） | | `total_male` | float64 | 65.8% | 0.0 ~ 447293.0（均值4957.5488） | | `esa_source` | 字符型 | 0.0% | HDX | | `esa_processed` | 字符型 | 0.0% | 2026-04-19 | --- ## 数值型变量统计 | 列名 | 最小值 | 最大值 | 均值 | 中位数 | |---|---|---|---|---| | `total_beneficiaries` | 0.0 | 3461154.2 | 14686.8997 | 1492.0 | | `total_female` | -11.0 | 361085.32 | 5063.6677 | 443.0 | | `total_male` | 0.0 | 447293.0 | 4957.5488 | 515.0 | --- ## 数据整理 原始数据通过CKAN API从HDX下载并转换为Parquet格式。列名统一转为小写并标准化为蛇形命名法（snake_case）。常见缺失值标记（`N/A`、`null`、`none`、`-`、`unknown`、`no data`、`#N/A`）被统一替换为`NaN`。删除了16个缺失值占比超过80%的列：`total_households`、`0_5_yrs`、`6_12_yrs`、`13_18yrs`、`19_30_yrs`、`31_59_yrs`等。删除了359条完全重复的行。根据解析成功率（阈值>85%），将2列从字符型转换为数值型或日期时间型。数据集以固定随机种子（42）按80/20比例划分为训练集与测试集，并保存为Snappy压缩的Parquet格式。 --- ## 局限性 - 本数据源自南苏丹OCHA，未由Electric Sheep Africa（ESA）进行独立验证。 - 自动化清洗无法修正原始数据收集中的错报值、定义不一致或抽样偏差问题。 - 以下列的缺失值占比超过20%，在建模时需谨慎使用：`total_female`、`total_male`。 - 请参阅[HDX原始数据集页面](https://data.humdata.org/dataset/south-sudan-2015-5w-response-data-by-cluster-and-indicator)查看发布方提供的方法说明与注意事项。 --- ## 引用 bibtex @dataset{hdx_africa_south_sudan_2015_5w_response_data_by_cluster_and_indicator, title = {South Sudan 2015 5W response data by cluster and indicator}, author = {OCHA South Sudan}, year = {2023}, url = {https://data.humdata.org/dataset/south-sudan-2015-5w-response-data-by-cluster-and-indicator}, note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)} } --- *[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — 非洲机器学习数据集基础设施。尼日利亚拉各斯。*
