electricsheepafrica/africa-ghana-languages

--- annotations_creators: - no-annotation language_creators: - found language: - en license: cc-by-sa-4.0 multilinguality: - monolingual size_categories: - n<1K source_datasets: - original task_categories: - other task_ids: [] tags: - africa - humanitarian - hdx - electric-sheep-africa - languages - gha pretty_name: "Ghana: Languages" dataset_info: splits: - name: train num_examples: 16 - name: test num_examples: 4 --- # Ghana: Languages **Publisher:** CLEAR Global (previously Translators without Borders) · **Source:** [HDX](https://data.humdata.org/dataset/ghana-languages) · **License:** `cc-by-sa` · **Updated:** 2026-04-06 --- ## Abstract Data on languages spoken in Ghana, showing the main language spoken in the household by proportion of the population. Data is drawn from AfroBarometer. For more resources on the languages of Ghana and language use in humanitarian contexts please visit: https://clearglobal.org/language-maps-and-data/ Each row in this dataset represents time-series observations. Temporal coverage is indicated by the `datetime_published`, `date_creation` column(s). Geographic scope: **GHA**. *Curated into ML-ready Parquet format by [Electric Sheep Africa](https://huggingface.co/electricsheepafrica).* --- ## Dataset Characteristics | | | |---|---| | **Domain** | Demographics and population | | **Unit of observation** | Time-series observations | | **Rows (total)** | 21 | | **Columns** | 16 (4 numeric, 10 categorical, 2 datetime) | | **Train split** | 16 rows | | **Test split** | 4 rows | | **Geographic scope** | GHA | | **Publisher** | CLEAR Global (previously Translators without Borders) | | **HDX last updated** | 2026-04-06 | --- ## Variables **Geographic** — `location_code` (GHA), `location_name` (Ghana), `location_level` (range 0.0–0.0), `reliability_score` (range 0.5952–0.5952), `representivity_rating` (moderate). **Temporal** — `datetime_published`, `date_creation`. **Demographic** — `language_code` (gonj1241, akan1250, guan1278), `language_name` (Gonja, Akan, Guang), `language_rank` (range 1.0–21.0). **Outcome / Measurement** — `proportion_value` (range 0.0005–0.5509). **Identifier / Metadata** — `dataset_name` (Ghana Round 5 data (2012)), `source` (AfroBarometer), `esa_source` (HDX), `esa_processed` (2026-04-06). **Other** — `url` (https://www.afrobarometer.org/wp-content/uploads/2022/02/gha_r5_data.sav). --- ## Quick Start ```python from datasets import load_dataset ds = load_dataset("electricsheepafrica/africa-ghana-languages") train = ds["train"].to_pandas() test = ds["test"].to_pandas() print(train.shape) train.head() ``` --- ## Schema | Column | Type | Null % | Range / Sample Values | |---|---|---|---| | `location_code` | object | 0.0% | GHA | | `location_name` | object | 0.0% | Ghana | | `location_level` | int64 | 0.0% | 0.0 – 0.0 (mean 0.0) | | `language_code` | object | 0.0% | gonj1241, akan1250, guan1278 | | `language_name` | object | 0.0% | Gonja, Akan, Guang | | `language_rank` | int64 | 0.0% | 1.0 – 21.0 (mean 11.0) | | `proportion_value` | float64 | 0.0% | 0.0005 – 0.5509 (mean 0.0476) | | `reliability_score` | float64 | 0.0% | 0.5952 – 0.5952 (mean 0.5952) | | `dataset_name` | object | 0.0% | Ghana Round 5 data (2012) | | `url` | object | 0.0% | https://www.afrobarometer.org/wp-content/uploads/2022/02/gha_r5_data.sav | | `source` | object | 0.0% | AfroBarometer | | `datetime_published` | datetime64[ns] | 0.0% | | | `date_creation` | datetime64[ns] | 0.0% | | | `representivity_rating` | object | 0.0% | moderate | | `esa_source` | object | 0.0% | HDX | | `esa_processed` | object | 0.0% | 2026-04-06 | --- ## Numeric Summary | Column | Min | Max | Mean | Median | |---|---|---|---|---| | `location_level` | 0.0 | 0.0 | 0.0 | 0.0 | | `language_rank` | 1.0 | 21.0 | 11.0 | 11.0 | | `proportion_value` | 0.0005 | 0.5509 | 0.0476 | 0.0114 | | `reliability_score` | 0.5952 | 0.5952 | 0.5952 | 0.5952 | --- ## Curation Raw data was downloaded from HDX via the CKAN API and converted to Parquet. Column names were lowercased and standardised to snake_case. Common missing-value markers (`N/A`, `null`, `none`, `-`, `unknown`, `no data`, `#N/A`) were unified to `NaN`. 2 column(s) were cast from string to numeric or datetime based on parse-success rate (>85% threshold). The dataset was split 80/20 into train and test partitions using a fixed random seed (42) and saved as Snappy-compressed Parquet. --- ## Limitations - Data originates from CLEAR Global (previously Translators without Borders) and has not been independently validated by ESA. - Automated cleaning cannot correct for misreported values, definitional inconsistencies, or sampling bias in the original collection. - Refer to the [original HDX dataset page](https://data.humdata.org/dataset/ghana-languages) for the publisher's own methodology notes and caveats. --- ## Citation ```bibtex @dataset{hdx_africa_ghana_languages, title = {Ghana: Languages}, author = {CLEAR Global (previously Translators without Borders)}, year = {2026}, url = {https://data.humdata.org/dataset/ghana-languages}, note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)} } ``` --- *[Electric Sheep Africa](https://huggingface.co/electricsheepafrica) — Africa's ML dataset infrastructure. Lagos, Nigeria.*annotations_creators: - 无注释（no-annotation） language_creators: - 采集型（found） language: - 英语（en） license: cc-by-sa-4.0 multilinguality: - 单语言（monolingual） size_categories: - 数据量小于1000（n<1K） source_datasets: - 原始数据集（original） task_categories: - 其他（other） task_ids: [] tags: - 非洲（africa） - 人道主义（humanitarian） - 人道主义数据交换（HDX） - 电动绵羊非洲（Electric Sheep Africa） - 语言（languages） - 加纳（GHA） pretty_name: "加纳：语言" dataset_info: splits: - name: train num_examples: 16 - name: test num_examples: 4 # 加纳：语言 **发布方**：CLEAR Global（前身为无国界译者Translators without Borders）· **数据源**：[人道主义数据交换（HDX）](https://data.humdata.org/dataset/ghana-languages) · **许可证**：`cc-by-sa` · **更新时间**：2026-04-06 --- ## 摘要 本数据集收录加纳境内语言使用数据，展示以人口比例统计的家庭主要使用语言。数据源自非洲晴雨表（AfroBarometer）。如需获取更多加纳语言及人道主义场景下语言使用的相关资源，请访问：https://clearglobal.org/language-maps-and-data/ 本数据集每一行均代表一条时序观测值。时间覆盖范围由`datetime_published`（发布时间）、`date_creation`（创建日期）列标注。地理覆盖范围：**加纳（GHA）**。 *本数据集已由[电动绵羊非洲（Electric Sheep Africa）](https://huggingface.co/electricsheepafrica)整理为适用于机器学习的帕奎特（Parquet）格式。* --- ## 数据集特征 | | | |---|---| | **领域** | 人口与人口统计学 | | **观测单元** | 时序观测值 | | **总行数** | 21 | | **列数** | 16（4个数值型、10个分类型、2个日期时间型） | | **训练集拆分** | 16行 | | **测试集拆分** | 4行 | | **地理覆盖范围** | 加纳（GHA） | | **发布方** | CLEAR Global（前身为无国界译者） | | **HDX最后更新时间** | 2026-04-06 | --- ## 变量说明 **地理类变量**：`location_code`（位置代码，GHA）、`location_name`（位置名称，加纳）、`location_level`（位置层级，范围0.0–0.0）、`reliability_score`（可信度评分，范围0.5952–0.5952）、`representivity_rating`（代表性评级，中等）。 **时间类变量**：`datetime_published`（发布时间）、`date_creation`（创建日期）。 **人口统计类变量**：`language_code`（语言代码，gonj1241、akan1250、guan1278）、`language_name`（语言名称，冈贾语、阿肯语、广语）、`language_rank`（语言排名，范围1.0–21.0）。 **结果/测量变量**：`proportion_value`（占比数值，范围0.0005–0.5509）。 **标识符/元数据变量**：`dataset_name`（数据集名称，加纳第五轮调查数据（2012））、`source`（数据源，非洲晴雨表（AfroBarometer））、`esa_source`（ESA数据源，HDX）、`esa_processed`（ESA处理时间，2026-04-06）。 **其他变量**：`url`（数据源链接，https://www.afrobarometer.org/wp-content/uploads/2022/02/gha_r5_data.sav）。 --- ## 快速上手 python from datasets import load_dataset ds = load_dataset("electricsheepafrica/africa-ghana-languages") train = ds["train"].to_pandas() test = ds["test"].to_pandas() print(train.shape) train.head() --- ## 数据模式 | 列名 | 数据类型 | 空值占比 | 范围/示例值 | |---|---|---|---| | `location_code` | 字符串型（object） | 0.0% | GHA | | `location_name` | 字符串型（object） | 0.0% | 加纳 | | `location_level` | 整数型（int64） | 0.0% | 0.0 – 0.0（均值0.0） | | `language_code` | 字符串型（object） | 0.0% | gonj1241、akan1250、guan1278 | | `language_name` | 字符串型（object） | 0.0% | 冈贾语、阿肯语、广语 | | `language_rank` | 整数型（int64） | 0.0% | 1.0 – 21.0（均值11.0） | | `proportion_value` | 浮点型（float64） | 0.0% | 0.0005 – 0.5509（均值0.0476） | | `reliability_score` | 浮点型（float64） | 0.0% | 0.5952 – 0.5952（均值0.5952） | | `dataset_name` | 字符串型（object） | 0.0% | 加纳第五轮调查数据（2012） | | `url` | 字符串型（object） | 0.0% | https://www.afrobarometer.org/wp-content/uploads/2022/02/gha_r5_data.sav | | `source` | 字符串型（object） | 0.0% | 非洲晴雨表（AfroBarometer） | | `datetime_published` | 日期时间型（datetime64[ns]） | 0.0% | 无 | | `date_creation` | 日期时间型（datetime64[ns]） | 0.0% | 无 | | `representivity_rating` | 字符串型（object） | 0.0% | 中等 | | `esa_source` | 字符串型（object） | 0.0% | HDX | | `esa_processed` | 字符串型（object） | 0.0% | 2026-04-06 | --- ## 数值型变量统计摘要 | 列名 | 最小值 | 最大值 | 均值 | 中位数 | |---|---|---|---|---| | `location_level` | 0.0 | 0.0 | 0.0 | 0.0 | | `language_rank` | 1.0 | 21.0 | 11.0 | 11.0 | | `proportion_value` | 0.0005 | 0.5509 | 0.0476 | 0.0114 | | `reliability_score` | 0.5952 | 0.5952 | 0.5952 | 0.5952 | --- ## 数据整理流程 原始数据通过CKAN API从人道主义数据交换（HDX）下载，并转换为帕奎特（Parquet）格式。列名统一转换为小写并标准化为蛇形命名法（snake_case）。常见缺失值标记（`N/A`、`null`、`none`、`-`、`unknown`、`no data`、`#N/A`）被统一替换为`NaN`。基于解析成功率（>85%阈值），将2列从字符串类型转换为数值型或日期时间型。本数据集以固定随机种子（42）按80/20比例划分为训练集与测试集，并保存为Snappy压缩的帕奎特（Parquet）格式。 --- ## 数据集局限性 - 数据源自CLEAR Global（前身为无国界译者），未经过电动绵羊非洲（Electric Sheep Africa）的独立验证。 - 自动化清洗无法修正原始数据收集中的错报值、定义不一致或抽样偏差问题。 - 如需查看发布方的方法论说明与免责条款，请参阅[原始HDX数据集页面](https://data.humdata.org/dataset/ghana-languages)。 --- ## 引用格式 bibtex @dataset{hdx_africa_ghana_languages, title = {Ghana: Languages}, author = {CLEAR Global (previously Translators without Borders)}, year = {2026}, url = {https://data.humdata.org/dataset/ghana-languages}, note = {Repackaged for machine learning by Electric Sheep Africa (https://huggingface.co/electricsheepafrica)} } --- *[电动绵羊非洲（Electric Sheep Africa）](https://huggingface.co/electricsheepafrica) — 非洲的机器学习数据集基础设施。尼日利亚拉各斯。*