andreniyongabo/kinnews_kirnews
收藏Hugging Face2024-01-18 更新2024-05-25 收录
下载链接：
https://hf-mirror.com/datasets/andreniyongabo/kinnews_kirnews
下载链接
链接失效反馈官方服务：
资源简介：
---
annotations_creators:
- expert-generated
language_creators:
- found
language:
- rn
- rw
license:
- mit
multilinguality:
- monolingual
size_categories:
- 10K<n<100K
- 1K<n<10K
source_datasets:
- original
task_categories:
- text-classification
task_ids:
- multi-class-classification
- topic-classification
paperswithcode_id: kinnews-and-kirnews
pretty_name: KinnewsKirnews
dataset_info:
- config_name: kinnews_raw
features:
- name: label
dtype:
class_label:
names:
'0': politics
'1': sport
'2': economy
'3': health
'4': entertainment
'5': history
'6': technology
'7': tourism
'8': culture
'9': fashion
'10': religion
'11': environment
'12': education
'13': relationship
- name: kin_label
dtype: string
- name: en_label
dtype: string
- name: url
dtype: string
- name: title
dtype: string
- name: content
dtype: string
splits:
- name: train
num_bytes: 38316546
num_examples: 17014
- name: test
num_bytes: 11971938
num_examples: 4254
download_size: 27377755
dataset_size: 50288484
- config_name: kinnews_cleaned
features:
- name: label
dtype:
class_label:
names:
'0': politics
'1': sport
'2': economy
'3': health
'4': entertainment
'5': history
'6': technology
'7': tourism
'8': culture
'9': fashion
'10': religion
'11': environment
'12': education
'13': relationship
- name: title
dtype: string
- name: content
dtype: string
splits:
- name: train
num_bytes: 32780382
num_examples: 17014
- name: test
num_bytes: 8217453
num_examples: 4254
download_size: 27377755
dataset_size: 40997835
- config_name: kirnews_raw
features:
- name: label
dtype:
class_label:
names:
'0': politics
'1': sport
'2': economy
'3': health
'4': entertainment
'5': history
'6': technology
'7': tourism
'8': culture
'9': fashion
'10': religion
'11': environment
'12': education
'13': relationship
- name: kir_label
dtype: string
- name: en_label
dtype: string
- name: url
dtype: string
- name: title
dtype: string
- name: content
dtype: string
splits:
- name: train
num_bytes: 7343223
num_examples: 3689
- name: test
num_bytes: 2499189
num_examples: 923
download_size: 5186111
dataset_size: 9842412
- config_name: kirnews_cleaned
features:
- name: label
dtype:
class_label:
names:
'0': politics
'1': sport
'2': economy
'3': health
'4': entertainment
'5': history
'6': technology
'7': tourism
'8': culture
'9': fashion
'10': religion
'11': environment
'12': education
'13': relationship
- name: title
dtype: string
- name: content
dtype: string
splits:
- name: train
num_bytes: 6629767
num_examples: 3689
- name: test
num_bytes: 1570745
num_examples: 923
download_size: 5186111
dataset_size: 8200512
config_names:
- kinnews_cleaned
- kinnews_raw
- kirnews_cleaned
- kirnews_raw
---
# Dataset Card for kinnews_kirnews
## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)
## Dataset Description
- **Homepage:** [More Information Needed]
- **Repository:** https://github.com/Andrews2017/KINNEWS-and-KIRNEWS-Corpus
- **Paper:** [KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi](https://arxiv.org/abs/2010.12174)
- **Leaderboard:** NA
- **Point of Contact:** [Rubungo Andre Niyongabo1](mailto:niyongabor.andre@std.uestc.edu.cn)
### Dataset Summary
Kinyarwanda and Kirundi news classification datasets (KINNEWS and KIRNEWS,respectively), which were both collected from Rwanda and Burundi news websites and newspapers, for low-resource monolingual and cross-lingual multiclass classification tasks.
### Supported Tasks and Leaderboards
This dataset can be used for text classification of news articles in Kinyarwadi and Kirundi languages. Each news article can be classified into one of the 14 possible classes. The classes are:
- politics
- sport
- economy
- health
- entertainment
- history
- technology
- culture
- religion
- environment
- education
- relationship
### Languages
Kinyarwanda and Kirundi
## Dataset Structure
### Data Instances
Here is an example from the dataset:
| Field | Value |
| ----- | ----------- |
| label | 1 |
| kin_label/kir_label | 'inkino' |
| url | 'https://nawe.bi/Primus-Ligue-Imirwi-igiye-guhura-gute-ku-ndwi-ya-6-y-ihiganwa.html' |
| title | 'Primus Ligue\xa0: Imirwi igiye guhura gute ku ndwi ya 6 y’ihiganwa\xa0?'|
| content | ' Inkino zitegekanijwe kuruno wa gatandatu igenekerezo rya 14 Nyakanga umwaka wa 2019...'|
| en_label| 'sport'|
### Data Fields
The raw version of the data for Kinyarwanda language consists of these fields
- label: The category of the news article
- kin_label/kir_label: The associated label in Kinyarwanda/Kirundi language
- en_label: The associated label in English
- url: The URL of the news article
- title: The title of the news article
- content: The content of the news article
The cleaned version contains only the `label`, `title` and the `content` fields
### Data Splits
Lang| Train | Test |
|---| ----- | ---- |
|Kinyarwandai Raw|17014|4254|
|Kinyarwandai Clean|17014|4254|
|Kirundi Raw|3689|923|
|Kirundi Clean|3689|923|
## Dataset Creation
### Curation Rationale
[More Information Needed]
### Source Data
#### Initial Data Collection and Normalization
[More Information Needed]
#### Who are the source language producers?
[More Information Needed]
### Annotations
#### Annotation process
[More Information Needed]
#### Who are the annotators?
[More Information Needed]
### Personal and Sensitive Information
[More Information Needed]
## Considerations for Using the Data
### Social Impact of Dataset
[More Information Needed]
### Discussion of Biases
[More Information Needed]
### Other Known Limitations
[More Information Needed]
## Additional Information
### Dataset Curators
[More Information Needed]
### Licensing Information
[More Information Needed]
### Citation Information
```
@article{niyongabo2020kinnews,
title={KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi},
author={Niyongabo, Rubungo Andre and Qu, Hong and Kreutzer, Julia and Huang, Li},
journal={arXiv preprint arXiv:2010.12174},
year={2020}
}
```
### Contributions
Thanks to [@saradhix](https://github.com/saradhix) for adding this dataset.
提供机构：
andreniyongabo
原始信息汇总
数据集概述
数据集名称
- 名称: KinnewsKirnews
- 别名: KINNEWS and KIRNEWS
语言信息
- 语言:
- Kinyarwanda (rn)
- Kirundi (rw)
- 多语言性: 单语
许可证
- 许可证: MIT
数据集大小
- 大小分类:
- Kinyarwanda: 10K<n<100K
- Kirundi: 1K<n<10K
数据集特征
- 特征:
- label: 新闻文章的类别，包括14个可能的类别（政治、体育、经济、健康、娱乐、历史、技术、文化、宗教、环境、教育、关系）
- kin_label/kir_label: 新闻文章的类别标签，使用Kinyarwanda/Kirundi语言
- en_label: 新闻文章的类别标签，使用英语
- url: 新闻文章的URL
- title: 新闻文章的标题
- content: 新闻文章的内容
数据集结构
- 数据分割:
- Kinyarwanda Raw: 训练集17014条，测试集4254条
- Kinyarwanda Cleaned: 训练集17014条，测试集4254条
- Kirundi Raw: 训练集3689条，测试集923条
- Kirundi Cleaned: 训练集3689条，测试集923条
任务类型
- 任务类别: 文本分类
- 任务ID:
- 多类分类
- 主题分类
数据集配置
- 配置名称:
- kinnews_raw
- kinnews_cleaned
- kirnews_raw
- kirnews_cleaned
数据集创建
- 注释创建者: 专家生成
- 语言创建者: 发现
数据集下载和大小
- 下载大小:
- Kinyarwanda: 27377755字节
- Kirundi: 5186111字节
- 数据集大小:
- Kinyarwanda: 50288484字节
- Kirundi: 9842412字节
引用信息
@article{niyongabo2020kinnews, title={KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi}, author={Niyongabo, Rubungo Andre and Qu, Hong and Kreutzer, Julia and Huang, Li}, journal={arXiv preprint arXiv:2010.12174}, year={2020} }
