Mollel/SwahiliNewsClassification

斯瓦希里新闻分类数据集是一个用于文本分类任务的数据集，特别是新闻分类。数据集包含斯瓦希里语的新闻内容，分为六个不同的主题。数据集的创建旨在填补斯瓦希里语在NLP技术应用中的空白，并支持坦桑尼亚和非洲其他地区的AI从业者。数据集通过人工注释过程确保了高准确性，并被纳入MTEB以评估嵌入模型对斯瓦希里新闻分类的能力。数据集的结构包括内容、类别和字符长度等特征。

The Swahili News Classification Dataset is a dataset designed for text classification tasks, particularly news categorization. It contains news content in Swahili, categorized into six distinct topics. The dataset was created to bridge the gap in utilizing the Swahili language for NLP technologies and to empower AI practitioners in Tanzania and across Africa. The high accuracy of the dataset is attributed to the human annotation process involved in its creation, and it is included in the MTEB to evaluate the capability of embedders to classify Swahili news accurately. The dataset structure includes features such as content, category, and character length.

原始信息汇总

Swahili News Classification Dataset

数据集概述

基本信息

• 名称: Swahili News Classification Dataset
• 版本: 1.0.0
• 语言: 斯瓦希里语 (Swahili)
• 许可证: CC BY 4.0
• 任务类别: 文本分类
• 标签: 新闻, 斯瓦希里语, 东非, NLP, 文本分类

数据集结构

• 特征:
  • content: 文本内容 (string)
  • category: 类别 (string)
  • char_length: 字符长度 (int32)
• 行数: 24275
• 分割:
  • train: 24275 行
  • test: 0 行

数据实例

json { "content": "SERIKALI imesema haitakuwa tayari kuona amani na utulivu wa nchi inachezewa huku ikisisitiza uwepo wa umoja kati ya wananchi bila kujali tofauti ya imani, kabila au itikadi yoyote.Hayo yalisemwa na Naibu Waziri wa Mambo ya Ndani ya Nchi, Hamad Yussuf Masauni wakati akifungua semina ya siku mbili iliyofanyika jijini Dar es Salaam ikiwahusisha viongozi wa taasisi za Kiislamu, lengo ikiwa ni kuwakumbusha kuhubiri amani katika sehemu zao.Naibu Waziri amesema mwelekeo na malengo ya Serikali ya Awamu ya Tano ni kukuza maendeleo katika sehemu mbalimbali nchini lengo ikiwa kuinua maisha ya wananchi na nchi kwa ujumla.“Serikali hii imejidhatiti kuhakikisha maendeleo yanakuja kwa kasi na maendeleo hayawezi kuja ikiwa amani na utulivu haupo, sisi kama serikali tutahakikisha tunalinda amani iliyopo ili wananchi wapate kufanya shughuli za kiuchumi bila wasiwasi wowote,” amesema Masauni.Akizungumza wakati wa ufunguzi huo, Shehe wa Mkoa wa Dar es Salaam, Alhaji Alhad Mussa Salum aliihakikishia serikali kutokuwepo kwa mifarakano kati ya taasisi mbalimbali kama ilivyokuwepo awali huku akisisitiza kuendelea kwa umoja huo ili jamii ipate kuendelea.“Sisi kama Bakwata tunaihakikishia serikali uwepo wa umoja na ushirikiano baina ya baraza na taasisi zingine na tofauti zetu hazipelekei kukoseana au kuvunjiana heshima kwahiyo tunaomba serikali iamini uwepo wa maelewano mazuri tu kwa maendeleo ya nchi hii,” amesema Shehe Alhad.Semina hiyo ya siku mbili imejumuisha viongozi wa taasisi 100 huku mada ya Nafasi ya Taasisi za Kiislamu katika Kuleta Umoja na Kuishi kwa Amani itajadiliwa.", "category": "kitaifa" }

引用

@inproceedings{davis2020swahili, title = "Swahili: News Classification Dataset (0.2)", author = "Davis, David", year = "2020", publisher = "Zenodo", doi = "10.5281/zenodo.5514203", url = "https://doi.org/10.5281/zenodo.5514203" }