five

LIACC/Emakhuwa-News-Topic-Classification

收藏
Hugging Face2024-11-11 更新2025-04-12 收录
下载链接:
https://hf-mirror.com/datasets/LIACC/Emakhuwa-News-Topic-Classification
下载链接
链接失效反馈
官方服务:
资源简介:
--- license: cc-by-4.0 task_categories: - translation - text-classification language: - vmw - pt --- **BibTeX:** The dataset paper was published in EMNLP 2024. Please cite as: ``` @inproceedings{ali-etal-2024-building, title = "Building Resources for Emakhuwa: Machine Translation and News Classification Benchmarks", author = "Ali, Felermino D. M. A. and Lopes Cardoso, Henrique and Sousa-Silva, Rui", editor = "Al-Onaizan, Yaser and Bansal, Mohit and Chen, Yun-Nung", booktitle = "Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing", month = nov, year = "2024", address = "Miami, Florida, USA", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/2024.emnlp-main.824", pages = "14842--14857", abstract = "This paper introduces a comprehensive collection of NLP resources for Emakhuwa, Mozambique{'}s most widely spoken language. The resources include the first manually translated news bitext corpus between Portuguese and Emakhuwa, news topic classification datasets, and monolingual data. We detail the process and challenges of acquiring this data and present benchmark results for machine translation and news topic classification tasks. Our evaluation examines the impact of different data types{---}originally clean text, post-corrected OCR, and back-translated data{---}and the effects of fine-tuning from pre-trained models, including those focused on African languages.Our benchmarks demonstrate good performance in news topic classification and promising results in machine translation. We fine-tuned multilingual encoder-decoder models using real and synthetic data and evaluated them on our test set and the FLORES evaluation sets. The results highlight the importance of incorporating more data and potential for future improvements.All models, code, and datasets are available in the \url{https://huggingface.co/LIACC} repository under the CC BY 4.0 license.", } ```
提供机构:
LIACC
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作