SEACrowd/brcc

Bahasa Rojak Crawled Corpus (BRCC) 是一个用于马来西亚Bahasa Rojak方言的代码混合数据集。该数据集通过使用改进的CoSDA-ML方法从英语和马来语维基百科页面生成段落，并由两位母语为马来语的评估者评估生成段落的质量。数据集支持自监督预训练任务，并提供了使用`datasets`和`seacrowd`库加载数据集的示例代码。数据集的语言包括zlm、eng和cmn。

The Bahasa Rojak Crawled Corpus (BRCC) is a code-mixed dataset for the Bahasa Rojak dialect in Malaysia. Passages are generated through data augmentation from English and Malay Wikipedia pages using a modified CoSDA-ML method. The quality of generated passages is evaluated by two native Malay speakers. The dataset supports self-supervised pretraining tasks and provides example code for loading the dataset using the `datasets` and `seacrowd` libraries. The languages included in the dataset are zlm, eng, and cmn.

原始信息汇总

Bahasa Rojak Crawled Corpus (BRCC)

概述

• 名称: Bahasa Rojak Crawled Corpus (BRCC)
• 描述: 这是一个用于马来西亚Bahasa Rojak方言的代码混合数据集。数据通过修改的CoSDA-ML方法从英语和马来语维基百科页面进行数据增强生成。生成的段落由两名母语为马来语的人士进行质量评估。

语言

• zlm
• eng
• cmn

支持的任务

• 自监督预训练

数据集版本

• 源版本: 1.0.0
• SEACrowd版本: 2024.06.20

数据集许可证

• 未知

引用

• 如果使用Brcc数据加载器，请引用以下内容：

@inproceedings{romadhona-etal-2022-brcc, author = {Romadhona, Nanda Putri and Lu, Sin-En and Lu, Bo-Han and Tsai, Richard Tzong-Han}, title = {BRCC and SentiBahasaRojak: The First Bahasa Rojak Corpus for Pretraining and Sentiment Analysis Dataset}, booktitle = {Proceedings of the 29th International Conference on Computational Linguistics}, publisher = {International Committee on Computational Linguistics}, year = {2022}, url = {https://aclanthology.org/2022.coling-1.389/}, pages = {4418--4428}, }

@article{lovenia2024seacrowd, title={SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages}, author={Holy Lovenia and Rahmad Mahendra and Salsabil Maulana Akbar and Lester James V. Miranda and Jennifer Santoso and Elyanah Aco and Akhdan Fadhilah and Jonibek Mansurov and Joseph Marvin Imperial and Onno P. Kampman and Joel Ruben Antony Moniz and Muhammad Ravi Shulthan Habibi and Frederikus Hudi and Railey Montalan and Ryan Ignatius and Joanito Agili Lopo and William Nixon and Börje F. Karlsson and James Jaya and Ryandito Diandaru and Yuze Gao and Patrick Amadeus and Bin Wang and Jan Christian Blaise Cruz and Chenxi Whitehouse and Ivan Halim Parmonangan and Maria Khelli and Wenyu Zhang and Lucky Susanto and Reynard Adha Ryanda and Sonny Lazuardi Hermawan and Dan John Velasco and Muhammad Dehan Al Kautsar and Willy Fitra Hendria and Yasmin Moslem and Noah Flynn and Muhammad Farid Adilazuarda and Haochen Li and Johanes Lee and R. Damanhuri and Shuo Sun and Muhammad Reza Qorib and Amirbek Djanibekov and Wei Qi Leong and Quyet V. Do and Niklas Muennighoff and Tanrada Pansuwan and Ilham Firdausi Putra and Yan Xu and Ngee Chia Tai and Ayu Purwarianti and Sebastian Ruder and William Tjhi and Peerat Limkonchotiwat and Alham Fikri Aji and Sedrick Keh and Genta Indra Winata and Ruochen Zhang and Fajri Koto and Zheng-Xin Yong and Samuel Cahyawijaya}, year={2024}, eprint={2406.10118}, journal={arXiv preprint arXiv: 2406.10118} }