遇见数据集

Bangla–Chittagonian Parallel Dataset

收藏
Zenodo2026-02-22 更新2026-05-26 收录
官方服务:

资源简介:

Overview This repository contains a manually constructed bilingual dataset comprising Bangla and Chittagonian language pairs. The dataset was developed to support research in low-resource machine translation, dialect modeling, and linguistic analysis of underrepresented South Asian languages. Chittagonian is primarily an oral language and lacks a standardized written form; therefore, a consistent written representation was proposed and applied throughout the dataset. All data files are provided in UTF-8 encoded CSV format. Dataset Structure The dataset consists of three main CSV files: 1. Word Pair Dataset File: chittagonian_bangla_words.csv Shape: (15270, 3) This file contains bilingual word-level alignments between Bangla and Chittagonian. Columns: `Bangla_word` — Word in standard Bangla orthography `Chittagonian_word` — Corresponding word in the proposed written representation of Chittagonian `POS_tag` — Part-of-speech label (e.g., noun, verb, adjective) `English Translation` — This column contains the English translation of each word 2. Sentence Pair Dataset File: chittagonian_bangla_sentences.csv Shape: (3793, 2) This file contains parallel sentence pairs intended for machine translation and corpus-based studies. Columns: Bangla_sentence — Sentence in Bangla Chittagonian_sentence — Corresponding sentence in Chittagonian `English Translation` — This column contains the English translation of each sentance 3. Isodomic / Idiomatic Pair Dataset File: chittagonian_bangla_isodomic.csv` Shape: (2098, 3) This file contains Chittagonian lexical items or idiomatic expressions that correspond to complete Bangla sentences. Columns: Chittagonian_expression — Word or expression in Chittagonian Bangla_sentence — Equivalent Bangla sentence `English Translation` — This column contains the Englaish translation of each isodomic expresson Data Collection and Preparation All Bangla source words and sentences were collected from publicly available online resources and printed materials. Some Chittagonian words are taken from a dictionary named 'চট্টগ্রামের আঞ্চলিক ভাষার অভিধান' (ISBN: 9789849107521). Translations into Chittagonian were performed manually by native speakers fluent in both languages. No automated translation tools were used. Basic normalization steps were applied, including punctuation cleanup and duplicate removal. The English translation is generated by using `Google Translate` API. Encoding All files are saved in UTF-8 encoding to ensure correct representation of Bangla and Chittagonian characters across platforms. License This dataset is released under the **Creative Commons Attribution 4.0 International (CC BY 4.0)** license. Users are free to share and adapt the data, provided appropriate credit is given. Suggested Citation If you use this dataset in your research, please cite the associated data article and the Zenodo DOI provided for this repository. Contact For questions or issues related to the dataset, please contact the corresponding author via the information provided in the associated publication.

提供机构:
Zenodo
创建时间:
2026-01-28
二维码
社区交流群
二维码
科研交流群
商业服务