strombergnlp/bornholmsk_parallel

---
annotations_creators:
- expert-generated
language_creators:
- found
language:
- da
- da-bornholm
license:
- cc-by-4.0
multilinguality:
- translation
pretty_name: Bornholmsk/Danish Parallel Texts
size_categories:
- 1K<n<10K
source_datasets:
- original
task_categories:
- translation
task_ids: []
paperswithcode_id: bornholmsk-parallel
---

## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-instances)
- [Data Splits](#data-instances)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)

## Dataset Description

- **Homepage:** [https://github.com/StrombergNLP/bornholmsk](https://github.com/StrombergNLP/bornholmsk)
- **Repository:** [https://github.com/StrombergNLP/bornholmsk](https://github.com/StrombergNLP/bornholmsk)
- **Paper:** [https://aclanthology.org/W19-6138/](https://aclanthology.org/W19-6138/)
- **Point of Contact:** [Leon Derczynski](https://github.com/leondz)
- **Size of downloaded dataset files:** 490 KB
- **Size of the generated dataset:** 582 KB
- **Total amount of disk used:** 1072 KB

### Dataset Summary

This dataset is parallel text for Bornholmsk and Danish.

For more details, see the paper [Bornholmsk Natural Language Processing: Resources and Tools](https://aclanthology.org/W19-6138/).

### Supported Tasks and Leaderboards

*

### Languages

Bornholmsk, a language variant of Danish spoken on the island of Bornholm, and Danish. bcp47: `da-bornholm` and `da-DK`

## Dataset Structure

### Data Instances

### Data Fields

`id`: the sentence ID, `int`
`da-bornholm`: the Bornholmsk text, `string`
`da`: the Danish translation, `string`

### Data Splits

* Train: 5785 sentence pairs
* Validation: 500 sentence pairs
* Test: 500 sentence pairs

## Dataset Creation

### Curation Rationale

To gather as much parallel Bornholmsk together as possible

### Source Data

#### Initial Data Collection and Normalization

From a translation of Kuhre's Sansager, a selection of colloquial resources, and a prototype Bornholmsk/Danish dictionary

#### Who are the source language producers?

Native speakers of Bornholmsk who have produced works in their native language, or translated them to Danish. Much of the data is the result of a community of Bornholmsk speakers volunteering their time across the island in an effort to capture this endangered language.

### Annotations

#### Annotation process

No annotations

#### Who are the annotators?

Native speakers of Bornholmsk, mostly aged 60+.

### Personal and Sensitive Information

Unknown, but low risk of presence, given the source material

## Considerations for Using the Data

### Social Impact of Dataset

The hope behind this data is to enable people to learn and use Bornholmsk

### Discussion of Biases

[Needs More Information]

### Other Known Limitations

[Needs More Information]

## Additional Information

### Dataset Curators

This collection of Bornholmsk is curated by Leon Derczynski and Alex Speed Kjeldsen

### Licensing Information

Creative Commons Attribution 4.0

### Citation Information

```
@inproceedings{derczynski-kjeldsen-2019-bornholmsk,
title = "Bornholmsk Natural Language Processing: Resources and Tools",
author = "Derczynski, Leon and
Kjeldsen, Alex Speed",
booktitle = "Proceedings of the 22nd Nordic Conference on Computational Linguistics",
month = sep # "{--}" # oct,
year = "2019",
address = "Turku, Finland",
publisher = {Link{\"o}ping University Electronic Press},
url = "https://aclanthology.org/W19-6138",
pages = "338--344",
}
```

原始信息汇总

数据集描述

数据集概述

该数据集包含Bornholmsk和Danish的平行文本。

支持的任务和排行榜

语言

Bornholmsk，一种在Bornholm岛上使用的丹麦语变体，以及丹麦语。bcp47: da-bornholm 和 da-DK

数据集结构

数据实例

数据字段

id: 句子ID，int da-bornholm: Bornholmsk文本，string da: 丹麦语翻译，string

数据分割

• 训练集: 5785个句子对
• 验证集: 500个句子对
• 测试集: 500个句子对

数据集创建

策划理由

为了尽可能多地收集Bornholmsk的平行文本。

源数据

初始数据收集和规范化

来自Kuhre的Sansager的翻译、口语资源的选择以及Bornholmsk/Danish词典的原型。

源语言生产者

Bornholmsk的母语者，他们用母语创作作品，或将其翻译成丹麦语。大部分数据是Bornholmsk说话者在整个岛上自愿贡献时间的结果，以捕捉这种濒危语言。

注释

注释过程

无注释

注释者

Bornholmsk的母语者，主要是60岁以上的人。

个人和敏感信息

未知，但鉴于源材料，存在风险较低。

使用数据集的考虑因素

数据集的社会影响

该数据集的目的是使人们能够学习和使用Bornholmsk。

偏见的讨论

[需要更多信息]

其他已知限制

[需要更多信息]

附加信息

数据集策展人

这个Bornholmsk的收集由Leon Derczynski和Alex Speed Kjeldsen策展。

许可信息

Creative Commons Attribution 4.0

引用信息

@inproceedings{derczynski-kjeldsen-2019-bornholmsk, title = "Bornholmsk Natural Language Processing: Resources and Tools", author = "Derczynski, Leon and Kjeldsen, Alex Speed", booktitle = "Proceedings of the 22nd Nordic Conference on Computational Linguistics", month = sep # "{--}" # oct, year = "2019", address = "Turku, Finland", publisher = {Link{"o}ping University Electronic Press}, url = "https://aclanthology.org/W19-6138", pages = "338--344", }