opus_ubuntu

# Dataset Card for Opus Ubuntu

## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)

## Dataset Description

- **Homepage:** http://opus.nlpl.eu/Ubuntu.php
- **Repository:** None
- **Paper:** http://www.lrec-conf.org/proceedings/lrec2012/pdf/463_Paper.pdf
- **Leaderboard:** [More Information Needed]
- **Point of Contact:** [More Information Needed]

### Dataset Summary

These are translations of the Ubuntu software package messages, donated by the Ubuntu community.

To load a language pair which isn't part of the config, all you need to do is specify the language code as pairs.
You can find the valid pairs in Homepage section of Dataset Description: http://opus.nlpl.eu/Ubuntu.php
E.g.

`dataset = load_dataset("opus_ubuntu", lang1="it", lang2="pl")`

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

Example instance:

```
{
'id': '0',
'translation': {
'it': 'Comprende Gmail, Google Docs, Google+, YouTube e Picasa',
'pl': 'Zawiera Gmail, Google Docs, Google+, YouTube oraz Picasa'
}
}
```

### Data Fields

Each instance has two fields:
- **id**: the id of the example
- **translation**: a dictionary containing translated texts in two languages.

### Data Splits

Each subset simply consists in a train set. We provide the number of examples for certain language pairs:

| | train |
|:---------|--------:|
| as-bs | 8583 |
| az-cs | 293 |
| bg-de | 184 |
| br-es_PR | 125 |
| bn-ga | 7324 |
| br-hi | 15551 |
| br-la | 527 |
| bs-szl | 646 |
| br-uz | 1416 |
| br-yi | 2799 |

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

[More Information Needed]

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

[More Information Needed]

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

BSD "Revised" license (see (https://help.launchpad.net/Legal#Translations_copyright)[https://help.launchpad.net/Legal#Translations_copyright])

### Citation Information

```bibtex
@InProceedings{TIEDEMANN12.463,
author = {J{\"o}rg Tiedemann},
title = {Parallel Data, Tools and Interfaces in OPUS},
booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)},
year = {2012},
month = {may},
date = {23-25},
address = {Istanbul, Turkey},
editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Ugur Dogan and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis},
publisher = {European Language Resources Association (ELRA)},
isbn = {978-2-9517408-7-7},
language = {english}
}
```

### Contributions

Thanks to [@rkc007](https://github.com/rkc007) for adding this dataset.

# Opus Ubuntu 数据集卡片

## 目录
- [数据集描述](#dataset-description)
- [数据集概述](#dataset-summary)
- [支持任务与排行榜](#supported-tasks-and-leaderboards)
- [语言](#languages)
- [数据集结构](#dataset-structure)
- [数据实例](#data-instances)
- [数据字段](#data-fields)
- [数据划分](#data-splits)
- [数据集构建](#dataset-creation)
- [构建初衷](#curation-rationale)
- [源数据](#source-data)
- [标注信息](#annotations)
- [个人与敏感信息](#personal-and-sensitive-information)
- [数据集使用注意事项](#considerations-for-using-the-data)
- [数据集的社会影响](#social-impact-of-dataset)
- [偏差讨论](#discussion-of-biases)
- [其他已知局限性](#other-known-limitations)
- [附加信息](#additional-information)
- [数据集维护者](#dataset-curators)
- [许可信息](#licensing-information)
- [引用信息](#citation-information)
- [贡献](#contributions)

## 数据集描述

- **主页**：http://opus.nlpl.eu/Ubuntu.php
- **代码仓库**：无
- **相关论文**：http://www.lrec-conf.org/proceedings/lrec2012/pdf/463_Paper.pdf
- **排行榜**：[需补充更多信息]
- **联系人**：[需补充更多信息]

### 数据集概述
本数据集包含由Ubuntu社区捐赠的Ubuntu软件包消息翻译语料。若需加载配置中未涵盖的语言对，仅需指定语言代码配对即可。有效语言对列表可在数据集描述的主页链接http://opus.nlpl.eu/Ubuntu.php中查询，示例如下：
python
dataset = load_dataset("opus_ubuntu", lang1="it", lang2="pl")

### 支持任务与排行榜
[需补充更多信息]

### 语言
[需补充更多信息]

## 数据集结构

### 数据实例
示例数据如下：
json
{
"id": "0",
"translation": {
"it": "Comprende Gmail, Google Docs, Google+, YouTube e Picasa",
"pl": "Zawiera Gmail, Google Docs, Google+, YouTube oraz Picasa"
}
}

### 数据字段
每个实例包含两个字段：
- **id**：示例编号
- **translation**：包含两种语言翻译文本的字典。

### 数据划分
每个子集仅包含训练集。部分语言对的样本数量如下：

| 语言对 | 训练集样本数 |
|:---------|-------------:|
| as-bs | 8583 |
| az-cs | 293 |
| bg-de | 184 |
| br-es_PR | 125 |
| bn-ga | 7324 |
| br-hi | 15551 |
| br-la | 527 |
| bs-szl | 646 |
| br-uz | 1416 |
| br-yi | 2799 |

## 数据集构建

### 构建初衷
[需补充更多信息]

### 源数据
[需补充更多信息]

#### 初始数据收集与标准化
[需补充更多信息]

#### 源语言创作者是谁？
[需补充更多信息]

### 标注信息
[需补充更多信息]

#### 标注流程
[需补充更多信息]

#### 标注者是谁？
[需补充更多信息]

### 个人与敏感信息
[需补充更多信息]

## 数据集使用注意事项

### 数据集的社会影响
[需补充更多信息]

### 偏差讨论
[需补充更多信息]

### 其他已知局限性
[需补充更多信息]

## 附加信息

### 数据集维护者
[需补充更多信息]

### 许可信息
BSD“修订版”许可协议（详见https://help.launchpad.net/Legal#Translations_copyright）

### 引用信息
bibtex
@InProceedings{TIEDEMANN12.463,
author = {J{"o}rg Tiedemann},
title = {Parallel Data, Tools and Interfaces in OPUS},
booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)},
year = {2012},
month = {may},
date = {23-25},
address = {Istanbul, Turkey},
editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Ugur Dogan and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis},
publisher = {European Language Resources Association (ELRA)},
isbn = {978-2-9517408-7-7},
language = {english}
}

### 贡献
感谢[@rkc007](https://github.com/rkc007) 为本数据集添加支持。