Helsinki-NLP/kde4

---
annotations_creators:
- found
language_creators:
- found
language:
- af
- ar
- as
- ast
- be
- bg
- bn
- br
- ca
- crh
- cs
- csb
- cy
- da
- de
- el
- en
- eo
- es
- et
- eu
- fa
- fi
- fr
- fy
- ga
- gl
- gu
- ha
- he
- hi
- hne
- hr
- hsb
- hu
- hy
- id
- is
- it
- ja
- ka
- kk
- km
- kn
- ko
- ku
- lb
- lt
- lv
- mai
- mk
- ml
- mr
- ms
- mt
- nb
- nds
- ne
- nl
- nn
- nso
- oc
- or
- pa
- pl
- ps
- pt
- ro
- ru
- rw
- se
- si
- sk
- sl
- sr
- sv
- ta
- te
- tg
- th
- tr
- uk
- uz
- vi
- wa
- xh
- zh
language_bcp47:
- bn-IN
- en-GB
- pt-BR
- zh-CN
- zh-HK
- zh-TW
license:
- unknown
multilinguality:
- multilingual
size_categories:
- 100K<n<1M
source_datasets:
- original
task_categories:
- translation
task_ids: []
paperswithcode_id: null
pretty_name: KDE4
dataset_info:
- config_name: fi-nl
features:
- name: id
dtype: string
- name: translation
dtype:
translation:
languages:
- fi
- nl
splits:
- name: train
num_bytes: 8845933
num_examples: 101593
download_size: 2471355
dataset_size: 8845933
- config_name: it-ro
features:
- name: id
dtype: string
- name: translation
dtype:
translation:
languages:
- it
- ro
splits:
- name: train
num_bytes: 8827049
num_examples: 109003
download_size: 2389051
dataset_size: 8827049
- config_name: nl-sv
features:
- name: id
dtype: string
- name: translation
dtype:
translation:
languages:
- nl
- sv
splits:
- name: train
num_bytes: 22294586
num_examples: 188454
download_size: 6203460
dataset_size: 22294586
- config_name: en-it
features:
- name: id
dtype: string
- name: translation
dtype:
translation:
languages:
- en
- it
splits:
- name: train
num_bytes: 27132585
num_examples: 220566
download_size: 7622662
dataset_size: 27132585
- config_name: en-fr
features:
- name: id
dtype: string
- name: translation
dtype:
translation:
languages:
- en
- fr
splits:
- name: train
num_bytes: 25650409
num_examples: 210173
download_size: 7049364
dataset_size: 25650409
---
# Dataset Card for KDE4

## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)

## Dataset Description

- **Homepage:** http://opus.nlpl.eu/KDE4.php
- **Repository:** None
- **Paper:** http://www.lrec-conf.org/proceedings/lrec2012/pdf/463_Paper.pdf
- **Leaderboard:** [More Information Needed]
- **Point of Contact:** [More Information Needed]

### Dataset Summary

To load a language pair which isn't part of the config, all you need to do is specify the language code as pairs.
You can find the valid pairs in Homepage section of Dataset Description: http://opus.nlpl.eu/KDE4.php
E.g.

`dataset = load_dataset("kde4", lang1="en", lang2="nl")`

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

[More Information Needed]

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

[More Information Needed]

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]

### Contributions

Thanks to [@abhishekkrthakur](https://github.com/abhishekkrthakur) for adding this dataset.

原始信息汇总

数据集概述

• 名称: KDE4
• 语言: 多语言，包括但不限于 af, ar, as, ast, be, bg, bn, br, ca, crh, cs, csb, cy, da, de, el, en, eo, es, et, eu, fa, fi, fr, fy, ga, gl, gu, ha, he, hi, hne, hr, hsb, hu, hy, id, is, it, ja, ka, kk, km, kn, ko, ku, lb, lt, lv, mai, mk, ml, mr, ms, mt, nb, nds, ne, nl, nn, nso, oc, or, pa, pl, ps, pt, ro, ru, rw, se, si, sk, sl, sr, sv, ta, te, tg, th, tr, uk, uz, vi, wa, xh, zh
• BCP47语言标签: bn-IN, en-GB, pt-BR, zh-CN, zh-HK, zh-TW
• 许可证: 未知
• 多语言性: 多语言
• 大小类别: 100K<n<1M
• 源数据集: 原始数据
• 任务类别: 翻译

数据集结构

• 配置名称: fi-nl
  • 特征:
    • id: 字符串类型
    • translation: 翻译类型，包含语言 fi, nl
  • 分割:
    • train: 101593个示例，8845933字节，下载大小2471355字节
• 配置名称: it-ro
  • 特征:
    • id: 字符串类型
    • translation: 翻译类型，包含语言 it, ro
  • 分割:
    • train: 109003个示例，8827049字节，下载大小2389051字节
• 配置名称: nl-sv
  • 特征:
    • id: 字符串类型
    • translation: 翻译类型，包含语言 nl, sv
  • 分割:
    • train: 188454个示例，22294586字节，下载大小6203460字节
• 配置名称: en-it
  • 特征:
    • id: 字符串类型
    • translation: 翻译类型，包含语言 en, it
  • 分割:
    • train: 220566个示例，27132585字节，下载大小7622662字节
• 配置名称: en-fr
  • 特征:
    • id: 字符串类型
    • translation: 翻译类型，包含语言 en, fr
  • 分割:
    • train: 210173个示例，25650409字节，下载大小7049364字节