Thermostatic/texts_parallel_corpus_europarl_english_spanish

---
task_categories:
- translation
language:
- en
- es
tags:
- English
- Spanish
- Parallel Corpus
pretty_name: Europarl
size_categories:
- 1M<n<10M
---

# Dataset Card for Dataset Name

<!-- Provide a quick summary of the dataset. -->

A massive parallel corpus of English-Spanish pairs. It hasn't a specified license, but there doesn't seem to be any copyrighted material in the corpus. I have personally merged rows using a pseudo-random algorithm making the dataset useful in training LLMs, reducing the risk of overfitting.

## Dataset Details

### Dataset Description

<!-- Provide a longer summary of what this dataset is. -->

- **Curated by:** Philipp Koehn
- **Funded by [optional]:** In part funded by the European Commission (7th Framework Programme).
- **Shared by [optional]:** [More Information Needed]
- **Language(s) (NLP):** English & Spanish
- **License:** Not specified.

### Dataset Sources [optional]

<!-- Provide the basic links for the dataset. -->

- **Repository:** https://www.statmt.org/europarl/index.html
- **Paper [optional]:** https://aclanthology.org/2005.mtsummit-papers.11.pdf
- **Demo [optional]:** [More Information Needed]

## Uses

<!-- Address questions around how the dataset is intended to be used. -->

### Direct Use

<!-- This section describes suitable use cases for the dataset. -->

[More Information Needed]

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->

[More Information Needed]

## Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

[More Information Needed]

## Dataset Creation

### Curation Rationale

<!-- Motivation for the creation of this dataset. -->

[More Information Needed]

### Source Data

<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->

#### Data Collection and Processing

<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->

[More Information Needed]

#### Who are the source data producers?

<!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. -->

[More Information Needed]

### Annotations [optional]

<!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. -->

#### Annotation process

<!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. -->

[More Information Needed]

#### Who are the annotators?

<!-- This section describes the people or systems who created the annotations. -->

[More Information Needed]

#### Personal and Sensitive Information

<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->

[More Information Needed]

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

[More Information Needed]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.

## Citation [optional]

<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Dataset Card Authors [optional]

[More Information Needed]

## Dataset Card Contact

[More Information Needed]

原始信息汇总

数据集概述

数据集描述

• 名称： Europarl
• 任务类别： 翻译
• 语言： 英语 & 西班牙语
• 标签： 英语, 西班牙语, 平行语料库
• 大小： 1M<n<10M
• 许可证： 未指定

数据集来源

• 存储库： https://www.statmt.org/europarl/index.html
• 论文： https://aclanthology.org/2005.mtsummit-papers.11.pdf

数据集创建

• 策划者： Philipp Koehn
• 资助： 部分由欧洲委员会（第7框架计划）资助

使用

• 直接使用： [信息不足]
• 超出范围的使用： [信息不足]

数据集结构

• 结构描述： [信息不足]

数据集创建

• 数据收集和处理： [信息不足]
• 源数据生产者： [信息不足]
• 注释： [信息不足]

偏差、风险和限制

• 建议： 用户应意识到数据集的风险、偏差和限制。需要更多信息以提供进一步的建议。