BSC-LT/MULTI_corpus

该语料库是TRAIN项目（Traducción Automática para la Inclusión，自动翻译促进包容）的一部分，由MCIN/AEI和ERDF资助。它汇总了15,191,441个句子级条目，涵盖四种极低资源语言：Tamazight/Amazigh (ZGH)、Pashto (PS)、Wolof (WO)和Romani (ROM)，这些语言与一种或多种高资源对应语言（英语、西班牙语、法语）配对，还包括每种低资源语言的单语数据。该数据集主要用于训练针对西班牙移民和少数民族社区资源不足语言的机器翻译系统。它将来自OPUS、NLLB集合、CommonVoice、Tatoeba、Col·lectivaT、IRCAM等来源的30个源数据集整合为一个统一的大型数据集（完整列表见源数据部分）。数据涵盖广泛领域，包括网络爬取文本、软件本地化、新闻、百科全书内容（维基百科）、宗教文本（圣经）、教育内容和机构文件。

This corpus was compiled as part of the TRAIN project (Traducción Automática para la Inclusión, Automatic Translation for Inclusion), funded by MCIN/AEI and ERDF. It aggregates 15,191,441 sentence-level entries covering four extremely low-resource languages: Tamazight/Amazigh (ZGH), Pashto (PS), Wolof (WO), and Romani (ROM), paired with one or more high-resource counterparts (English, Spanish, French), plus monolingual data for each low-resource language. The dataset is intended primarily for training machine translation (MT) systems targeting under-resourced languages of migrant and minority communities in Spain. It consolidates 30 source datasets drawn from OPUS, the NLLB collection, CommonVoice, Tatoeba, Col·lectivaT, IRCAM, and other sources into a single unified large dataset (see Source Data section for the full list). The data spans a wide range of domains including web-crawled text, software localisation, news, encyclopaedic content (Wikipedia), religious text (Bible), educational contents, and institutional documents.