covost2

CoVoST 2, a large-scale multilingual speech translation corpus covering translations from 21 languages into English and from English into 15 languages. The dataset is created using Mozilla’s open source Common Voice database of crowdsourced voice recordings.

Note that in order to limit the required storage for preparing this dataset, the audio
is stored in the .mp3 format and is not converted to a float32 array. To convert, the audio
file to a float32 array, please make use of the `.map()` function as follows:

```python
import torchaudio

def map_to_array(batch):
speech_array, _ = torchaudio.load(batch["file"])
batch["speech"] = speech_array.numpy()
return batch

dataset = dataset.map(map_to_array, remove_columns=["file"])
```

CoVoST 2，一个涵盖从21种语言翻译至英语及从英语翻译至15种语言的规模庞大的多语言语音翻译语料库。该数据集采用Mozilla开源的Common Voice语音录制众包数据库构建而成。请注意，为限制准备该数据集所需的存储空间，音频以.mp3格式存储，并未转换为float32数组。若需将音频文件转换为float32数组，请使用以下`.map()`函数进行操作：
python
import torchaudio

def map_to_array(batch):
speech_array, _ = torchaudio.load(batch["file"])
batch["speech"] = speech_array.numpy()
return batch

dataset = dataset.map(map_to_array, remove_columns=["file"])

搜集汇总

背景与挑战

背景概述

CoVoST 2是一个多语言语音翻译数据集，支持21种语言到英语和英语到15种语言的翻译，音频以.mp3格式存储。