mesolitica/pseudostreaming-malaysian-youtube-whisper-large-v3

---
license: mit
task_categories:
- automatic-speech-recognition
language:
- ms
---

# Pseudostreaming Malaysian Youtube videos using Whisper Large V3

Original dataset at https://huggingface.co/datasets/mesolitica/pseudolabel-malaysian-youtube-whisper-large-v3

We use https://huggingface.co/mesolitica/conformer-medium-mixed to generate pseudostreaming dataset, source code at https://github.com/mesolitica/malaysian-dataset/tree/master/speech-to-text-semisupervised/pseudostreaming-whisper

Total 40486.589364839296 hours.

data format from [processed.jsonl](processed.jsonl),

```json
[
{
"text": "dalam sukan olimpik dan paralimpik tokyo dua ribu dua puluh",
"start": 3.52,
"end": 6.46,
"audio_filename": "processed-audio/1-225586-0.mp3",
"original_audio_filename": "output-audio/3-1084-10.mp3"
},
{
"text": "to azizul has",
"start": 7.12,
"end": 8.179999999999998,
"audio_filename": "processed-audio/1-225586-1.mp3",
"original_audio_filename": "output-audio/3-1084-10.mp3"
},
{
"text": "awang meraih kilauan perak untuk malaysia dalam sukan olimpik tokyo dua ribu dua puluh tampil sebagai satu satunya wakil asia bagaimanapun beliau terpaksa akur di tangan pelumba great britain jason",
"start": 8.4,
"end": 22.98,
"audio_filename": "processed-audio/1-225586-2.mp3",
"original_audio_filename": "output-audio/3-1084-10.mp3"
},
{
"text": "y yang meraih pingat emas",
"start": 23.28,
"end": 25.060000000000002,
"audio_filename": "processed-audio/1-225586-3.mp3",
"original_audio_filename": "output-audio/3-1084-10.mp3"
}
]
```

## how-to

```bash
git clone https://huggingface.co/datasets/mesolitica/pseudostreaming-malaya-speech-stt
cd pseudostreaming-malaya-speech-stt
wget https://www.7-zip.org/a/7z2301-linux-x64.tar.xz
tar -xf 7z2301-linux-x64.tar.xz
./7zz x processed-audio.7z.001 -y -mmt40
```

原始信息汇总

Pseudostreaming Malaysian Youtube videos using Whisper Large V3

数据集概述

• 许可证: MIT
• 任务类别: 自动语音识别
• 语言: 马来语

数据集详情

• 总时长: 40486.589364839296小时
• 数据格式: 从 processed.jsonl 文件中提取

数据示例

json [ { "text": "dalam sukan olimpik dan paralimpik tokyo dua ribu dua puluh", "start": 3.52, "end": 6.46, "audio_filename": "processed-audio/1-225586-0.mp3", "original_audio_filename": "output-audio/3-1084-10.mp3" }, { "text": "to azizul has", "start": 7.12, "end": 8.179999999999998, "audio_filename": "processed-audio/1-225586-1.mp3", "original_audio_filename": "output-audio/3-1084-10.mp3" }, { "text": "awang meraih kilauan perak untuk malaysia dalam sukan olimpik tokyo dua ribu dua puluh tampil sebagai satu satunya wakil asia bagaimanapun beliau terpaksa akur di tangan pelumba great britain jason", "start": 8.4, "end": 22.98, "audio_filename": "processed-audio/1-225586-2.mp3", "original_audio_filename": "output-audio/3-1084-10.mp3" }, { "text": "y yang meraih pingat emas", "start": 23.28, "end": 25.060000000000002, "audio_filename": "processed-audio/1-225586-3.mp3", "original_audio_filename": "output-audio/3-1084-10.mp3" } ]