distil-whisper/peoples_speech-dirty

---
license: cc-by-4.0
task_categories:
- automatic-speech-recognition
language:
- en
-pretty_name: People's Speech Other
---

# Distil Whisper: People's Speech Other

This is a variant of the [People's Speech Other](https://huggingface.co/datasets/MLCommons/peoples_speech) dataset, augmented to return the pseudo-labelled Whisper
Transcriptions alongside the original dataset elements. The pseudo-labelled transcriptions were generated by
labelling the input audio data with the Whisper [large-v2](https://huggingface.co/openai/whisper-large-v2)
model with *greedy* sampling. For information on how the original dataset was curated, refer to the original
[dataset card](https://huggingface.co/datasets/MLCommons/peoples_speech).

## Standalone Usage

First, install the latest version of the 🤗 Datasets package:

```bash
pip install --upgrade pip
pip install --upgrade datasets[audio]
```

The dataset can be downloaded and pre-processed on disk using the [`load_dataset`](https://huggingface.co/docs/datasets/v2.14.5/en/package_reference/loading_methods#datasets.load_dataset)
function:

```python
from datasets import load_dataset

dataset = load_dataset("distil-whisper/peoples_speech-dirty", "dirty")
# take the first sample of the validation set
sample = dataset["validation"][0]
```

It can also be streamed directly from the Hub using Datasets' [streaming mode](https://huggingface.co/blog/audio-datasets#streaming-mode-the-silver-bullet).
Loading a dataset in streaming mode loads individual samples of the dataset at a time, rather than downloading the entire
dataset to disk:

```python
from datasets import load_dataset

dataset = load_dataset("distil-whisper/peoples_speech-dirty", "dirty", streaming=True)
# take the first sample of the validation set
sample = next(iter(dataset["validation"]))
```

## Distil Whisper Usage

To use this dataset to reproduce a Distil Whisper training run, refer to the instructions on the
[Distil Whisper repository](https://github.com/huggingface/distil-whisper#training).

## License

This dataset is licensed under cc-by-4.0.

原始信息汇总

Distil Whisper: Peoples Speech Other

概述

这是一个Peoples Speech Other数据集的变体，增加了伪标记的Whisper转录本。伪标记转录本是通过使用Whisper large-v2模型和贪婪采样方法生成的。关于原始数据集的制作信息，请参考原始数据集卡片。

独立使用

首先，安装最新版本的🤗 Datasets包：

bash pip install --upgrade pip pip install --upgrade datasets[audio]

可以使用load_dataset函数下载和预处理数据集：

python from datasets import load_dataset

dataset = load_dataset("distil-whisper/peoples_speech-dirty", "dirty")

获取验证集的第一个样本

sample = dataset["validation"][0]

也可以直接从Hub使用Datasets的流模式进行流式加载：

python from datasets import load_dataset

dataset = load_dataset("distil-whisper/peoples_speech-dirty", "dirty", streaming=True)

获取验证集的第一个样本

sample = next(iter(dataset["validation"]))

Distil Whisper 使用

要使用此数据集复现Distil Whisper训练运行，请参考Distil Whisper仓库中的说明。

许可证

此数据集采用cc-by-4.0许可证。