Whispering-GPT/lex-fridman-podcast

---
language: en
task_categories:
- automatic-speech-recognition
dataset_info:
features:
- name: id
dtype: string
- name: channel
dtype: string
- name: channel_id
dtype: string
- name: title
dtype: string
- name: categories
sequence: string
- name: tags
sequence: string
- name: description
dtype: string
- name: text
dtype: string
- name: segments
list:
- name: start
dtype: float64
- name: end
dtype: float64
- name: text
dtype: string
splits:
- name: train
num_bytes: 102530760
num_examples: 346
download_size: 57264732
dataset_size: 102530760
tags:
- whisper
- whispering
- medium
---
# Dataset Card for "lexFridmanPodcast-transcript-audio"

## Table of Contents
- [Table of Contents](#table-of-contents)
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Contributions](#contributions)

## Dataset Description

- **Homepage:** [Whispering-GPT](https://github.com/matallanas/whisper_gpt_pipeline)
- **Repository:** [whisper_gpt_pipeline](https://github.com/matallanas/whisper_gpt_pipeline)
- **Paper:** [whisper](https://cdn.openai.com/papers/whisper.pdf) and [gpt](https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf)
- **Point of Contact:** [Whispering-GPT organization](https://huggingface.co/Whispering-GPT)

### Dataset Summary

This dataset is created by applying whisper to the videos of the Youtube channel [Lex Fridman Podcast](https://www.youtube.com/watch?v=FhfmGM6hswI&list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4&ab_channel=LexFridman). The dataset was created a medium size whisper model.

### Languages

- **Language**: English

## Dataset Structure

The dataset contains all the transcripts plus the audio of the different videos of Lex Fridman Podcast.

### Data Fields

The dataset is composed by:
- **id**: Id of the youtube video.
- **channel**: Name of the channel.
- **channel\_id**: Id of the youtube channel.
- **title**: Title given to the video.
- **categories**: Category of the video.
- **description**: Description added by the author.
- **text**: Whole transcript of the video.
- **segments**: A list with the time and transcription of the video.
- **start**: When started the trancription.
- **end**: When the transcription ends.
- **text**: The text of the transcription.

### Data Splits

- Train split.

## Dataset Creation
### Source Data

The transcriptions are from the videos of [Lex Fridman Podcast](https://www.youtube.com/watch?v=FhfmGM6hswI&list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4&ab_channel=LexFridman)

### Contributions

Thanks to [Whispering-GPT](https://huggingface.co/Whispering-GPT) organization for adding this dataset.

原始信息汇总

数据集卡片 for "lexFridmanPodcast-transcript-audio"

数据集描述

数据集摘要

该数据集是通过应用whisper模型到Lex Fridman Podcast的YouTube视频创建的。数据集由一个中等大小的whisper模型创建。

语言

• 语言: 英语

数据集结构

该数据集包含Lex Fridman Podcast不同视频的全部转录文本及音频。

数据字段

数据集由以下字段组成：

• id: YouTube视频的ID。
• channel: 频道名称。
• channel_id: YouTube频道的ID。
• title: 视频的标题。
• categories: 视频的分类。
• description: 作者添加的描述。
• text: 视频的完整转录文本。
• segments: 包含视频时间和转录文本的列表。
  • start: 转录开始的时间。
  • end: 转录结束的时间。
  • text: 转录的文本。

数据分割

• 训练集分割。

数据集创建

源数据

转录文本来自Lex Fridman Podcast的视频。

贡献

感谢Whispering-GPT组织添加此数据集。