eswardivi/telugu_dataset

---
dataset_info:
- config_name: telugu_asr
features:
- name: sentence
dtype: string
splits:
- name: train
num_bytes: 47887486
num_examples: 209270
download_size: 20219871
dataset_size: 47887486
- config_name: telugu_nlp
features:
- name: text
dtype: string
splits:
- name: train
num_bytes: 387671180
num_examples: 47415
download_size: 150012515
dataset_size: 387671180
- config_name: wikipedia
features:
- name: text
dtype: string
splits:
- name: train
num_bytes: 710613522
num_examples: 87854
download_size: 209754217
dataset_size: 710613522
configs:
- config_name: telugu_asr
data_files:
- split: train
path: telugu_asr/train-*
- config_name: telugu_nlp
data_files:
- split: train
path: telugu_nlp/train-*
- config_name: wikipedia
data_files:
- split: train
path: wikipedia/train-*
---

# Dataset

This repository contains the final dataset created using various resources. The primary datasets used for the construction of this final dataset are:

- [Telugu NLP Dataset from Kaggle](https://www.kaggle.com/datasets/sudalairajkumar/telugu-nlp)
- [Telugu ASR Corpus from HuggingFace](https://huggingface.co/datasets/parambharat/telugu_asr_corpus)
- [Wikipedia Telugu Dataset from Wikimedia on HuggingFace](https://huggingface.co/datasets/wikimedia/wikipedia)

These datasets have been combined to form a comprehensive resource for Telugu Natural Language Processing (NLP) tasks.

原始信息汇总

数据集概述

数据集配置

1. Telugu ASR

• 特征:
  • 名称: sentence
  • 数据类型: string
• 分割:
  • 名称: train
  • 字节数: 47887486
  • 样本数: 209270
• 下载大小: 20219871
• 数据集大小: 47887486
• 数据文件:
  • 分割: train
  • 路径: telugu_asr/train-*

2. Telugu NLP

• 特征:
  • 名称: text
  • 数据类型: string
• 分割:
  • 名称: train
  • 字节数: 387671180
  • 样本数: 47415
• 下载大小: 150012515
• 数据集大小: 387671180
• 数据文件:
  • 分割: train
  • 路径: telugu_nlp/train-*

3. Wikipedia

• 特征:
  • 名称: text
  • 数据类型: string
• 分割:
  • 名称: train
  • 字节数: 710613522
  • 样本数: 87854
• 下载大小: 209754217
• 数据集大小: 710613522
• 数据文件:
  • 分割: train
  • 路径: wikipedia/train-*