MLP-SEMO/CSR_datasets

---
dataset_info:
- config_name: imdb
features:
- name: sentence
dtype: string
splits:
- name: train
num_bytes: 100969177
num_examples: 981208
download_size: 66789757
dataset_size: 100969177
- config_name: open_web_text
features:
- name: sentence
dtype: string
splits:
- name: train
num_bytes: 609072555.1696403
num_examples: 5000000
download_size: 448554864
dataset_size: 609072555.1696403
- config_name: s2orc
features:
- name: sentence
dtype: string
splits:
- name: train
num_bytes: 722273785.5209366
num_examples: 5000000
download_size: 490289348
dataset_size: 722273785.5209366
- config_name: wikipedia
features:
- name: sentence
dtype: string
splits:
- name: train
num_bytes: 3315345717.963178
num_examples: 24000000
download_size: 2395731872
dataset_size: 3315345717.963178
configs:
- config_name: imdb
data_files:
- split: train
path: imdb/train-*
- config_name: open_web_text
data_files:
- split: train
path: open_web_text/train-*
- config_name: s2orc
data_files:
- split: train
path: s2orc/train-*
- config_name: wikipedia
data_files:
- split: train
path: wikipedia/train-*
---

原始信息汇总

数据集概述

数据集1: IMDb

• 配置名称: imdb
• 特征:
  • 名称: sentence
  • 数据类型: string
• 分割:
  • 类型: train
  • 字节数: 100969177
  • 示例数: 981208
• 下载大小: 66789757
• 数据集大小: 100969177

数据集2: Open Web Text

• 配置名称: open_web_text
• 特征:
  • 名称: sentence
  • 数据类型: string
• 分割:
  • 类型: train
  • 字节数: 609072555.1696403
  • 示例数: 5000000
• 下载大小: 448554864
• 数据集大小: 609072555.1696403

数据集3: S2ORC

• 配置名称: s2orc
• 特征:
  • 名称: sentence
  • 数据类型: string
• 分割:
  • 类型: train
  • 字节数: 722273785.5209366
  • 示例数: 5000000
• 下载大小: 490289348
• 数据集大小: 722273785.5209366

数据集4: Wikipedia

• 配置名称: wikipedia
• 特征:
  • 名称: sentence
  • 数据类型: string
• 分割:
  • 类型: train
  • 字节数: 3315345717.963178
  • 示例数: 24000000
• 下载大小: 2395731872
• 数据集大小: 3315345717.963178