skeskinen/books3_basic_paragraphs

---
dataset_info:
features:
- name: text
dtype: string
- name: book
dtype: string
- name: pos
dtype: float64
- name: smog_index
dtype: float64
splits:
- name: train
num_bytes: 1366299770
num_examples: 6639751
download_size: 676098743
dataset_size: 1366299770
---
# Dataset Card for "books3_basic_paragraphs"

the_pile books3, books with smog grade difficulty estimate of 6.5 or under. Split into paragraphs and filtered out most 'non-paragraphs' like titles, tables of content, etc.

原始信息汇总

数据集概述

数据集名称

• 名称: books3_basic_paragraphs

数据集特征

• 特征列表:
  • text: 数据类型为 string
  • book: 数据类型为 string
  • pos: 数据类型为 float64
  • smog_index: 数据类型为 float64

数据集划分

• 训练集:
  • 样本数量: 6639751
  • 数据大小: 1366299770 字节

数据集大小

• 下载大小: 676098743 字节
• 总数据大小: 1366299770 字节