ruliad/fineweb_edu_100BT_chunk_19

---
dataset_info:
features:
- name: text
dtype: string
- name: id
dtype: string
- name: dump
dtype: string
- name: url
dtype: string
- name: file_path
dtype: string
- name: language
dtype: string
- name: language_score
dtype: float64
- name: token_count
dtype: int64
- name: score
dtype: float64
- name: int_score
dtype: int64
splits:
- name: train
num_bytes: 11643458556
num_examples: 2270686
download_size: 6736413929
dataset_size: 11643458556
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---

This dataset includes multiple features such as text, ID, URL, file path, language, language score, token count, score, and integer score. The data types cover string, float, and integer. The dataset is divided into a training set, which contains 2270686 examples with a total size of 11643458556 bytes, and a download size of 6736413929 bytes.

原始信息汇总

数据集概述

数据集特征

• text: 字符串类型
• id: 字符串类型
• dump: 字符串类型
• url: 字符串类型
• file_path: 字符串类型
• language: 字符串类型
• language_score: 浮点数类型
• token_count: 整数类型
• score: 浮点数类型
• int_score: 整数类型

数据集分割

• train:
  • 字节数: 11643458556
  • 示例数: 2270686

数据集大小

• 下载大小: 6736413929
• 数据集大小: 11643458556

配置

• config_name: default
  • data_files:
    • split: train
      • path: data/train-*