ruliad/fineweb_350BT_chunk_52

---
dataset_info:
features:
- name: text
dtype: string
- name: id
dtype: string
- name: dump
dtype: string
- name: url
dtype: string
- name: date
dtype: string
- name: file_path
dtype: string
- name: language
dtype: string
- name: language_score
dtype: float64
- name: token_count
dtype: int64
splits:
- name: train
num_bytes: 17184923305
num_examples: 5000000
download_size: 10265143434
dataset_size: 17184923305
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---

This dataset includes multiple features such as text, ID, URL, date, file path, language, language score, and token count. It is divided into a training set with 5 million examples. The dataset size is 17184923305 bytes, and the download size is 10265143434 bytes.

原始信息汇总

数据集信息

特征

• text: 类型为字符串
• id: 类型为字符串
• dump: 类型为字符串
• url: 类型为字符串
• date: 类型为字符串
• file_path: 类型为字符串
• language: 类型为字符串
• language_score: 类型为浮点数 (float64)
• token_count: 类型为整数 (int64)

数据分割

• train: 包含5,000,000个样本，总字节数为17,184,923,305

数据集大小

• 下载大小: 10,265,143,434字节
• 数据集大小: 17,184,923,305字节

配置

• default:
  • 数据文件:
    • train: 路径为data/train-*