ZhuofengLi/fineweb_corpus
收藏Hugging Face2026-01-01 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/ZhuofengLi/fineweb_corpus
下载链接
链接失效反馈官方服务：
资源简介：
---
configs:
- config_name: Sample-10BT
data_files:
- split: train
path: Sample-10BT/train-*
- config_name: default
data_files:
- split: train
path: data/train-*
- config_name: miroverse-10k
data_files:
- split: train
path: miroverse-10k/train-*
- config_name: miroverse-10k-Sample-10BT
data_files:
- split: train
path: miroverse-10k-Sample-10BT/train-*
dataset_info:
- config_name: Sample-10BT
features:
- name: text
dtype: string
- name: id
dtype: string
- name: dump
dtype: string
- name: url
dtype: string
- name: date
dtype: string
- name: file_path
dtype: string
- name: language
dtype: string
- name: language_score
dtype: float64
- name: token_count
dtype: int64
- name: docid
dtype: int64
splits:
- name: train
num_bytes: 51171581034
num_examples: 14868862
download_size: 30243993165
dataset_size: 51171581034
- config_name: default
features:
- name: text
dtype: string
- name: id
dtype: string
- name: dump
dtype: string
- name: url
dtype: string
- name: date
dtype: string
- name: file_path
dtype: string
- name: language
dtype: string
- name: language_score
dtype: float64
- name: token_count
dtype: int64
- name: docid
dtype: int64
splits:
- name: train
num_bytes: 51171581034
num_examples: 14868862
download_size: 30243993165
dataset_size: 51171581034
- config_name: miroverse-10k
features:
- name: docid
dtype: int64
- name: text
dtype: string
- name: url
dtype: string
splits:
- name: train
num_bytes: 1061304795
num_examples: 9222
download_size: 540186151
dataset_size: 1061304795
- config_name: miroverse-10k-Sample-10BT
features:
- name: docid
dtype: string
- name: text
dtype: string
- name: url
dtype: string
splits:
- name: train
num_bytes: 48560880327
num_examples: 14878084
download_size: 29752871121
dataset_size: 48560880327
---
提供机构：
ZhuofengLi
