sumuks/essential-web-v1.0-sample-1B
收藏Hugging Face2025-07-03 更新2025-10-25 收录
下载链接：
https://hf-mirror.com/datasets/sumuks/essential-web-v1.0-sample-1B
下载链接
链接失效反馈官方服务：
资源简介：
这是一个从Essential Web v1.0中抽取的样本数据集，包含大约10亿个token。数据集保留了原始数据集中的所有列，包括文档ID、文本内容、URL和来源信息、质量信号、AI分类标签等。数据集以parquet文件格式存储，并可通过HuggingFace datasets库方便地加载。
This is a sample dataset extracted from Essential Web v1.0, containing approximately 1 billion tokens. It preserves all columns from the original dataset, including document ID, text content, URL and source information, quality signals, AI taxonomy labels, etc. The dataset is stored in parquet file format and can be easily loaded using the HuggingFace datasets library.
提供机构：
sumuks
