konwoo/dclm-val-1.64m-sorted
收藏Hugging Face2025-12-16 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/konwoo/dclm-val-1.64m-sorted
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含多个特征，如ngram计数、语言识别（使用fasttext）、丰富的WARC记录元数据（包括内容类型、日期、IP地址等）、文本内容、URL等。数据集分为训练集，包含1,640,000个样本，总大小约为10.82 GB。
The dataset includes multiple features such as ngram counts, language identification (using fasttext), extensive WARC record metadata (including content type, date, IP address, etc.), text content, URLs, and more. The dataset is split into a training set with 1,640,000 examples and a total size of approximately 10.82 GB.
提供机构：
konwoo
