konwoo/dclm-train-164k-t10x-tsp-d20
收藏Hugging Face2025-12-18 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/konwoo/dclm-train-164k-t10x-tsp-d20
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含多个字段，包括文本内容、URL、元数据（如内容长度、内容类型、WARC相关字段等）、语言识别信息（如英语概率）、以及各种计数和概率（如ngram计数、前词计数等）。数据集的结构表明它可能用于自然语言处理或网页内容分析任务，但具体用途未明确说明。
The dataset includes multiple fields such as text content, URL, metadata (e.g., Content-Length, Content-Type, WARC-related fields), language identification information (e.g., English probability), and various counts and probabilities (e.g., ngram count, previous word count). The structure suggests it might be used for natural language processing or web content analysis tasks, but the specific purpose is not explicitly stated.
提供机构：
konwoo
