nhagar/dclm-dedup_urls
收藏Hugging Face2025-05-04 更新2025-08-30 收录
下载链接：
https://hf-mirror.com/datasets/nhagar/dclm-dedup_urls
下载链接
链接失效反馈官方服务：
资源简介：
该数据集提供了与Zyphra/dclm-dedup训练记录相关的URL和顶级域名。它是由Nick Hagar和Jack Bandy策划的，旨在让研究人员和实践者能够分析大型语言模型训练数据集的内容，而不必直接处理数TB的原始文本数据。
This dataset provides the URLs and top-level domains associated with training records in Zyphra/dclm-dedup. Curated by Nick Hagar and Jack Bandy, it aims to enable researchers and practitioners to analyze the contents of large language model training datasets without directly handling terabytes of raw text data.
提供机构：
nhagar
