nhagar/dclm-baseline-1.0-parquet_urls
收藏Hugging Face2025-05-15 更新2025-08-30 收录
下载链接：
https://hf-mirror.com/datasets/nhagar/dclm-baseline-1.0-parquet_urls
下载链接
链接失效反馈官方服务：
资源简介：
该数据集提供了与mlfoundations/dclm-baseline-1.0-parquet训练记录相关的URL和顶级域名。它是由Nick Hagar和Jack Bandy策划的，旨在让研究人员和实践者能够分析大型语言模型训练数据集的内容，而无需处理原始的大量文本数据。数据集包含两个字段：每个记录的原始URL和每个URL的顶级域名。
This dataset provides URLs and top-level domains associated with training records in mlfoundations/dclm-baseline-1.0-parquet. Curated by Nick Hagar and Jack Bandy, it is intended to enable researchers and practitioners to analyze the contents of large LLM training datasets without having to manage terabytes of raw text data. The dataset includes two fields: the raw URL for each record and the top-level domain for each URL.
提供机构：
nhagar
