nhagar/dolma_urls_v1.6
收藏Hugging Face2025-05-15 更新2025-08-30 收录
下载链接：
https://hf-mirror.com/datasets/nhagar/dolma_urls_v1.6
下载链接
链接失效反馈官方服务：
资源简介：
此数据集提供了与allenai/dolma训练记录相关的URLs和顶级域。它是由Nick Hagar和Jack Bandy策划的，旨在帮助研究者和从业者探索大型LLM训练数据集的内容，而无需处理数TB的原始文本数据。数据集包含两列：URL（每条记录关联的原始URL）和domain（每个URL的顶级域）。
This dataset provides the URLs and top-level domains associated with training records in allenai/dolma. It is curated by Nick Hagar and Jack Bandy to assist researchers and practitioners in exploring the contents of large LLM training datasets without having to manage terabytes of raw text data. The dataset includes two columns: url (the raw URL associated with each record) and domain (the top-level domain for each URL).
提供机构：
nhagar
