nhagar/crawlpt_dedup_urls
收藏Hugging Face2025-05-15 更新2025-10-25 收录
下载链接:
https://hf-mirror.com/datasets/nhagar/crawlpt_dedup_urls
下载链接
链接失效反馈官方服务:
资源简介:
该数据集提供了从eduagarcia/CrawlPT_dedup数据集中提取的URL和顶级域名,旨在帮助研究人员和实践者无需处理大量原始文本即可探索大型LLM训练数据集的内容。
This dataset provides the URLs and top-level domains extracted from the eduagarcia/CrawlPT_dedup dataset, aiming to help researchers and practitioners explore the content of large LLM training datasets without having to manage terabytes of raw text.
提供机构:
nhagar



