nhagar/c4_urls_en.noclean

该数据集提供了[allenai/c4](https://huggingface.co/datasets/allenai/c4)训练记录中的URL和顶级域名信息（英语未清理版本）。它是由Nick Hagar和Jack Bandy策划的一组数据集的一部分，旨在使探索大型语言模型训练数据集变得更加直接和便捷。该数据集通过下载源数据、提取URL和顶级域名，并仅保留这些记录标识符而创建，允许研究人员和实践者在不管理数TB原始文本的情况下探索这些训练数据集的内容。

This dataset provides URLs and top-level domains associated with training records in [allenai/c4](https://huggingface.co/datasets/allenai/c4) (English no clean variant). It is part of a collection of datasets curated by Nick Hagar and Jack Bandy to make exploring large language model training datasets more straightforward and accessible. The dataset was created by downloading the source data, extracting URLs and top-level domains, and retaining only the record identifiers, allowing researchers and practitioners to explore the contents of these training datasets without having to manage terabytes of raw text.