nhagar/mc4-es-sampled_urls

该数据集提供了与bertin-project/mc4-es-sampled训练记录相关的URL和顶级域名。它是由Nick Hagar和Jack Bandy策划的，旨在让研究人员和实践者能够分析大型语言模型训练数据集的内容，而无需手动处理数TB的原始文本数据。数据集包含两个字段：URL和域名。

This dataset provides URLs and top-level domains associated with training records in bertin-project/mc4-es-sampled. Curated by Nick Hagar and Jack Bandy, it is designed to enable researchers and practitioners to analyze the contents of large language model training datasets without having to manage terabytes of raw text data. The dataset includes two fields: URL and domain.