nhagar/dolma_urls_v1.5
收藏Hugging Face2025-05-15 更新2025-08-30 收录
下载链接:
https://hf-mirror.com/datasets/nhagar/dolma_urls_v1.5
下载链接
链接失效反馈官方服务:
资源简介:
dolma_urls_v1.5数据集提供了来自allenai/dolma训练记录的URLs和顶级域名。该数据集通过下载源数据、提取URLs和顶级域名,并仅保留记录标识符来创建,从而使得研究人员和实践者能够在不处理原始文本的terabytes数据的情况下,探索这些训练数据集的内容。
The dolma_urls_v1.5 dataset provides URLs and top-level domains associated with training records in allenai/dolma. This dataset is created by downloading the source data, extracting URLs and top-level domains, and retaining only the record identifiers, allowing researchers and practitioners to explore the content of these training datasets without dealing with terabytes of raw text data.
提供机构:
nhagar



