nhagar/CC-MAIN-2021-04_urls
收藏Hugging Face2025-05-15 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/nhagar/CC-MAIN-2021-04_urls
下载链接
链接失效反馈官方服务：
资源简介：
这是一个包含网页爬取数据的数据集，其中包括网页内容（crawl）、网址的主机名（url_host_name）和网址的数量（url_count）。数据集分为训练集，大小为3,015,192,328字节，共有60,732,385个示例。数据集的总大小与训练集相同，下载大小为1,087,222,871字节。
This dataset contains web crawling data, including page content (crawl), the domain name of the URL (url_host_name), and the count of URLs (url_count). The dataset is split into a training set, which is 3,015,192,328 bytes in size and contains 60,732,385 examples. The total size of the dataset is the same as the training set, and the download size is 1,087,222,871 bytes.
提供机构：
nhagar
