nhagar/CC-MAIN-2017-09_urls

这是一个包含网页抓取数据的数据集，具有crawl（抓取内容）、url_host_name（网址主机名）和url_count（网址计数）等字段。数据集分为训练集，大小为3,634,909,180字节，共有70,405,541个样本。数据集的下载大小为1,225,800,650字节。

This dataset contains web crawling data with fields such as crawl (content of the crawl), url_host_name (host name of the URL), and url_count (URL count). The dataset is split into a training set, which is 3,634,909,180 bytes in size and contains 70,405,541 samples. The download size of the dataset is 1,225,800,650 bytes.