nhagar/CC-MAIN-2014-10_urls

这是一个包含网页抓取信息的数据集，具体包括网页内容（crawl）、网址的主机名（url_host_name）和网址的出现次数（url_count）。数据集仅包含训练集，共有约3亿条数据，总文件大小为1.5GB。This dataset consists of web crawling information, including the web page content (crawl), the hostname of the URL (url_host_name), and the count of URL appearances (url_count). The dataset only contains a training set with about 300 million examples, with a total file size of 1.5GB.