nhagar/CC-MAIN-2018-51_urls

这是一个包含网页抓取信息的数据集，具体特征包括网页的抓取内容（crawl）、网址的主机名（url_host_name）和网址的出现次数（url_count）。数据集仅包含训练集分割，共有约9亿2千4百95万3千个样本，数据集大小为4.7GB。This dataset includes web crawling information, with features such as the content of the web page (crawl), the hostname of the URL (url_host_name), and the occurrence count of the URL (url_count). The dataset contains only the training set split, with a total of approximately 924,953,033 samples, and the dataset size is 4.7GB.