nhagar/CC-MAIN-2016-26_urls

该数据集包含网页抓取信息，具体特征包括网页内容（crawl）、网址的域名（url_host_name）以及网址出现的次数（url_count）。数据集分为训练集（train），共有约2934万个样本，数据集总大小为约1.5GB。数据集适用于网页内容分析、网址特征提取等任务。

The dataset contains web crawling information, with specific features including web page content (crawl), domain name of the URL (url_host_name), and the frequency of URL occurrences (url_count). The dataset is split into a training set (train), with a total of approximately 29.34 million samples, and the total size of the dataset is about 1.5GB. The dataset is suitable for tasks such as web content analysis and URL feature extraction.