nhagar/CC-MAIN-2016-18_urls

该数据集包含网页抓取信息，具体包括网页内容（crawl）、网页的域名（url_host_name）以及网页的访问计数（url_count）。数据集分为训练集，共有约2299万条样本，总大小约为1.2GB。数据集的下载大小约为399.98MB。提供了一个默认配置，用于指定训练数据文件的路径。

The dataset contains web crawling information, specifically including the web page content (crawl), the domain name of the web page (url_host_name), and the visit count of the web page (url_count). The dataset is split into a training set with a total of approximately 22,992,885 samples, with a total size of about 1.2GB. The download size of the dataset is approximately 399.98MB. A default configuration is provided to specify the path to the training data files.