nhagar/CC-MAIN-2016-36_urls

这是一个包含网页抓取信息的数据集，具体包含三个字段：网页抓取内容（crawl），URL主机名（url_host_name）和URL数量（url_count）。数据集仅包含训练集，共有69897376个样本，总文件大小为3.6GB。数据集提供了默认配置，指明了训练数据的文件路径。This dataset contains web crawling information, including three fields: web page content (crawl), URL hostname (url_host_name), and URL count (url_count). The dataset consists only of a training set with a total of 69897376 samples, with a total file size of 3.6GB. The dataset provides a default configuration that specifies the file path for the training data.