nhagar/CC-MAIN-2020-05_urls

这是一个包含网页抓取信息的数据集，具体包括网页内容（crawl）、网址主机名（url_host_name）和网址计数（url_count）三个字段。数据集被分为训练集（train），共有约5.9亿个样本，总大小为2.93GB。This dataset contains web crawling information, including three fields: page content (crawl), URL host name (url_host_name), and URL count (url_count). The dataset is split into a training set (train) with approximately 590 million samples, totaling 2.93GB in size.