nhagar/CC-MAIN-2019-18_urls

这是一个包含网页抓取内容(crawl)、网址主机名(url_host_name)和网址计数(url_count)信息的训练数据集，适用于网页内容分析、网址特征提取等任务。数据集包含训练集(train)，共有约6487万条示例，数据集大小为3GB。This is a training dataset containing web crawling content (crawl), URL host names (url_host_name), and URL count (url_count) information, which is suitable for tasks such as web content analysis and URL feature extraction. The dataset includes a training set (train) with approximately 64.87 million examples and a dataset size of 3GB.