Common Crawl
收藏知名数据库2026-06-26 收录
下载链接：
https://commoncrawl.org
下载链接
链接失效反馈官方服务：
资源简介：
Common Crawl是一个免费开放的网页爬取数据存储库，成立于2007年，是一个501(c)(3)非营利组织。该数据库包含超过3000亿个网页，跨越19年，每月新增30-50亿个页面，已被超过10000篇研究论文引用。它为研究人员提供了开放网络数据的批量提取、转换和分析服务。
Common Crawl is a free and open web crawling data repository, founded in 2007, and it is a 501(c)(3) non-profit organization. This database contains over 300 billion web pages spanning 19 years, with 3 to 5 billion new pages added monthly, and has been cited in more than 10,000 research papers. It provides researchers with bulk extraction, transformation and analysis services for open web data.
