CC-News-En

We describe a static, open-access news corpus using data from the Common Crawl Foundation, who provide free, publicly available web archives, including a continuous crawl of international news articles published in multiple languages. Our derived corpus, CC-News-En, contains 44 million English documents collected between September 2016 and March 2018. The dataset published here contains all crowdworker provided information, collected topics and queries, WARC data for the corresponding news documents, and other relevant data. The original paper describes the suite of data and processes used to collect it.