An new corpus of one million articles from four post-soviet countries and Poland.

Data is in the .Rata format. Should be read into R using the load() function. It contains two R data frames called tx_pl_lang (articles in Polish laniuage) and tx_ru_lang (articles in Russian language). Covered newspapers Table 1. Newspapers and portals included in the analysis and their Alexia ranks Country Newspaper site Number of articles Alexia global rank Alexia local rank Russia iz.ru 43,782 1,378 45 Russia kommersant.ru 46,070 1,335 44 Russia novayagazeta.ru 29,357 9,215 459 Russia vedomosti.ru 27,797 6,302 288 Kazakhstan informburo.kz 29,375 38,916 119 Kazakhstan nur.kz 67,350 951 6 Kazakhstan tengrinews.kz 44,285 13,036 34 Kazakhstan zakon.kz 109,442 9,477 30 Belarus bdg.by 33,447 292,678 746 Belarus belgazeta.by 21,995 1,392,332 11,041 Belarus sb.by 83,685 41,015 79 Ukraine kp.ua 194,792 64,062 860 Ukraine segodnya.ua 45,835 18,658 256 Ukraine vesti.ua 90,559 58,573 1,096 Poland gazeta.pl 53,321 1,749 14 Poland rp.pl 49,587 20,930 167 Poland wpolityce.pl 76,625 13,833 105 Note: Alexia rank, 90-day average, checked on 17 February 2021. Total number of articles 1,047,304. List of columns is the same for both data frames: - short name of the newspaper, - text of the article - date when the article was scraped - sentiment calculated using the standard sentiment lexicons - sentiment calculated using the Covid-extended lexicons - name of the topic - surnames of influential politicians 0/1 variable, 1 if the name is in the article > colnames(tx_pl_lang) [1] "name" "art" "date" "sent" "sent.c" "tname" [7] "putin" "medvedev" "vaino" "shoigu" "bortnikov" "lavrov" [13] "mishustin" "kirienko" "sechin" "zelensky" "shmygal" "akhmetov" [19] "avakov" "ermak" "poroshenko" "medvedchuk" "groisman" "sagyntaev" [25] "mamin" "tokayev" "nnazarbayev" "dnazarbayeva" "kulibayev" "masimov" [31] "alukashenko" "vakulchik" "vlukashenko" "kobyakov" "makei" "myasnikovich" [37] "rumas" "golovchenko" "kaczynski" "duda" "morawiecki" "ziobro" List of LDA topics (tname column) cri crime ind industry itr international trade sov former Soviet republics pol politics tou tourism con construction air air transport ban banking fin finance med media pro protests hou housing spo sport pol politics reg regional mkt financial markets cul culture acc accidents edu education lab labour market war war pub public finances eco economy int international eur europe mob mobile/internet com commodities, oil, gas usa USA fam family hea health his history tra transport pop gossip/beauty/weather rel religion aut automotive spa space misc cannot decide the topic ussr soviet history ukr Ukraine mos Moscow