Dataset for "Mentions of Political Extremism in English Wikipedia"

This is a data set accompanying the article "Mentions of Political Extremism in English Wikipedia" (https://davidrozado.substack.com/p/mentions-of-political-extremism-in-wikipedia)

To ensure the integrity of the frequency counts reported above, I provide a link to a file containing the analyzed terms, the corresponding Wikipedia paragraphs where the terms appear, and the URLs of the corresponding Wikipedia articles. Two important points to note: First, the data source is the Wikipedia Dump file "enwiki-20221001-pages-articles-multistream.xml," retrieved on October 15, 2022. The raw content was parsed to extract only the textual data from articles, excluding metadata and other non-article information. The final article text-only dataset is 23.6 GB in size. While the URLs provide a reference to the article where each target term appeared as of October 2022, some of the content of the articles may have changed since then. Second, the analysis above did not disambiguate terms with multiple meanings. For instance, a small fraction of the paragraphs analyzed use far-right to describe the position of an entity in a photograph, not political extremism. This is not too limiting for the results as there is no reason to expect such mentions to disproportionately outnumber equivalent uses of far-left. And still, even when excluding far-right and far-left from the analysis, the remaining references to right-wing political extremism (4,870) still outnumber all remaining references to left-wing political extremism (3,019).