Proppy Corpus 1.0

# Proppy Corpus 1.0 Version 1.0: March 25, 2019<br> --------------------------- This file describes the corpus Proppy 1.0. This is the corpus used in the<br> paper "Proppy: Organizing the News Based on Their Propagandistic Content" <br> (see citation section). The corpus contains 52k articles from 100+ news outlets. Each article is<br> labeled as either “propagandistic” (positive class) or “non-propagandistic”<br> (negative class). The labeling was done indirectly using a technique known as<br> distant supervision, i.e. an article is considered propagandistic if it comes<br> from a news outlet that has been labeled as propagandistic by human annotators. <br> ## Data format We provide the corpus in three tsv files, including training, development, and<br> testing partitions. The data is tab-separated. Each line represents one article, with the following<br> information: 1. article_text: the text of the article retrieved via newspaper3k package.<br> 2. event_location: the geographical location - collected from GDELT.<br> 3. average_tone: measures the impact of the event - collected from GDELT<br> 4. article_date: article's publish date - collected from GDELT.<br> 5. article_ID: GDELT ID , unique among the dataset's articles.<br> 6. article_URL: the direct URL for the published article in its source website.<br> 7. MBFC_factuality_label: factuality label for the source from MBFC<br> 8. article_URL<br> 9. MBFC_factuality_label <br> 10. URL_to_MBFC_page <br> 11. source_name <br> 12. MBFC_notes_about_source<br> 13. MBFC_bias_label<br> 14. source_URL<br> 15. propaganda_label <br> ## About The corpus was downloaded using MBFC metadata to identify propagandistic vs<br> non-propagandistic sources. Specific URLs where then gathered with GDELT and<br> contents downloaded with newspaper3k ## Credit Please cite the following paper when using this corpus: A. Barrón-Cedeño, G. Da San Martino, I. Jaradat, and P. Nakov.<br> Proppy: Organizing news coverage on the basis of their propagandistic content.<br> Information Processing and Management 56(5), pp. 1849-1864. 2019 @article{BARRONCEDENO20191849,<br> author = "Barr\'{o}n-Cede\~no, Alberto and<br> Da San Martino, Giovanni and<br> Jaradat, Israa and<br> Nakov, Preslav",<br> title = "{Proppy: Organizing the news based on their propagandistic content}",<br> journal = "Information Processing &amp; Management",<br> volume = "56",<br> number = "5",<br> pages = "1849 - 1864",<br> year = "2019",<br> issn = "0306-4573",<br> doi = "https://doi.org/10.1016/j.ipm.2019.03.005",<br> url = "http://www.sciencedirect.com/science/article/pii/S0306457318306058",<br> } ## Authors Alberto Barrón-Cedeno;<br> Israa Jaradat;<br> Giovani Da San Martino;<br> Preslav Nakov