South African Disinformation [Fake News] Website Data - 2020

See publication: <strong>Is it Fake? News Disinformation Detection on South African News Websites</strong> We used, as sources, investigations by the news websites MyBroadband (https://mybroadband.co.za/forum/threads/list-of-known-fake-news-sites-in-south-africa-and-beyond.879854/) and News24 (https://exposed.news24.com/the-website-blacklist/). These articles covered investigations into disinformation websites in South Africa in 2018. They compiled lists of websites that were suspected to be disinformation. During the period from those articles to present, a number of the websites have become inaccessible or offline. We attempted to use the internet archives WayBack Machine we could only get partial snapshots and error messages. A web-scraper only worked for one of the sources although manual editing was still required to clean the text from Javascript code and some paragraph duplicates. On most of the other websites, a web-scraper did not work well as there were too many advertisements and broken parts of pages. Because of all these problems, most of the articles were manually copied and pasted and cleaned in flat files. In some cases, the text of articles could not be copied and was not made part of the South African disinformation corpus. <strong>Citing the dataset</strong> @inproceedings{de2021fake, title={Is it Fake? News Disinformation Detection on South African News Websites}, author={de Wet, Harm and Marivate, Vukosi}, booktitle={2021 IEEE AFRICON}, pages={1--6}, year={2021}, organization={IEEE} }参见以下论文：**《Is it Fake? 南非新闻网站的虚假新闻检测》** 本数据集以新闻网站MyBroadband（链接：https://mybroadband.co.za/forum/threads/list-of-known-fake-news-sites-in-south-africa-and-beyond.879854/）与News24（链接：https://exposed.news24.com/the-website-blacklist/）的调查内容作为数据源。上述两篇2018年的调查报道针对南非虚假新闻网站展开调研，并整理了疑似虚假新闻网站的名单。 自上述报道发布至今，其中部分网站已无法访问或处于离线状态。我们尝试通过互联网档案馆（WayBack Machine）获取相关存档，但仅能获取部分页面快照与错误提示信息。尽管仍需通过人工编辑移除文本中的JavaScript代码与重复段落，但仅有一种数据源可通过网页爬虫（web-scraper）完成爬取。对于其余多数网站，由于页面存在大量广告与破损元素，网页爬虫无法正常运行。受上述各类问题影响，绝大多数文章均通过手动复制粘贴的方式获取，并以纯文本文件完成清洗整理。部分文章因无法提取文本，未被纳入南非虚假新闻语料库。 **数据集引用** @inproceedings{de2021fake, title={Is it Fake? News Disinformation Detection on South African News Websites}, author={de Wet, Harm and Marivate, Vukosi}, booktitle={2021 IEEE AFRICON}, pages={1--6}, year={2021}, organization={IEEE} }