Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus

The Webis-Editorial-Quality-18 corpus is a novel corpus with 1000 news editorials.  The aim of this Corpus is to study a new notion for news editorials quality. It contains the quality assessments of 1000 news editorials, each annotated by three liberals and three conservatives. The annotators also reported free-text reasons for the effects they observed.