annotations on elifesciences.org

This dataset accompanies the conference contribution
"An Online Field Study on Scholarly Journal
Annotations" (Felix Lange, de Gruyter 2020, yet to be published), in which annotations on the journal plattform elifesciences.org are analysed.
File "flange_cohen_kappa" contains the content-type attributions made by two annotators. Annotator 2 is the author of the study, Annotator 1 is a student assistant that worked on a subset of the data presented in the publication.
On the basis of this attributions, the interrater reliability score (Cohen's kappa) was calculated (0.54). This data was created for test purposes. Minor differences (less than 5%) to the data used for the publication are possible, but not probable.
The content-types reffered to in the spreadsheet are Assertion/Contribution (1), Information Request (2), Unspecified Praise/Criticism (3), Unclear (4). The file contains snippets of the annotation texts to differentiate between annotations that are referenced by the same web url.The "dataset anno_data_export" represents the data used in the final, published version of the article. It is accompanied by a data description. Errors in the data caused during the export are possible, but not probable.