COVID-19 and Election Datasets - Evaluation of Thematic Coherence in Microblogs

These datasets were used in the paper 'Evaluation of Thematic Coherence in Microblogs' (ACL, 2021). The data is structured as follows: each file represents a cluster of tweets which contains the tweet IDs, the journalist annotations for quality evaluation and issue identification, as well as the metric evaluation scores. Note that a set of 50 clusters, equally split between COVID-19 and Election domains, is shared between the 3 annotators and thus contains 3 labels.
The complete annotation guidelines used for this task are attached.
Due to the recent changes in the availability of the Twitter / X academic API, please reach out to [e-mail] if you consider using the dataset.

License: The annotations are provided under a CC-BY license, while Twitter retains the ownership and rights of the content of the tweets.