Replication Data for: Are chatbots reliable text annotators? Sometimes

NB: In order to reproduce figures found in the article in the simplest manner, one should clone the GitHub repository and run the plotting script directly after installing necessary requirements. The corresponding files used for making these plots can also be found here under \"output.zip\". Classifying tweets with large language models with zero- and few-shot learning with custom and generic prompts, as well as supervised learning algorithms for comparison. The full GitHub repository for this data can be found at this URL or by following the link under the \"metadata\" tab. This GitHub repo contains an extensive README file explaining how to run the code and reproduce the results and plots found in the article. The present Dataverse repository contains all code and prompts used to generate predictions on the human annotated data, as well as the code book used by human annotators on this data. Due to data sharing policies at X (formerly Twitter), we are unable to share full texts from the Tweets used in our study. Instead, we have provided Tweet IDs, unique identifiers which can be used to re-scrape the data if desired.