Topic Annotations on Reddit Posts from Eating Disorders and Dieting Forums by Human and LLMs

This dataset comprises 77,175 Reddit posts from 115 subreddit forums, annotated for the presence of 15 topics related to eating disorders and dieting. The dataset includes labels and scores on all 77,175 Reddit posts, determined by 5 Large Language Models: GPT-4o, Llama-3.1-8B-Instruct, Qwen2.5-7B-Instruct, Mistral-7B-Instruct-v0.3, Vicuna-7b-v1.5, as well as by the ensemble of the four open-source LLMs. The dataset also includes a subset of 1,080 human-annotated posts for evaluation. <br> Replication data for the publications 'Ensemble of Large Language Models for Curated Labeling and Rating of Free-text Data' and 'Connections Between Dieting and Eating Disorders Online Discussions: A Network Analysis of Reddit Forums'.