JQL-AI/JQL-Human-Edu-Annotations

JQL多语言教育质量注释数据集提供了高质量的人工注释，用于评估网络文档的教育价值，并作为训练和评估多语言LLM注释器的基准。该数据集包含511篇英文文本，每篇文本由3名人类评分者在0到5的范围内进行评分。这些注释已翻译成35种欧洲语言和3种非欧洲语言。该数据集由15名具有技术和语言学背景的领域专家创建，适用于评估多语言LLM的性能、训练序数分类任务模型以及研究人机协作和跨语言评估。

The JQL Multilingual Educational Quality Annotations dataset provides high-quality human annotations for evaluating the educational value of web documents and serves as a benchmark for training and evaluating multilingual LLM annotators. It includes 511 English texts, each annotated by 3 human raters on a scale from 0 to 5. These annotations have been translated into 35 European languages and 3 non-European languages. The dataset was created by 15 domain experts with strong technical or linguistic backgrounds and is intended for tasks such as evaluating multilingual LLMs, training models for ordinal classification tasks, and researching human-AI alignment and cross-lingual evaluation.