A Multilingual Dataset of Student Answers, Human Grading, and Multi-LLM Evaluations for Automated Assessment Research using JorGPT
收藏资源简介:
This is a multilingual dataset of open-ended student answers collected from authentic university-level assessments. The dataset comprises 3041 student re-sponses to 50 distinct open-ended questions, authored by 79 anonymized students from a single institution across one semester of the academic course 2025-26. It integrates real student answers, instructor-defined ideal solutions, numerical grades and qualitative feedback provided by human teachers, and structured evaluations generated by multi-ple state-of-the-art LLMs following a unified grading schema. All pedagogical content is available in both Spanish, the original language of instruction, and English, enabling multilingual and cross-lingual research. The dataset supports benchmarking of automated grading systems, analysis of alignment between human and LLM-based assessment, training of judge or meta-evaluation models, and studies on automated feedback generation. By releasing this dataset under an open license, we aim to facilitate transparent, reproducible, and realistic research in educational artificial intelligence and automated assessment.



