SemEval 2025 Task 5 - LLMs4Subjects - Shared Task Dataset

Repositories Included

shared-task-datasets: This subfolder includes the human-readable formatted GND subjects taxonomy and the training and development sets for the TIBKAT records. Participants in the LLMs4Subjects shared task are requested to download the relevant files from this folder for system development.

supplementary-datasets: This subfolder includes all excluded data from the open-access GND and TIBKAT datasets that are not part of the LLMs4Subjects shared task. For instance, this may include records from TIBKAT in languages other than English or German or records where a specific record type is too sparse. Although not part of the official shared task, these records are available for participants to use as needed.

shared-task-eval-script: This subfolder contains the official evaluation script used to generate the quantitative evaluation results for LLMs4Subjects participant team submissions.