Spanish Language Benchmark for Artificial Intelligence Models (TELEIA)

TELEIA Datasets

The dataset contains test questions to evaluate LLMs in Spanish

TELEIA_Cervantes_AVE.csv: test questions on vocabulary and grammatical structures, following the format of the Cervantes AVE exam. The column "question" contains a sentence with a gap that must be filled in. The columns "option_a", "option_b", "option_c", "option_d" and "correct_answer" (A,B,C or D) represent the different possibilities for the gap and the correct one.

TELEIA_PCE.csv: test on morphology and semantics resembling the style of the PCE exam, consisting of short questions or sentences to be completed. It is composed of the following columns: "question", "option_a", "option_b", "option_c" and "correct_answer" (A, B or C).

TELEIA_SIELE.csv: different texts with questions related to them, based on the reading comprehension task of the SIELE exam. It is composed of the following columns: "question", "option_a", "option_b", "option_c" and "correct_answer" (A, B or C).