MMLU Spanish Translation
收藏arXiv2025-09-30 收录
下载链接：
https://zenodo.org/records/11314109
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含了使用Azure翻译器和ChatGPT将选定的MMLU问题翻译成西班牙语的内容，同时还包括了这些翻译在ChatGPT4上的运行性能结果。数据集突出了翻译错误，并比较了英语和西班牙语回答之间的性能表现，显示了西班牙语性能的下降。该任务是对大型语言模型在翻译后的基准测试上的评估。
This dataset contains Spanish translations of selected MMLU questions translated via Azure Translator and ChatGPT, alongside the performance results obtained by running these translated questions on GPT-4. It highlights translation errors, compares the performance differences between English and Spanish responses, and demonstrates a decline in model performance when using Spanish-language inputs. The core task here is to evaluate large language models on translated benchmark tests.
提供机构：
Zenodo
