openai/MMMLU

MMMLU多语言大规模多任务语言理解测试集，包含57个类别的知识，从基础到高级专业领域，支持14种语言，包括阿拉伯语、孟加拉语、德语、西班牙语、法语、印地语、印尼语、意大利语、日语、韩语、葡萄牙语、斯瓦希里语、约鲁巴语和简体中文。该测试集旨在评估AI模型在不同语言中的表现，特别是对于代表性不足的社区。

The Multilingual Massive Multitask Language Understanding (MMMLU) test set covers a wide range of topics from basic to advanced professional subjects across 57 categories, supporting 14 languages including Arabic, Bengali, German, Spanish, French, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Swahili, Yoruba, and Simplified Chinese. It aims to evaluate the performance of AI models across different languages, with a focus on underrepresented communities.