PaulMvp/MMMLU

MMMLU（多语言大规模多任务语言理解）是一个广泛认可的AI模型通用知识基准测试。它涵盖了57个不同类别的广泛主题，从基础知识到高级专业科目如法律、物理、历史和计算机科学。数据集将MMLU的测试集翻译成14种语言，使用专业人工翻译，以提高翻译准确性，特别是对于低资源语言如约鲁巴语。这一努力反映了对提高AI模型多语言能力的承诺，确保它们在不同语言中表现准确，特别是对于代表性不足的社区。通过优先考虑高质量的翻译，旨在使AI技术对全球用户更具包容性和有效性。

The MMLU is a widely recognized benchmark of general knowledge attained by AI models. It covers a broad range of topics from 57 different categories, covering elementary-level knowledge up to advanced professional subjects like law, physics, history, and computer science. We translated the MMLU’s test set into 14 languages using professional human translators. Relying on human translators for this evaluation increases confidence in the accuracy of the translations, especially for low-resource languages like Yoruba. This effort reflects our commitment to improving the multilingual capabilities of AI models, ensuring they perform accurately across languages, particularly for underrepresented communities. By prioritizing high-quality translations, we aim to make AI technology more inclusive and effective for users worldwide.