Fsoft-AIC/CodeMMLU
收藏官方服务：
资源简介：
CodeMMLU是一个多任务基准，用于评估大型语言模型在编码和软件知识方面的能力。它基于多项选择题问答（MCQA）框架，覆盖了代码生成、缺陷检测、软件工程原则等多个编程任务和领域。
CodeMMLU is a comprehensive benchmark designed to evaluate the capabilities of large language models (LLMs) in coding and software knowledge. It builds upon the structure of multiple-choice question answering (MCQA) to cover a wide range of programming tasks and domains, including code generation, defect detection, software engineering principles, and much more.
提供机构：
Fsoft-AIC
