Fsoft-AIC/CodeMMLU
收藏Hugging Face2025-05-12 更新2025-04-12 收录
下载链接:
https://hf-mirror.com/datasets/Fsoft-AIC/CodeMMLU
下载链接
链接失效反馈官方服务:
资源简介:
CodeMMLU是一个多任务基准,用于评估大型语言模型在编码和软件知识方面的能力。它基于多项选择题问答(MCQA)框架,覆盖了代码生成、缺陷检测、软件工程原则等多个编程任务和领域。
CodeMMLU is a comprehensive benchmark designed to evaluate the capabilities of large language models (LLMs) in coding and software knowledge. It builds upon the structure of multiple-choice question answering (MCQA) to cover a wide range of programming tasks and domains, including code generation, defect detection, software engineering principles, and much more.
提供机构:
Fsoft-AIC



