hazyresearch/MMLU-Pro_with_Llama_3.1_70B_Instruct_v1
收藏Hugging Face2025-06-24 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/hazyresearch/MMLU-Pro_with_Llama_3.1_70B_Instruct_v1
下载链接
链接失效反馈官方服务：
资源简介：
MMLU-Pro with Llama-3.1-70B-Instruct数据集包含了500个来自MMLU-Pro基准的多项选择题，每个问题由Llama-3.1-70B-Instruct模型生成了100个候选答案。每个答案都通过GPT-4o-mini和Python代码的混合验证进行正确性评估，并由多个奖励模型和语言模型评审员给出评分。
This dataset contains 500 multiple-choice questions from the MMLU-Pro benchmark, each with 100 candidate responses generated by the Llama-3.1-70B-Instruct model. Each response has been evaluated for correctness using a mixture of GPT-4o-mini and procedural Python code, and scored by multiple reward models and LM judges.
提供机构：
hazyresearch
