hazyresearch/GPQA_Diamond_with_Llama_3.1_70B_Instruct_up_to_1K_Samples_v1
收藏Hugging Face2025-06-24 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/hazyresearch/GPQA_Diamond_with_Llama_3.1_70B_Instruct_up_to_1K_Samples_v1
下载链接
链接失效反馈官方服务：
资源简介：
这是一个包含198个研究生级别科学问题的数据集，来自GPQA Diamond基准测试，每个问题有Llama-3.1-70B-Instruct生成的最多1000个候选答案。每个答案都经过GPT-4o-mini和过程化Python代码的混合验证，以健壮地解析不同的答案格式，并由多个奖励模型和LM评判器进行评分。
This dataset contains 198 graduate-level science questions from the GPQA Diamond benchmark, each with up to 1000 candidate responses generated by Llama-3.1-70B-Instruct. Each response has been evaluated for correctness using a mixture of GPT-4o-mini and procedural Python code to robustly parse different answer formats, and scored by multiple reward models and LM judges.
提供机构：
hazyresearch
