qwen2-5_sci_qa_exps_scp_filtered_1664_verified_1k_len_r1_eval_03-18-25_22-26-45_0981
收藏资源简介：
# mlfoundations-dev/qwen2-5_sci_qa_exps__scp_filtered_1664__verified_1k_len_r1_eval_03-18-25_22-26-45_0981 Precomputed model outputs for evaluation. ## Evaluation Results ### Summary | Metric | AIME24 | AIME25 | AMC23 | MATH500 | GPQADiamond | LiveCodeBench | |--------|------|------|-----|-------|-----------|-------------| | Accuracy | 26.0 | 23.3 | 71.0 | 82.8 | 22.7 | 32.6 | ### AIME24 - **Average Accuracy**: 26.00% ± 1.74% - **Number of Runs**: 5 | Run | Accuracy | Questions Solved | Total Questions | |-----|----------|-----------------|----------------| | 1 | 30.00% | 9 | 30 | | 2 | 30.00% | 9 | 30 | | 3 | 20.00% | 6 | 30 | | 4 | 23.33% | 7 | 30 | | 5 | 26.67% | 8 | 30 | ### AIME25 - **Average Accuracy**: 23.33% ± 0.94% - **Number of Runs**: 5 | Run | Accuracy | Questions Solved | Total Questions | |-----|----------|-----------------|----------------| | 1 | 23.33% | 7 | 30 | | 2 | 23.33% | 7 | 30 | | 3 | 26.67% | 8 | 30 | | 4 | 20.00% | 6 | 30 | | 5 | 23.33% | 7 | 30 | ### AMC23 - **Average Accuracy**: 71.00% ± 1.52% - **Number of Runs**: 5 | Run | Accuracy | Questions Solved | Total Questions | |-----|----------|-----------------|----------------| | 1 | 75.00% | 30 | 40 | | 2 | 72.50% | 29 | 40 | | 3 | 72.50% | 29 | 40 | | 4 | 65.00% | 26 | 40 | | 5 | 70.00% | 28 | 40 | ### MATH500 - **Accuracy**: 82.80% | Accuracy | Questions Solved | Total Questions | |----------|-----------------|----------------| | 82.80% | 414 | 500 | ### GPQADiamond - **Average Accuracy**: 22.73% ± 0.48% - **Number of Runs**: 3 | Run | Accuracy | Questions Solved | Total Questions | |-----|----------|-----------------|----------------| | 1 | 23.74% | 47 | 198 | | 2 | 21.72% | 43 | 198 | | 3 | 22.73% | 45 | 198 | ### LiveCodeBench - **Average Accuracy**: 32.55% ± 0.85% - **Number of Runs**: 3 | Run | Accuracy | Questions Solved | Total Questions | |-----|----------|-----------------|----------------| | 1 | 32.49% | 166 | 511 | | 2 | 31.12% | 159 | 511 | | 3 | 34.05% | 174 | 511 |
