open-llm-leaderboard-old/details_Felladrin__Minueza-32M-Chat
收藏数据集概述
该数据集是在评估模型Felladrin/Minueza-32M-Chat在Open LLM Leaderboard上的运行过程中自动创建的。数据集包含63个配置，每个配置对应一个评估任务。数据集从1次运行中创建，每次运行的详细结果可以在每个配置中找到，并以运行的时间戳命名。"train"分割始终指向最新的结果。
数据集结构
数据集包含以下配置：
-
harness_arc_challenge_25
- 分割: 2024_02_29T16_20_09.486856
- 路径:
**/details_harness|arc:challenge|25_2024-02-29T16-20-09.486856.parquet - 分割: latest
- 路径:
**/details_harness|arc:challenge|25_2024-02-29T16-20-09.486856.parquet
-
harness_gsm8k_5
- 分割: 2024_02_29T16_20_09.486856
- 路径:
**/details_harness|gsm8k|5_2024-02-29T16-20-09.486856.parquet - 分割: latest
- 路径:
**/details_harness|gsm8k|5_2024-02-29T16-20-09.486856.parquet
-
harness_hellaswag_10
- 分割: 2024_02_29T16_20_09.486856
- 路径:
**/details_harness|hellaswag|10_2024-02-29T16-20-09.486856.parquet - 分割: latest
- 路径:
**/details_harness|hellaswag|10_2024-02-29T16-20-09.486856.parquet
-
harness_hendrycksTest_5
- 分割: 2024_02_29T16_20_09.486856
- 路径:
**/details_harness|hendrycksTest-abstract_algebra|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-anatomy|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-astronomy|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-business_ethics|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-clinical_knowledge|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-college_biology|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-college_chemistry|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-college_computer_science|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-college_mathematics|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-college_medicine|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-college_physics|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-computer_security|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-conceptual_physics|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-econometrics|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-electrical_engineering|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-elementary_mathematics|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-formal_logic|5_2024-02-29T16-20-09.486856.parquet**/details_harness|hendrycksTest-global_facts|5_2024-02-29T16-20-09.486856.parquet
最新结果
以下是2024-02-29T16:20:09.486856运行的最新结果：
python { "all": { "acc": 0.2562052459364911, "acc_stderr": 0.030704761687739203, "acc_norm": 0.2566921244530212, "acc_norm_stderr": 0.03151693797177765, "mc1": 0.25703794369645044, "mc1_stderr": 0.015298077509485083, "mc2": 0.47273397572972664, "mc2_stderr": 0.015697890529464523 }, "harness|arc:challenge|25": { "acc": 0.18003412969283278, "acc_stderr": 0.011227856729050021, "acc_norm": 0.20392491467576793, "acc_norm_stderr": 0.011774262478702256 }, "harness|hellaswag|10": { "acc": 0.26309500099581756, "acc_stderr": 0.004394136724172993, "acc_norm": 0.26538538139812784, "acc_norm_stderr": 0.004406358190678486 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.26, "acc_stderr": 0.04408440022768081, "acc_norm": 0.26, "acc_norm_stderr": 0.04408440022768081 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.22962962962962963, "acc_stderr": 0.03633384414073461, "acc_norm": 0.22962962962962963, "acc_norm_stderr": 0.03633384414073461 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.19078947368421054, "acc_stderr": 0.03197565821032499, "acc_norm": 0.19078947368421054, "acc_norm_stderr": 0.03197565821032499 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.21, "acc_stderr": 0.040936018074033256, "acc_norm": 0.21, "acc_norm_stderr": 0.040936018074033256 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.22264150943396227, "acc_stderr": 0.025604233470899105, "acc_norm": 0.22264150943396227, "acc_norm_stderr": 0.025604233470899105 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.2708333333333333, "acc_stderr": 0.037161774375660164, "acc_norm": 0.2708333333333333, "acc_norm_stderr": 0.037161774375660164 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.23, "acc_stderr": 0.042295258468165044, "acc_norm": 0.23, "acc_norm_stderr": 0.042295258468165044 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.3, "acc_stderr": 0.046056618647183814, "acc_norm": 0.3, "acc_norm_stderr": 0.046056618647183814 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.27, "acc_stderr": 0.044619604333847415, "acc_norm": 0.27, "acc_norm_stderr": 0.044619604333847415 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.2023121387283237, "acc_stderr": 0.030631145539198816, "acc_norm": 0.2023121387283237, "acc_norm_stderr": 0.030631145539198816 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.21568627450980393, "acc_stderr": 0.04092563958237654, "acc_norm": 0.21568627450980393, "acc_norm_stderr": 0.04092563958237654 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.22, "acc_stderr": 0.041633319989322695, "acc_norm": 0.22, "acc_norm_stderr": 0.041633319989322695 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.2553191489361702, "acc_stderr": 0.02850485647051419, "acc_norm": 0.2553191489361702, "acc_norm_stderr": 0.02850485647051419 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.19298245614035087, "acc_stderr": 0.037124548537213684, "acc_norm": 0.19298245614035087, "acc_norm_stderr": 0.037124548537213684 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.2896551724137931, "acc_stderr": 0.03780019230438014, "acc_norm": 0.2896551724137931, "acc_norm_stderr": 0.03780019230438014 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.25396825396825395, "acc_stderr": 0.022418042891113942
