open-llm-leaderboard-old/details_johnsnowlabs__PhigRange-2.7B-slerp

该数据集是在评估模型[johnsnowlabs/PhigRange-2.7B-slerp](https://huggingface.co/johnsnowlabs/PhigRange-2.7B-slerp)时自动创建的，评估在[Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)上进行。数据集由63个配置组成，每个配置对应一个评估任务。数据集是从1次运行中创建的，每次运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。"train"分割始终指向最新结果。一个额外的配置"results"存储了所有运行的聚合结果，并用于计算和显示[Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)上的聚合指标。

原始信息汇总

数据集概述

该数据集是在评估模型johnsnowlabs/PhigRange-2.7B-slerp在Open LLM Leaderboard上的自动创建的。数据集包含63个配置，每个配置对应一个评估任务。数据集从1次运行中创建，每次运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。"train"分割始终指向最新的结果。

数据集结构

配置

• harness_arc_challenge_25

  • 分割: 2024_04_09T23_28_00.860067, latest
  • 路径: **/details_harness|arc:challenge|25_2024-04-09T23-28-00.860067.parquet

• harness_gsm8k_5

  • 分割: 2024_04_09T23_28_00.860067, latest
  • 路径: **/details_harness|gsm8k|5_2024-04-09T23-28-00.860067.parquet

• harness_hellaswag_10

  • 分割: 2024_04_09T23_28_00.860067, latest
  • 路径: **/details_harness|hellaswag|10_2024-04-09T23-28-00.860067.parquet

• harness_hendrycksTest_5

  • 分割: 2024_04_09T23_28_00.860067, latest
  • 路径:
    • **/details_harness|hendrycksTest-abstract_algebra|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-anatomy|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-astronomy|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-business_ethics|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-college_biology|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-college_chemistry|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-college_computer_science|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-college_mathematics|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-college_medicine|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-college_physics|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-computer_security|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-conceptual_physics|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-econometrics|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-electrical_engineering|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-formal_logic|5_2024-04-09T23-28-00.860067.parquet
    • **/details_harness|hendrycksTest-global_facts|5_2024-04-09T23-28-00.860067.parquet
    • ...

最新结果

以下是最新结果从运行2024-04-09T23:28:00.860067：

python { "all": { "acc": 0.2346565602684817, "acc_stderr": 0.029941751455701507, "acc_norm": 0.2350571738760513, "acc_norm_stderr": 0.03073212900737563, "mc1": 0.23378212974296206, "mc1_stderr": 0.014816195991931598, "mc2": 0.4844398937149579, "mc2_stderr": 0.01666642030156188 }, "harness|arc:challenge|25": { "acc": 0.22781569965870307, "acc_stderr": 0.012256708602326924, "acc_norm": 0.2721843003412969, "acc_norm_stderr": 0.013006600406423707 }, "harness|hellaswag|10": { "acc": 0.2582154949213304, "acc_stderr": 0.004367586801776664, "acc_norm": 0.26777534355706034, "acc_norm_stderr": 0.004418948941099403 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.29, "acc_stderr": 0.045604802157206845, "acc_norm": 0.29, "acc_norm_stderr": 0.045604802157206845 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.14814814814814814, "acc_stderr": 0.030688647610352657, "acc_norm": 0.14814814814814814, "acc_norm_stderr": 0.030688647610352657 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.2894736842105263, "acc_stderr": 0.03690677986137282, "acc_norm": 0.2894736842105263, "acc_norm_stderr": 0.03690677986137282 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.27, "acc_stderr": 0.044619604333847394, "acc_norm": 0.27, "acc_norm_stderr": 0.044619604333847394 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.2339622641509434, "acc_stderr": 0.02605529690115292, "acc_norm": 0.2339622641509434, "acc_norm_stderr": 0.02605529690115292 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.22916666666666666, "acc_stderr": 0.03514697467862388, "acc_norm": 0.22916666666666666, "acc_norm_stderr": 0.03514697467862388 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.22, "acc_stderr": 0.04163331998932269, "acc_norm": 0.22, "acc_norm_stderr": 0.04163331998932269 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.2, "acc_stderr": 0.04020151261036845, "acc_norm": 0.2, "acc_norm_stderr": 0.04020151261036845 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.23, "acc_stderr": 0.04229525846816505, "acc_norm": 0.23, "acc_norm_stderr": 0.04229525846816505 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.24855491329479767, "acc_stderr": 0.03295304696818318, "acc_norm": 0.24855491329479767, "acc_norm_stderr": 0.03295304696818318 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.2549019607843137, "acc_stderr": 0.04336432707993177, "acc_norm": 0.2549019607843137, "acc_norm_stderr": 0.04336432707993177 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.23, "acc_stderr": 0.042295258468165065, "acc_norm": 0.23, "acc_norm_stderr": 0.042295258468165065 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.24680851063829787, "acc_stderr": 0.028185441301234102, "acc_norm": 0.24680851063829787, "acc_norm_stderr": 0.028185441301234102 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.19298245614035087, "acc_stderr": 0.037124548537213684, "acc_norm": 0.19298245614035087, "acc_norm_stderr": 0.037124548537213684 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.22758620689655173, "acc_stderr": 0.03493950380131184, "acc_norm": 0.22758620689655173, "acc_norm_stderr": 0.03493950380131184 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.2566137566137566, "acc_stderr": 0.022494510767503154, "acc_norm": 0.2566137566137566, "acc_norm_stderr": 0.022494510767503154 }, "harness|hendrycksTest-formal_logic|5": { "acc": 0.23015873015873015, "acc_stderr": 0.037649508797906066, "acc_norm": 0.23015873015873