open-llm-leaderboard-old/details_ozayezerceli__Lowke-2x7B-v1

Name: open-llm-leaderboard-old/details_ozayezerceli__Lowke-2x7B-v1
Creator: open-llm-leaderboard-old
Published: 2024-03-28 02:13:34
License: 暂无描述

Hugging Face2024-03-28 更新2024-06-22 收录

下载链接：

https://hf-mirror.com/datasets/open-llm-leaderboard-old/details_ozayezerceli__Lowke-2x7B-v1

下载链接

链接失效反馈

官方服务：

资源简介：

该数据集是在评估模型ozayezerceli/Lowke-2x7B-v1时自动创建的，用于在Open LLM Leaderboard上进行评估。数据集由63个配置组成，每个配置对应一个评估任务。数据集从1次运行中创建，每次运行可以在每个配置的特定分割中找到，分割名称使用运行的时间戳命名。"train"分割始终指向最新的结果。此外，还有一个名为"results"的配置，存储了所有运行的聚合结果，并用于计算和显示Open LLM Leaderboard上的聚合指标。

提供机构：

open-llm-leaderboard-old

原始信息汇总

数据集概述

该数据集是在对模型 ozayezerceli/Lowke-2x7B-v1 进行评估运行期间自动创建的，用于 Open LLM Leaderboard。数据集包含63个配置，每个配置对应一个评估任务。数据集从1次运行中创建，每个运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。"train" 分割始终指向最新的结果。

数据集结构

配置详情

配置名称: harness_arc_challenge_25
- 数据文件:
  - 分割: 2024_03_28T02_10_48.461618
    - 路径: **/details_harness|arc:challenge|25_2024-03-28T02-10-48.461618.parquet
  - 分割: latest
    - 路径: **/details_harness|arc:challenge|25_2024-03-28T02-10-48.461618.parquet
配置名称: harness_gsm8k_5
- 数据文件:
  - 分割: 2024_03_28T02_10_48.461618
    - 路径: **/details_harness|gsm8k|5_2024-03-28T02-10-48.461618.parquet
  - 分割: latest
    - 路径: **/details_harness|gsm8k|5_2024-03-28T02-10-48.461618.parquet
配置名称: harness_hellaswag_10
- 数据文件:
  - 分割: 2024_03_28T02_10_48.461618
    - 路径: **/details_harness|hellaswag|10_2024-03-28T02-10-48.461618.parquet
  - 分割: latest
    - 路径: **/details_harness|hellaswag|10_2024-03-28T02-10-48.461618.parquet
配置名称: harness_hendrycksTest_5
- 数据文件:
  - 分割: 2024_03_28T02_10_48.461618
    - 路径:
      - **/details_harness|hendrycksTest-abstract_algebra|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-anatomy|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-astronomy|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-business_ethics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-clinical_knowledge|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-college_biology|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-college_chemistry|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-college_computer_science|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-college_mathematics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-college_medicine|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-college_physics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-computer_security|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-conceptual_physics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-econometrics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-electrical_engineering|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-elementary_mathematics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-formal_logic|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-global_facts|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_biology|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_chemistry|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_computer_science|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_european_history|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_geography|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_mathematics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_microeconomics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_physics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_psychology|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_statistics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_us_history|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-high_school_world_history|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-human_aging|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-human_sexuality|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-international_law|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-jurisprudence|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-logical_fallacies|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-machine_learning|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-management|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-marketing|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-medical_genetics|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-miscellaneous|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-moral_disputes|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-moral_scenarios|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-nutrition|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-philosophy|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-prehistory|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-professional_accounting|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-professional_law|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-professional_medicine|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-professional_psychology|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-public_relations|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-security_studies|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-sociology|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-us_foreign_policy|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-virology|5_2024-03-28T02-10-48.461618.parquet
      - **/details_harness|hendrycksTest-world_religions|5_2024-03-28T02-10-48.461618.parquet

最新结果

以下是 2024-03-28T02:10:48.461618 运行的最新结果：

python { "all": { "acc": 0.6486187485707325, "acc_stderr": 0.031998586116046404, "acc_norm": 0.6490610469951146, "acc_norm_stderr": 0.0326511575368417, "mc1": 0.5520195838433293, "mc1_stderr": 0.017408513063422913, "mc2": 0.726719785213627, "mc2_stderr": 0.014214257461390666 }, "harness|arc:challenge|25": { "acc": 0.6774744027303754, "acc_stderr": 0.01365998089427737, "acc_norm": 0.7150170648464164, "acc_norm_stderr": 0.013191348179838793 }, "harness|hellaswag|10": { "acc": 0.6921927902808206, "acc_stderr": 0.004606429684604528, "acc_norm": 0.8730332603067118, "acc_norm_stderr": 0.0033225528296089014 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.31, "acc_stderr": 0.04648231987117316, "acc_norm": 0.31, "acc_norm_stderr": 0.04648231987117316 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.5925925925925926, "acc_stderr": 0.04244633238353228, "acc_norm": 0.5925925925925926, "acc_norm_stderr": 0.04244633238353228 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.7039473684210527, "acc_stderr": 0.03715062154998904, "acc_norm": 0.7039473684210527, "acc_norm_stderr": 0.03715062154998904 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.65, "acc_stderr": 0.0479372485441102, "acc_norm": 0.65, "acc_norm_stderr": 0.0479372485441102 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.720754716981132, "acc_stderr": 0.027611163402399715, "acc_norm": 0.720754716981132, "acc_norm_stderr": 0.027611163402399715 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.7638888888888888, "acc_stderr": 0.03551446610810826, "acc_norm": 0.7638888888888888, "acc_norm_stderr": 0.03551446610810826 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.47, "acc_stderr": 0.050161355804659205, "acc_norm": 0.47, "acc_norm_stderr": 0.050161355804659205 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.57, "acc_stderr": 0.04975698519562428, "acc_norm": 0.57, "acc_norm_stderr": 0.04975698519562428 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.29, "acc_stderr": 0.04560480215720683, "acc_norm": 0.29, "acc_norm_stderr": 0.04560480215720683 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.6705202312138728, "acc_stderr": 0.03583901754736412, "acc_norm": 0.6705202312138728, "acc_norm_stderr": 0.03583901754736412 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.37254901960784315, "acc_stderr": 0.04810840148082635, "acc_norm": 0.37254901960784315, "acc_norm_stderr": 0.04810840148082635 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.76, "acc_stderr": 0.042923469599092816, "acc_norm": 0.76, "acc_norm_stderr": 0.042923469599092816 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.574468085106383, "acc_stderr": 0.03232146916224468, "acc_norm": 0.574468085106383, "acc_norm_stderr": 0.03232146916224468 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.4473684210526316, "acc_stderr": 0.04677473004491199, "acc_norm": 0.4473684210526316, "acc_norm_stderr": 0.04677473004491199 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.5655172413793104, "acc_stderr": 0.04130740879555497, "acc_norm": 0.5655172413793104, "acc_norm_stderr": 0.04130740879555497 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.41798941798941797, "acc_stderr": 0.025402555503260912, "acc_norm": 0.41798941798941797, "acc_norm_stderr": 0.025402555503260912 }, "harness|hendrycksTest-formal_logic|5": { "acc": 0.4444444444444444, "acc_stderr": 0.044444444444444495, "acc_norm": 0.4444444444444444, "acc_norm_stderr": 0.044444444444444495 }, "harness|hendrycksTest-global_facts|5": { "acc": 0.31, "acc_stderr": 0.04648231987117316, "acc_norm": 0.31, "acc_norm_stderr": 0.04648231987117316 }, "harness|hendrycksTest-high_school_biology|5": { "acc": 0.7741935483870968, "acc_stderr": 0.023785577884181012, "acc_norm": 0.7741935483870968, "acc_norm_stderr": 0.023785577884181012 }, "harness|hendrycksTest-high_school_chemistry|5": { "acc": 0.5073891625615764, "acc_stderr": 0.035176035403610105, "acc_norm": 0.5073891625615764, "acc_norm_stderr": 0.035176035403610105 }, "harness|hendrycksTest-high_school_computer_science|5": { "acc": 0.73, "acc_stderr": 0.044619604333847394, "acc_norm": 0.73, "acc_norm_stderr": 0.044619604333847394 }, "harness|hendrycksTest-high_school_european_history|5": { "acc": 0.7696969696969697, "acc_stderr": 0.0328766675860349, "acc_norm": 0.7696969696969697, "acc_norm_stderr": 0.0328766675860349 }, "harness|hendrycksTest-high_school_geography|5": { "acc": 0.803030303030303, "acc_stderr": 0.028335609732463362, "acc_norm": 0.803030303030303, "acc_norm_stderr": 0.028335609732463362 }, "harness|hendrycksTest-high_school_government_and_politics|5": { "acc": 0.8963730569948186, "acc_stderr": 0.02199531196364424, "acc_norm": 0.8963730569948186, "acc_norm_stderr": 0.02199531196364424 }, "harness|hendrycksTest-high_school_macroeconomics|5": { "acc": 0.6794871794871795, "acc_stderr": 0.02366129639396428, "acc_norm": 0.6794871794871795, "acc_norm_stderr": 0.02366129639396428 }, "harness|hendrycksTest-high_school_mathematics|5": { "acc": 0.3074074074074074, "acc_stderr": 0.028133252578815632, "acc_norm": 0.3074074074074074, "acc_norm_stderr": 0.028133252578815632 }, "harness|hendrycksTest-high_school_microeconomics|5": { "acc": 0.6596638655462185, "acc_stderr": 0.03077805742293167, "acc_norm": 0.6596638655462185, "acc_norm_stderr": 0.03077805742293167 }, "harness|hendrycksTest-high_school_physics|5": { "acc": 0.3841059602649007, "acc_stderr": 0.03971301814719197, "acc_norm": 0.3841059602649007, "acc_norm_stderr": 0.03971301814719197 }, "harness|hendrycksTest-high_school_psychology|5": { "acc": 0.8440366972477065, "acc_stderr": 0.015555802713590167, "acc_norm": 0.8440366972477065, "acc_norm_stderr": 0.015555802713590167 }, "harness|hendrycksTest-high_school_statistics|5": { "acc": 0.5462962962962963, "acc_stderr": 0.033953227263757976, "acc_norm": 0.5462962962962963, "acc_norm_stderr": 0.033953227263757976 }, "harness|hendrycksTest-high_school_us_history|5": { "acc": 0.8431372549019608, "acc_stderr": 0.02552472232455334, "acc_norm": 0.8431372549019608, "acc_norm_stderr": 0.02552472232455334 }, "harness|hendrycksTest-high_school_world_history|5": { "acc": 0.8016877637130801, "acc_stderr": 0.025955020841621112, "acc_norm": 0.8016877637130801, "acc_norm_stderr": 0.025955020841621112 }, "harness|hendrycksTest-human_aging|5": { "acc": 0.6860986547085202, "acc_stderr": 0.031146796482972465, "acc_norm": 0.6860986547085202, "acc_norm_stderr": 0.031146796482972465 }, "harness|hendrycksTest-human_sexuality|5": { "acc": 0.7862595419847328, "acc_stderr": 0.0359546161177469, "acc_norm": 0.7862595419847328, "acc_norm_stderr": 0.0359546161177469 }, "harness|hendrycksTest-international_law|5": { "acc": 0.7603305785123967, "acc_stderr": 0.03896878985070417, "acc_norm": 0.7603305785123967, "acc_norm_stderr": 0.03896878985070417 }, "harness|hendrycksTest-jurisprudence|5": { "acc": 0.7685185185185185, "acc_stderr": 0.04077494709252627, "acc_norm": 0.7685185185185185, "acc_norm_stderr": 0.04077494709252627 }, "harness|hendrycksTest-logical_fallacies|5": { "acc": 0.7791411042944786, "acc_stderr": 0.03259177392742178, "acc_norm": 0.7791411042944786, "acc_norm_stderr": 0.03259177392742178 }, "harness|hendrycksTest-machine_learning|5": { "acc": 0.42857142857142855, "acc_stderr": 0.04697113923010212, "acc_norm": 0.42857142857142855, "acc_norm_stderr": 0.04697113923010212 }, "harness|hendrycksTest-management|5": { "acc": 0.7766990291262136, "acc_stderr": 0.04123553189891431, "acc_norm": 0.7766990291262136, "acc_norm_stderr": 0.04123553189891431 }, "harness|hendrycksTest-marketing|5": { "acc": 0.8760683760683761, "acc_stderr": 0.02158649400128138, "acc_norm": 0.8760683760683761, "acc_norm_stderr": 0.02158649400128138 }, "harness|hendrycksTest-medical_genetics|5": { "acc": 0.7, "acc_stderr": 0.046056618647183814, "acc_norm": 0.7, "acc_norm_stderr": 0.046056618647183814 }, "harness|hendrycksTest-miscellaneous|5": { "acc": 0.8212005108556832, "acc_stderr": 0.01370264371536898, "acc_norm": 0.8212005108556832, "acc_norm_stderr": 0.01370264371536898 }, "harness|hendrycksTest-moral_disputes|5": { "acc": 0.7283236994219653, "acc_stderr": 0.02394851290546836, "acc_norm": 0.7283236994219653, "acc_norm_stderr": 0.02394851290546836 }, "harness|hendrycksTest-moral_scenarios|5": { "acc": 0.38324022346368714, "acc_stderr": 0.016260159604429125, "acc_norm": 0.38324022346368714, "acc_norm_stderr": 0.016260159604429125 }, "harness|hendrycksTest-nutrition|5": { "acc": 0.7026143790849673, "acc_stderr": 0.026173908506718576, "acc_norm": 0.7026143790849673, "acc_norm_stderr": 0.026173908506718576 }, "harness|hendrycksTest-philosophy|5": { "acc": 0.6977491961414791, "acc_stderr": 0.02608270069539966, "acc_norm": 0.6977491961414791, "acc_norm_stderr": 0.02608270069539966 }, "harness|hendrycksTest-prehistory|5": { "acc": 0.7530864197530864, "acc_stderr": 0.023993501709042117, "acc_norm": 0.7530864197530864, "acc_norm_stderr": 0.023993501709042117 }, "harness|hendrycksTest-professional_accounting|5": { "acc": 0.49645390070921985, "acc_stderr": 0.02982674915328092, "acc_norm": 0.49645390070921985, "acc_norm_stderr": 0.02982674915328092 }, "harness|hendrycksTest-professional_law|5": { "acc": 0.47783572359843546, "acc_stderr": 0.012757683047716174, "acc_norm": 0.47783572359843546, "acc_norm_stderr": 0.012757683047716174 }, "harness|hendrycksTest-professional_medicine|5": { "acc": 0.6911764705882353, "acc_stderr": 0.02806499816704009, "acc_norm": 0.6911764705882353, "acc_norm_stderr": 0.02806499816704009 }, "harness|hendrycksTest-professional_psychology|5": { "acc": 0.6862745098039216, "acc_stderr": 0.01877168389352818, "acc_norm": 0.6862745098039216, "acc_norm_stderr": 0.01877168389352818 }, "harness|hendrycksTest-public_relations|5": { "acc": 0.7090909090909091, "acc_stderr": 0.04350271442923243, "acc_norm": 0.7090909090909091, "acc_norm_stderr": 0.04350271442923243 }, "harness|hendrycksTest-security_studies|5": { "acc": 0.726530612244898, "acc_stderr": 0.028535560337128448, "acc_norm": 0.726530612244898, "acc_norm_stderr": 0.028535560337128448 }, "harness|hendrycksTest-sociology|5": { "acc": 0.8407960199004975, "acc_stderr": 0.025870646766169136, "acc_norm": 0.8407960199004975, "acc_norm_stderr": 0.025870646766169136 }, "harness|hendrycksTest-us_foreign_policy|5": { "acc": 0.86, "acc_stderr": 0.0348735088019777, "acc_norm": 0.86, "acc_norm_stderr": 0.0348735088019777 }, "harness|hendrycksTest-virology|5": { "acc": 0.536144578313253, "acc_stderr": 0.03882310850890594, "acc_norm": 0.536144578313253, "acc_norm_stderr": 0.03882310850890594 }, "harness|hendrycksTest-world_religions|5": { "acc": 0.8538011695906432, "acc_stderr": 0.02709729011807081, "acc_norm": 0.8538011695906432, "acc_norm_stderr": 0.02709729011807081 }, "harness|truthfulqa:mc|0": { "mc1": 0.5520195838433293, "mc1_stderr": 0.017408513063422913, "mc2": 0.726719785213627, "mc2_stderr": 0.014214257461390666 }, "harness|winogrande|5": { "acc": 0.8208366219415943, "acc_stderr": 0.010777949156047992 }, "harness|gsm8k|5": { "acc": 0.66868840030326, "acc_stderr": 0.012964999679688664 } }

5,000+

优质数据集

54 个

任务类型

进入经典数据集