five

open-llm-leaderboard-old/details_chatty123__mistral_rank32_invert

收藏
Hugging Face2024-04-15 更新2024-06-22 收录
下载链接：
https://hf-mirror.com/datasets/open-llm-leaderboard-old/details_chatty123__mistral_rank32_invert
下载链接
链接失效反馈
官方服务：
资源简介：
该数据集是在评估模型chatty123/mistral_rank32_invert在Open LLM Leaderboard上的表现时自动生成的。数据集包含63个配置，每个配置对应一个评估任务。数据集由1次运行生成，每次运行的结果作为一个特定的分割存储在配置中，分割名称使用运行的时间戳。train分割始终指向最新的结果。此外，还有一个名为results的配置存储了所有运行的聚合结果，用于计算和显示在Open LLM Leaderboard上的聚合指标。

该数据集是在评估模型chatty123/mistral_rank32_invert在Open LLM Leaderboard上的表现时自动生成的。数据集包含63个配置，每个配置对应一个评估任务。数据集由1次运行生成，每次运行的结果作为一个特定的分割存储在配置中，分割名称使用运行的时间戳。train分割始终指向最新的结果。此外，还有一个名为results的配置存储了所有运行的聚合结果，用于计算和显示在Open LLM Leaderboard上的聚合指标。
提供机构：
open-llm-leaderboard-old
原始信息汇总

数据集概述

该数据集是在模型 chatty123/mistral_rank32_invert 在 Open LLM Leaderboard 上的评估运行期间自动创建的。

数据集组成

  • 数据集由 63 个配置组成，每个配置对应一个评估任务。
  • 数据集从 1 次运行中创建。每个运行可以在每个配置中作为一个特定的分片找到，分片名称使用运行的时间戳。
  • "train" 分片始终指向最新的结果。
  • 一个额外的配置 "results" 存储所有运行的聚合结果，用于计算和显示 Open LLM Leaderboard 上的聚合指标。

最新结果

以下是 2024-04-15T18:56:20.691515 运行的最新结果：

python { "all": { "acc": 0.5963459156241223, "acc_stderr": 0.03334804643106429, "acc_norm": 0.6017021726171937, "acc_norm_stderr": 0.03403695297458732, "mc1": 0.38922888616891066, "mc1_stderr": 0.017068552680690328, "mc2": 0.5617709613227319, "mc2_stderr": 0.015145399162234476 }, "harness|arc:challenge|25": { "acc": 0.5170648464163823, "acc_stderr": 0.0146028783885366, "acc_norm": 0.5571672354948806, "acc_norm_stderr": 0.014515573873348892 }, "harness|hellaswag|10": { "acc": 0.6074487153953396, "acc_stderr": 0.004873203269366312, "acc_norm": 0.8119896434973113, "acc_norm_stderr": 0.0038992191786572285 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.34, "acc_stderr": 0.047609522856952365, "acc_norm": 0.34, "acc_norm_stderr": 0.047609522856952365 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.562962962962963, "acc_stderr": 0.04284958639753401, "acc_norm": 0.562962962962963, "acc_norm_stderr": 0.04284958639753401 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.6118421052631579, "acc_stderr": 0.03965842097512744, "acc_norm": 0.6118421052631579, "acc_norm_stderr": 0.03965842097512744 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.56, "acc_stderr": 0.04988876515698589, "acc_norm": 0.56, "acc_norm_stderr": 0.04988876515698589 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.660377358490566, "acc_stderr": 0.02914690474779833, "acc_norm": 0.660377358490566, "acc_norm_stderr": 0.02914690474779833 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.6458333333333334, "acc_stderr": 0.039994111357535424, "acc_norm": 0.6458333333333334, "acc_norm_stderr": 0.039994111357535424 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.4, "acc_stderr": 0.04923659639173309, "acc_norm": 0.4, "acc_norm_stderr": 0.04923659639173309 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.5, "acc_stderr": 0.050251890762960605, "acc_norm": 0.5, "acc_norm_stderr": 0.050251890762960605 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.37, "acc_stderr": 0.048523658709391, "acc_norm": 0.37, "acc_norm_stderr": 0.048523658709391 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.6184971098265896, "acc_stderr": 0.037038511930995215, "acc_norm": 0.6184971098265896, "acc_norm_stderr": 0.037038511930995215 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.38235294117647056, "acc_stderr": 0.04835503696107224, "acc_norm": 0.38235294117647056, "acc_norm_stderr": 0.04835503696107224 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.72, "acc_stderr": 0.04512608598542129, "acc_norm": 0.72, "acc_norm_stderr": 0.04512608598542129 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.5319148936170213, "acc_stderr": 0.03261936918467381, "acc_norm": 0.5319148936170213, "acc_norm_stderr": 0.03261936918467381 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.43859649122807015, "acc_stderr": 0.04668000738510455, "acc_norm": 0.43859649122807015, "acc_norm_stderr": 0.04668000738510455 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.5586206896551724, "acc_stderr": 0.04137931034482758, "acc_norm": 0.5586206896551724, "acc_norm_stderr": 0.04137931034482758 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.41798941798941797, "acc_stderr": 0.025402555503260912, "acc_norm": 0.41798941798941797, "acc_norm_stderr": 0.025402555503260912 }, "harness|hendrycksTest-formal_logic|5": { "acc": 0.3888888888888889, "acc_stderr": 0.04360314860077459, "acc_norm": 0.3888888888888889, "acc_norm_stderr": 0.04360314860077459 }, "harness|hendrycksTest-global_facts|5": { "acc": 0.39, "acc_stderr": 0.04902071300001974, "acc_norm": 0.39, "acc_norm_stderr": 0.04902071300001974 }, "harness|hendrycksTest-high_school_biology|5": { "acc": 0.6709677419354839, "acc_stderr": 0.02672949906834996, "acc_norm": 0.6709677419354839, "acc_norm_stderr": 0.02672949906834996 }, "harness|hendrycksTest-high_school_chemistry|5": { "acc": 0.4827586206896552, "acc_stderr": 0.035158955511656986, "acc_norm": 0.4827586206896552, "acc_norm_stderr": 0.035158955511656986 }, "harness|hendrycksTest-high_school_computer_science|5": { "acc": 0.6, "acc_stderr": 0.049236596391733084, "acc_norm": 0.6, "acc_norm_stderr": 0.049236596391733084 }, "harness|hendrycksTest-high_school_european_history|5": { "acc": 0.7090909090909091, "acc_stderr": 0.03546563019624336, "acc_norm": 0.7090909090909091, "acc_norm_stderr": 0.03546563019624336 }, "harness|hendrycksTest-high_school_geography|5": { "acc": 0.7727272727272727, "acc_stderr": 0.029857515673386417, "acc_norm": 0.7727272727272727, "acc_norm_stderr": 0.029857515673386417 }, "harness|hendrycksTest-high_school_government_and_politics|5": { "acc": 0.8393782383419689, "acc_stderr": 0.026499057701397467, "acc_norm": 0.8393782383419689, "acc_norm_stderr": 0.026499057701397467 }, "harness|hendrycksTest-high_school_macroeconomics|5": { "acc": 0.558974358974359, "acc_stderr": 0.025174048384000745, "acc_norm": 0.558974358974359, "acc_norm_stderr": 0.025174048384000745 }, "harness|hendrycksTest-high_school_mathematics|5": { "acc": 0.34814814814814815, "acc_stderr": 0.029045600290616255, "acc_norm": 0.34814814814814815, "acc_norm_stderr": 0.029045600290616255 }, "harness|hendrycksTest-high_school_microeconomics|5": { "acc": 0.6218487394957983, "acc_stderr": 0.031499305777849054, "acc_norm": 0.6218487394957983, "acc_norm_stderr": 0.031499305777849054 }, "harness|hendrycksTest-high_school_physics|5": { "acc": 0.3576158940397351, "acc_stderr": 0.03913453431177258, "acc_norm": 0.3576158940397351, "acc_norm_stderr": 0.03913453431177258 }, "harness|hendrycksTest-high_school_psychology|5": { "acc": 0.7926605504587156, "acc_stderr": 0.017381415563608674, "acc_norm": 0.7926605504587156, "acc_norm_stderr": 0.017381415563608674 }, "harness|hendrycksTest-high_school_statistics|5": { "acc": 0.46296296296296297, "acc_stderr": 0.03400603625538272, "acc_norm": 0.46296296296296297, "acc_norm_stderr": 0.03400603625538272 }, "harness|hendrycksTest-high_school_us_history|5": { "acc": 0.75, "acc_stderr": 0.03039153369274154, "acc_norm": 0.75, "acc_norm_stderr": 0.03039153369274154 }, "harness|hendrycksTest-high_school_world_history|5": { "acc": 0.7215189873417721, "acc_stderr": 0.029178682304842548, "acc_norm": 0.7215189873417721, "acc_norm_stderr": 0.029178682304842548 }, "harness|hendrycksTest-human_aging|5": { "acc": 0.6322869955156951, "acc_stderr": 0.032361983509282745, "acc_norm": 0.6322869955156951, "acc_norm_stderr": 0.032361983509282745 }, "harness|hendrycksTest-human_sexuality|5": { "acc": 0.6870229007633588, "acc_stderr": 0.04066962905677698, "acc_norm": 0.6870229007633588, "acc_norm_stderr": 0.04066962905677698 }, "harness|hendrycksTest-international_law|5": { "acc": 0.8099173553719008, "acc_stderr": 0.03581796951709282, "acc_norm": 0.8099173553719008, "acc_norm_stderr": 0.03581796951709282 }, "harness|hendrycksTest-jurisprudence|5": { "acc": 0.7314814814814815, "acc_stderr": 0.042844679680521934, "acc_norm": 0.7314814814814815, "acc_norm_stderr": 0.042844679680521934 }, "harness|hendrycksTest-logical_fallacies|5": { "acc": 0.7116564417177914, "acc_stderr": 0.03559039531617342, "acc_norm": 0.7116564417177914, "acc_norm_stderr": 0.03559039531617342 }, "harness|hendrycksTest-machine_learning|5": { "acc": 0.4642857142857143, "acc_stderr": 0.04733667890053756, "acc_norm": 0.4642857142857143, "acc_norm_stderr": 0.04733667890053756 }, "harness|hendrycksTest-management|5": { "acc": 0.7281553398058253, "acc_stderr": 0.044052680241409216, "acc_norm": 0.7281553398058253, "acc_norm_stderr": 0.044052680241409216 }, "harness|hendrycksTest-marketing|5": { "acc": 0.8675213675213675, "acc_stderr": 0.02220930907316561, "acc_norm": 0.8675213675213675, "acc_norm_stderr": 0.02220930907316561 }, "harness|hendrycksTest-medical_genetics|5": { "acc": 0.64, "acc_stderr": 0.04824181513244218, "acc_norm": 0.64, "acc_norm_stderr": 0.04824181513244218 }, "harness|hendrycksTest-miscellaneous|5": { "acc": 0.7701149425287356, "acc_stderr": 0.015046301846691814, "acc_norm": 0.7701149425287356, "acc_norm_stderr": 0.015046301846691814 }, "harness|hendrycksTest-moral_disputes|5": { "acc": 0.6502890173410405, "acc_stderr": 0.025674281456531015, "acc_norm": 0.6502890173410405, "acc_norm_stderr": 0.025674281456531015 }, "harness|hendrycksTest-moral_scenarios|5": { "acc": 0.2994413407821229, "acc_stderr": 0.015318257745976708, "acc_norm": 0.2994413407821229, "acc_norm_stderr": 0.015318257745976708 }, "harness|hendrycksTest-nutrition|5": { "acc": 0.6568627450980392, "acc_stderr": 0.02718449890994161, "acc_norm": 0.6568627450980392, "acc_norm_stderr": 0.02718449890994161 }, "harness|hendrycksTest-philosophy|5": { "acc": 0.684887459807074, "acc_stderr": 0.026385273703464485, "acc_norm": 0.684887459807074, "acc_norm_stderr": 0.026385273703464485 }, "harness|hendrycksTest-prehistory|5": { "acc": 0.6604938271604939, "acc_stderr": 0.026348564412011617, "acc_norm": 0.6604938271604939, "acc_norm_stderr": 0.026348564412011617 }, "harness|hendrycksTest-professional_accounting|5": { "acc": 0.43617021276595747, "acc_stderr": 0.029583452036284066, "acc_norm": 0.43617021276595747, "acc_norm_stderr": 0.029583452036284066 }, "harness|hendrycksTest-professional_law|5": { "acc": 0.4230769230769231, "acc_stderr": 0.012618204066588389, "acc_norm": 0.4230769230769231, "acc_norm_stderr": 0.012618204066588389 }, "harness|hendrycksTest-professional_medicine|5": { "acc": 0.5919117647058824, "acc_stderr": 0.029855261393483924, "acc_norm": 0.5919117647058824, "acc_norm_stderr": 0.029855261393483924 }, "harness|hendrycksTest-professional_psychology|5": { "acc": 0.5947712418300654, "acc_stderr": 0.019861155193829163, "acc_norm": 0.5947712418300654, "acc_norm_stderr": 0.019861155193829163 }, "harness|hendrycksTest-public_relations|5": { "acc": 0.6363636363636364, "acc_stderr": 0.04607582090719976, "acc_norm": 0.6363636363636364, "acc_norm_stderr": 0.04607582090719976 }, "harness|hendrycksTest-security_studies|5": { "acc": 0.7183673469387755, "acc_stderr": 0.02879518557429129, "acc_norm": 0.7183673469387755, "acc_norm_stderr": 0.02879518557429129 }, "harness|hendrycksTest-sociology|5": { "acc": 0.8208955223880597, "acc_stderr": 0.027113286753111837, "acc_norm": 0.8208955223880597, "acc_norm_stderr": 0.027113286753111837 }, "harness|hendrycksTest-us_foreign_policy|5": { "acc": 0.84, "acc_stderr": 0.03684529491774708, "acc_norm": 0.84, "acc_norm_stderr": 0.03684529491774708 }, "harness|hendrycksTest-virology|5": { "acc": 0.4759036144578313, "acc_stderr": 0.038879718495972646, "acc_norm": 0.4759036144578313, "acc_norm_stderr": 0.038879718495972646 }, "harness|hendrycksTest-world_religions|5": { "acc": 0.8128654970760234, "acc_stderr": 0.02991312723236804, "acc_norm": 0.8128654970760234, "acc_norm_stderr": 0.02991312723236804 }, "harness|truthfulqa:mc|0": { "mc1": 0.38922888616891066, "mc1_stderr": 0.017068552680690328, "mc2": 0.5617709613227319, "mc2_stderr": 0.015145399162234476 }, "harness|winogrande|5": { "acc": 0.7695343330702447, "acc_stderr": 0.011835872164836673 }, "harness|gsm8k|5": { "acc": 0.35178165276724793, "acc_stderr": 0.013153446023536033 } }

数据集配置

以下是数据集的配置信息：

  • 配置名称: harness_arc_challenge_25

    • 数据文件:
      • 分片: 2024_04_15T18_56_20.691515
        • 路径: **/details_harness|arc:challenge|25_2024-04-15T18-56-20.691515.parquet
      • 分片: latest
        • 路径: **/details_harness|arc:challenge|25_2024-04-15T18-56-20.691515.parquet

  • 配置名称: harness_gsm8k_5

    • 数据文件:
      • 分片: 2024_04_15T18_56_20.691515
        • 路径: **/details_harness|gsm8k|5_2024-04-15T18-56-20.691515.parquet
      • 分片: latest
        • 路径: **/details_harness|gsm8k|5_2024-04-15T18-56-20.691515.parquet

  • 配置名称: harness_hellaswag_10

    • 数据文件:
      • 分片: 2024_04_15T18_56_20.691515
        • 路径: **/details_harness|hellaswag|10_2024-04-15T18-56-20.691515.parquet
      • 分片: latest
        • 路径: **/details_harness|hellaswag|10_2024-04-15T18-56-20.691515.parquet

  • 配置名称: harness_hendrycksTest_5

    • 数据文件:
      • 分片: 2024_04_15T18_56_20.691515
        • 路径:
          • **/details_harness|hendrycksTest-abstract_algebra|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-anatomy|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-astronomy|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-business_ethics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-college_biology|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-college_chemistry|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-college_computer_science|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-college_mathematics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-college_medicine|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-college_physics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-computer_security|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-conceptual_physics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-econometrics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-electrical_engineering|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-formal_logic|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-global_facts|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_biology|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_european_history|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_geography|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_physics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_psychology|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_statistics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_us_history|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-high_school_world_history|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-human_aging|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-human_sexuality|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-international_law|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-jurisprudence|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-logical_fallacies|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-machine_learning|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-management|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-marketing|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-medical_genetics|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-miscellaneous|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-moral_disputes|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-moral_scenarios|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-nutrition|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-philosophy|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-prehistory|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-professional_accounting|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-professional_law|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-professional_medicine|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-professional_psychology|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-public_relations|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-security_studies|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-sociology|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-virology|5_2024-04-15T18-56-20.691515.parquet
          • **/details_harness|hendrycksTest-world_religions|5_2024-04-15T18-56-20.691515.parquet
5,000+
优质数据集
54 个
任务类型
进入经典数据集
关于我们
遇见数据集——让每个数据集都被发现，让每一次遇见都有价值。
数发科官网www.sfktec.com.cn
联系我们
youjian
selectdataset@iotsh.com.cn
商业合作
数据驱动未来，携手共赢发展
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作