open-llm-leaderboard-old/details_meraGPT__mera-mix-4x7B

Name: open-llm-leaderboard-old/details_meraGPT__mera-mix-4x7B
Creator: open-llm-leaderboard-old
Published: 2024-04-16 01:41:19
License: 暂无描述

Hugging Face2024-04-16 更新2024-06-22 收录

下载链接：

https://hf-mirror.com/datasets/open-llm-leaderboard-old/details_meraGPT__mera-mix-4x7B

下载链接

链接失效反馈

官方服务：

资源简介：

该数据集是在评估meraGPT/mera-mix-4x7B模型运行期间自动创建的，包含63个配置，每个配置对应一个评估任务。数据集由一次运行创建，每个运行在每个配置中作为一个特定的分割存在，分割名称使用运行的时间戳。此外，还有一个名为results的额外配置，存储了运行中的所有聚合结果，用于计算和显示在Open LLM Leaderboard上的聚合指标。

提供机构：

open-llm-leaderboard-old

原始信息汇总

数据集概述

数据集摘要

该数据集是在对模型 meraGPT/mera-mix-4x7B 进行评估运行期间自动创建的，用于 Open LLM Leaderboard。数据集包含 63 个配置，每个配置对应一个评估任务。数据集从 1 次运行中创建，每个运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。"train" 分割始终指向最新的结果。

数据集结构

数据集包含多个配置，每个配置对应不同的评估任务。以下是部分配置的详细信息：

配置示例

config_name: harness_arc_challenge_25
- data_files:
  - split: 2024_04_16T01_38_05.880148
    - path: **/details_harness|arc:challenge|25_2024-04-16T01-38-05.880148.parquet
  - split: latest
    - path: **/details_harness|arc:challenge|25_2024-04-16T01-38-05.880148.parquet
config_name: harness_gsm8k_5
- data_files:
  - split: 2024_04_16T01_38_05.880148
    - path: **/details_harness|gsm8k|5_2024-04-16T01-38-05.880148.parquet
  - split: latest
    - path: **/details_harness|gsm8k|5_2024-04-16T01-38-05.880148.parquet
config_name: harness_hellaswag_10
- data_files:
  - split: 2024_04_16T01_38_05.880148
    - path: **/details_harness|hellaswag|10_2024-04-16T01-38-05.880148.parquet
  - split: latest
    - path: **/details_harness|hellaswag|10_2024-04-16T01-38-05.880148.parquet
config_name: harness_hendrycksTest_5
- data_files:
  - split: 2024_04_16T01_38_05.880148
    - path:
      - **/details_harness|hendrycksTest-abstract_algebra|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-anatomy|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-astronomy|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-business_ethics|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-college_biology|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-college_chemistry|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-college_computer_science|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-college_mathematics|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-college_medicine|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-college_physics|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-computer_security|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-conceptual_physics|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-econometrics|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-electrical_engineering|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-formal_logic|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-global_facts|5_2024-04-16T01-38-05.880148.parquet
      - **/details_harness|hendrycksTest-high_school_biology|5_2024-04-16T01-38-05.880148.parquet

最新结果

以下是 2024-04-16T01:38:05.880148 运行的最新结果：

python { "all": { "acc": 0.6503285450675976, "acc_stderr": 0.03207933858854692, "acc_norm": 0.6499992637050008, "acc_norm_stderr": 0.03274923464299276, "mc1": 0.6217870257037944, "mc1_stderr": 0.016976335907546866, "mc2": 0.77168306520371, "mc2_stderr": 0.013809257106847805 }, "harness|arc:challenge|25": { "acc": 0.7039249146757679, "acc_stderr": 0.01334091608524626, "acc_norm": 0.7295221843003413, "acc_norm_stderr": 0.012980954547659556 }, "harness|hellaswag|10": { "acc": 0.7198765186217885, "acc_stderr": 0.00448141618049963, "acc_norm": 0.8916550487950607, "acc_norm_stderr": 0.0031018035745563103 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.34, "acc_stderr": 0.04760952285695235, "acc_norm": 0.34, "acc_norm_stderr": 0.04760952285695235 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.6296296296296297, "acc_stderr": 0.041716541613545426, "acc_norm": 0.6296296296296297, "acc_norm_stderr": 0.041716541613545426 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.7039473684210527, "acc_stderr": 0.03715062154998904, "acc_norm": 0.7039473684210527, "acc_norm_stderr": 0.03715062154998904 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.63, "acc_stderr": 0.04852365870939099, "acc_norm": 0.63, "acc_norm_stderr": 0.04852365870939099 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.7094339622641509, "acc_stderr": 0.027943219989337124, "acc_norm": 0.7094339622641509, "acc_norm_stderr": 0.027943219989337124 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.7638888888888888, "acc_stderr": 0.03551446610810826, "acc_norm": 0.7638888888888888, "acc_norm_stderr": 0.03551446610810826 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.47, "acc_stderr": 0.050161355804659205, "acc_norm": 0.47, "acc_norm_stderr": 0.050161355804659205 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.56, "acc_stderr": 0.049888765156985884, "acc_norm": 0.56, "acc_norm_stderr": 0.049888765156985884 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.3, "acc_stderr": 0.046056618647183814, "acc_norm": 0.3, "acc_norm_stderr": 0.046056618647183814 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.6473988439306358, "acc_stderr": 0.036430371689585475, "acc_norm": 0.6473988439306358, "acc_norm_stderr": 0.036430371689585475 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.37254901960784315, "acc_stderr": 0.04810840148082635, "acc_norm": 0.37254901960784315, "acc_norm_stderr": 0.04810840148082635 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.76, "acc_stderr": 0.04292346959909282, "acc_norm": 0.76, "acc_norm_stderr": 0.04292346959909282 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.5617021276595745, "acc_stderr": 0.03243618636108102, "acc_norm": 0.5617021276595745, "acc_norm_stderr": 0.03243618636108102 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.49122807017543857, "acc_stderr": 0.04702880432049615, "acc_norm": 0.49122807017543857, "acc_norm_stderr": 0.04702880432049615 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.5448275862068965, "acc_stderr": 0.04149886942192117, "acc_norm": 0.5448275862068965, "acc_norm_

5,000+

优质数据集

54 个

任务类型

进入经典数据集