open-llm-leaderboard-old/details_KnutJaegersberg__Nanbeige-16B-Base-32K-llama

Name: open-llm-leaderboard-old/details_KnutJaegersberg__Nanbeige-16B-Base-32K-llama
Creator: open-llm-leaderboard-old
Published: 2024-01-16 17:56:50
License: 暂无描述

Hugging Face2024-01-16 更新2024-06-22 收录

下载链接：

https://hf-mirror.com/datasets/open-llm-leaderboard-old/details_KnutJaegersberg__Nanbeige-16B-Base-32K-llama

下载链接

链接失效反馈

官方服务：

资源简介：

该数据集是在Open LLM Leaderboard上对模型KnutJaegersberg/Nanbeige-16B-Base-32K-llama进行评估时自动创建的。数据集由63个配置组成，每个配置对应一个评估任务。数据集是从1次运行中创建的，每次运行可以在每个配置中找到特定的分割，分割以运行的时间戳命名。train分割始终指向最新的结果。此外，一个名为results的配置存储了所有运行的聚合结果，并用于计算和显示在Open LLM Leaderboard上的聚合指标。

提供机构：

open-llm-leaderboard-old

原始信息汇总

数据集概述

数据集摘要

该数据集是在评估模型 KnutJaegersberg/Nanbeige-16B-Base-32K-llama 在 Open LLM Leaderboard 上的自动创建的。数据集包含 63 个配置，每个配置对应一个评估任务。数据集从 1 次运行中创建，每个运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。"train" 分割始终指向最新的结果。

数据集结构

数据集包含多个配置，每个配置对应不同的评估任务。以下是部分配置的详细信息：

配置示例

config_name: harness_arc_challenge_25
- data_files:
  - split: 2024_01_16T17_54_07.755069
    - path: **/details_harness|arc:challenge|25_2024-01-16T17-54-07.755069.parquet
  - split: latest
    - path: **/details_harness|arc:challenge|25_2024-01-16T17-54-07.755069.parquet
config_name: harness_gsm8k_5
- data_files:
  - split: 2024_01_16T17_54_07.755069
    - path: **/details_harness|gsm8k|5_2024-01-16T17-54-07.755069.parquet
  - split: latest
    - path: **/details_harness|gsm8k|5_2024-01-16T17-54-07.755069.parquet
config_name: harness_hellaswag_10
- data_files:
  - split: 2024_01_16T17_54_07.755069
    - path: **/details_harness|hellaswag|10_2024-01-16T17-54-07.755069.parquet
  - split: latest
    - path: **/details_harness|hellaswag|10_2024-01-16T17-54-07.755069.parquet
config_name: harness_hendrycksTest_5
- data_files:
  - split: 2024_01_16T17_54_07.755069
    - path:
      - **/details_harness|hendrycksTest-abstract_algebra|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-anatomy|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-astronomy|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-business_ethics|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-clinical_knowledge|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-college_biology|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-college_chemistry|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-college_computer_science|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-college_mathematics|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-college_medicine|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-college_physics|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-computer_security|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-conceptual_physics|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-econometrics|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-electrical_engineering|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-elementary_mathematics|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-formal_logic|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-global_facts|5_2024-01-16T17-54-07.755069.parquet
      - **/details_harness|hendrycksTest-high_school_biology|5_2024-01-16T17-54-07.755069.parquet
      - ...

最新结果

以下是 2024-01-16T17:54:07.755069 运行的最新结果：

python { "all": { "acc": 0.4511351260863433, "acc_stderr": 0.03174859727422269, "acc_norm": 0.4577622215400404, "acc_norm_stderr": 0.03255795969436768, "mc1": 1.0, "mc1_stderr": 0.0, "mc2": NaN, "mc2_stderr": NaN }, "harness|arc:challenge|25": { "acc": 0.43430034129692835, "acc_stderr": 0.01448470304885736, "acc_norm": 0.4761092150170648, "acc_norm_stderr": 0.014594701798071654 }, "harness|hellaswag|10": { "acc": 0.5440151364270066, "acc_stderr": 0.004970410081009455, "acc_norm": 0.7308305118502291, "acc_norm_stderr": 0.004426217654917996 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.32, "acc_stderr": 0.046882617226215034, "acc_norm": 0.32, "acc_norm_stderr": 0.046882617226215034 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.5111111111111111, "acc_stderr": 0.04318275491977976, "acc_norm": 0.5111111111111111, "acc_norm_stderr": 0.04318275491977976 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.5855263157894737, "acc_stderr": 0.04008973785779206, "acc_norm": 0.5855263157894737, "acc_norm_stderr": 0.04008973785779206 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.58, "acc_stderr": 0.049604496374885836, "acc_norm": 0.58, "acc_norm_stderr": 0.049604496374885836 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.6075471698113207, "acc_stderr": 0.03005258057955785, "acc_norm": 0.6075471698113207, "acc_norm_stderr": 0.03005258057955785 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.6041666666666666, "acc_stderr": 0.04089465449325583, "acc_norm": 0.6041666666666666, "acc_norm_stderr": 0.04089465449325583 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.2, "acc_stderr": 0.04020151261036845, "acc_norm": 0.2, "acc_norm_stderr": 0.04020151261036845 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.26, "acc_stderr": 0.0440844002276808, "acc_norm": 0.26, "acc_norm_stderr": 0.0440844002276808 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.21, "acc_stderr": 0.040936018074033256, "acc_norm": 0.21, "acc_norm_stderr": 0.040936018074033256 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.20809248554913296, "acc_stderr": 0.030952890217749874, "acc_norm": 0.20809248554913296, "acc_norm_stderr": 0.030952890217749874 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.21568627450980393, "acc_stderr": 0.04092563958237654, "acc_norm": 0.21568627450980393, "acc_norm_stderr": 0.04092563958237654 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.72, "acc_stderr": 0.04512608598542128, "acc_norm": 0.72, "acc_norm_stderr": 0.04512608598542128 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.49361702127659574, "acc_stderr": 0.03268335899936338, "acc_norm": 0.49361702127659574, "acc_norm_stderr": 0.03268335899936338 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.23684210526315788, "acc_stderr": 0.039994238792813365, "acc_norm": 0.23684210526315788, "acc_norm_stderr": 0.039994238792813365 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.2413793103448276, "acc_stderr": 0.03565998174135302, "acc_norm": 0.2413793103448276, "acc_norm_stderr": 0.03565998174135302 }, "harness

5,000+

优质数据集

54 个

任务类型

进入经典数据集