open-llm-leaderboard-old/details_SUSTech__SUS-Chat-72B

该数据集是在评估模型SUSTech/SUS-Chat-72B时自动创建的，用于Open LLM Leaderboard的评估。数据集由63个配置组成，每个配置对应一个评估任务。数据集从1次运行中创建，每次运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。train分割始终指向最新的结果。此外，results配置存储了所有运行的聚合结果，并用于计算和显示Open LLM Leaderboard上的聚合指标。

原始信息汇总

数据集概述

数据集摘要

该数据集是在模型 SUSTech/SUS-Chat-72B 在 Open LLM Leaderboard 上的评估运行期间自动创建的。数据集包含 63 个配置，每个配置对应一个评估任务。数据集从 1 次运行中创建，每次运行的详细结果存储在特定的分割中，分割名称使用运行的时间戳。"train" 分割始终指向最新的结果。

数据集结构

• 配置数量: 63
• 运行次数: 1
• 分割命名: 使用运行的时间戳
• "train" 分割: 指向最新的结果

数据加载示例

python from datasets import load_dataset data = load_dataset("open-llm-leaderboard/details_SUSTech__SUS-Chat-72B", "harness_winogrande_5", split="train")

最新结果

以下是 2023-12-30T08:38:52.255652 运行 的最新结果：

python { "all": { "acc": 0.7531471665521513, "acc_stderr": 0.028005234629175594, "acc_norm": 0.7666170688561996, "acc_norm_stderr": 0.028617434882601496, "mc1": 0.44063647490820074, "mc1_stderr": 0.017379697555437446, "mc2": 0.6026834780213507, "mc2_stderr": 0.014913414941903928 }, "harness|arc:challenge|25": { "acc": 0.6373720136518771, "acc_stderr": 0.014049106564955002, "acc_norm": 0.6629692832764505, "acc_norm_stderr": 0.013813476652902274 }, "harness|hellaswag|10": { "acc": 0.6585341565425215, "acc_stderr": 0.004732322172153752, "acc_norm": 0.849631547500498, "acc_norm_stderr": 0.0035670171422264854 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.42, "acc_stderr": 0.049604496374885836, "acc_norm": 0.42, "acc_norm_stderr": 0.049604496374885836 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.725925925925926, "acc_stderr": 0.038532548365520045, "acc_norm": 0.725925925925926, "acc_norm_stderr": 0.038532548365520045 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.868421052631579, "acc_stderr": 0.027508689533549915, "acc_norm": 0.868421052631579, "acc_norm_stderr": 0.027508689533549915 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.8, "acc_stderr": 0.040201512610368445, "acc_norm": 0.8, "acc_norm_stderr": 0.040201512610368445 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.8301886792452831, "acc_stderr": 0.02310839379984133, "acc_norm": 0.8301886792452831, "acc_norm_stderr": 0.02310839379984133 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.8958333333333334, "acc_stderr": 0.025545239210256917, "acc_norm": 0.8958333333333334, "acc_norm_stderr": 0.025545239210256917 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.54, "acc_stderr": 0.05009082659620333, "acc_norm": 0.54, "acc_norm_stderr": 0.05009082659620333 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.61, "acc_stderr": 0.04902071300001975, "acc_norm": 0.61, "acc_norm_stderr": 0.04902071300001975 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.44, "acc_stderr": 0.04988876515698589, "acc_norm": 0.44, "acc_norm_stderr": 0.04988876515698589 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.7514450867052023, "acc_stderr": 0.03295304696818317, "acc_norm": 0.7514450867052023, "acc_norm_stderr": 0.03295304696818317 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.5588235294117647, "acc_stderr": 0.049406356306056595, "acc_norm": 0.5588235294117647, "acc_norm_stderr": 0.049406356306056595 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.82, "acc_stderr": 0.03861229196653695, "acc_norm": 0.82, "acc_norm_stderr": 0.03861229196653695 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.7872340425531915, "acc_stderr": 0.02675439134803977, "acc_norm": 0.7872340425531915, "acc_norm_stderr": 0.02675439134803977 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.6052631578947368, "acc_stderr": 0.045981880578165414, "acc_norm": 0.6052631578947368, "acc_norm_stderr": 0.045981880578165414 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.8, "acc_stderr": 0.03333333333333329, "acc_norm": 0.8, "acc_norm_stderr": 0.03333333333333329 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.671957671957672, "acc_stderr": 0.024180497164376896, "acc_norm": 0.671957671957672, "acc_norm_stderr": 0.024180497164376896 }, "harness|hendrycksTest-formal_logic|5": { "acc": 0.5555555555555556, "acc_stderr": 0.04444444444444449, "acc_norm": 0.5555555555555556, "acc_norm_stderr": 0.04444444444444449 }, "harness|hendrycksTest-global_facts|5": { "acc": 0.49, "acc_stderr": 0.05024183937956912, "acc_norm": 0.49, "acc_norm_stderr": 0.05024183937956912 }, "harness|hendrycksTest-high_school_biology|5": { "acc": 0.8870967741935484, "acc_stderr": 0.01800360332586361, "acc_norm": 0.8870967741935484, "acc_norm_stderr": 0.01800360332586361 }, "harness|hendrycksTest-high_school_chemistry|5": { "acc": 0.6798029556650246, "acc_stderr": 0.032826493853041504, "acc_norm": 0.6798029556650246, "acc_norm_stderr": 0.032826493853041504 }, "harness|hendrycksTest-high_school_computer_science|5": { "acc": 0.84, "acc_stderr": 0.03684529491774709, "acc_norm": 0.84, "acc_norm_stderr": 0.03684529491774709 }, "harness|hendrycksTest-high_school_european_history|5": { "acc": 0.8545454545454545, "acc_stderr": 0.027530196355066584, "acc_norm": 0.8545454545454545, "acc_norm_stderr": 0.027530196355066584 }, "harness|hendrycksTest-high_school_geography|5": { "acc": 0.9292929292929293, "acc_stderr": 0.01826310542019951, "acc_norm": 0.9292929292929293, "acc_norm_stderr": 0.01826310542019951 }, "harness|hendrycksTest-high_school_government_and_politics|5": { "acc": 0.9792746113989638, "acc_stderr": 0.010281417011909046, "acc_norm": 0.9792746113989638, "acc_norm_stderr": 0.010281417011909046 }, "harness|hendrycksTest-high_school_macroeconomics|5": { "acc": 0.8205128205128205, "acc_stderr": 0.019457390787681786, "acc_norm": 0.8205128205128205, "acc_norm_stderr": 0.019457390787681786 }, "harness|hendrycksTest-high_school_mathematics|5": { "acc": 0.45185185185185184, "acc_stderr": 0.030343862998512636, "acc_norm": 0.45185185185185184, "acc_norm_stderr": 0.030343862998512636 }, "harness|hendrycksTest-high_school_microeconomics|5": { "acc": 0.85