open-llm-leaderboard/details_ehartford__Wizard-Vicuna-30B-Uncensored

该数据集是在Open LLM Leaderboard上对模型ehartford/Wizard-Vicuna-30B-Uncensored进行评估时自动创建的。数据集由64个配置组成，每个配置对应一个评估任务。数据集由2次运行生成，每次运行的结果作为特定配置中的一个分割，分割名称使用运行的时间戳。train分割始终指向最新的结果。此外，还有一个名为results的配置存储了所有运行的聚合结果，并用于在Open LLM Leaderboard上计算和显示聚合指标。

This dataset was automatically created during the evaluation of the model ehartford/Wizard-Vicuna-30B-Uncensored on the Open LLM Leaderboard. It comprises 64 configurations, each corresponding to a single evaluation task. The dataset is generated from two runs, where the results of each run serve as a split under a specific configuration, with the split name being the timestamp of the corresponding run. The 'train' split always points to the most recent results. Additionally, there is a configuration named 'results' that stores the aggregated results of all runs, and is used to compute and display the aggregated metrics on the Open LLM Leaderboard.

原始信息汇总

数据集概述

数据集简介

该数据集是在评估模型ehartford/Wizard-Vicuna-30B-Uncensored在Open LLM Leaderboard上的自动创建的。数据集包含64个配置，每个配置对应一个评估任务。

数据集结构

数据集由2次运行创建，每次运行的结果可以在每个配置中找到，以运行的时间戳命名的特定分片形式存在。"train"分片始终指向最新的结果。

额外配置

一个额外的配置"results"存储了所有运行结果的聚合，用于计算和显示在Open LLM Leaderboard上的聚合指标。

数据加载示例

python from datasets import load_dataset data = load_dataset("open-llm-leaderboard/details_ehartford__Wizard-Vicuna-30B-Uncensored", "harness_winogrande_5", split="train")

最新结果

以下是最新结果： python { "all": { "em": 0.18162751677852348, "em_stderr": 0.0039482621737543045, "f1": 0.2674087667785243, "f1_stderr": 0.004012090110572664, "acc": 0.46353130406008236, "acc_stderr": 0.01059244186586655 }, "harness|drop|3": { "em": 0.18162751677852348, "em_stderr": 0.0039482621737543045, "f1": 0.2674087667785243, "f1_stderr": 0.004012090110572664 }, "harness|gsm8k|5": { "acc": 0.1425322213798332, "acc_stderr": 0.009629588445673819 }, "harness|winogrande|5": { "acc": 0.7845303867403315, "acc_stderr": 0.011555295286059279 } }

配置详情

配置列表

• harness_arc_challenge_25
• harness_drop_3
• harness_gsm8k_5
• harness_hellaswag_10
• harness_hendrycksTest_5
• harness_hendrycksTest_abstract_algebra_5
• harness_hendrycksTest_anatomy_5
• harness_hendrycksTest_astronomy_5
• harness_hendrycksTest_business_ethics_5
• harness_hendrycksTest_clinical_knowledge_5
• harness_hendrycksTest_college_biology_5
• harness_hendrycksTest_college_chemistry_5
• harness_hendrycksTest_college_computer_science_5
• harness_hendrycksTest_college_mathematics_5
• harness_hendrycksTest_college_medicine_5
• harness_hendrycksTest_college_physics_5
• harness_hendrycksTest_computer_security_5
• harness_hendrycksTest_conceptual_physics_5
• harness_hendrycksTest_econometrics_5
• harness_hendrycksTest_electrical_engineering_5
• harness_hendrycksTest_elementary_mathematics_5