open-llm-leaderboard-old/details_NeuralNovel__Valor-7B-v0.1

--- pretty_name: Evaluation run of NeuralNovel/Valor-7B-v0.1 dataset_summary: "Dataset automatically created during the evaluation run of model\ \ [NeuralNovel/Valor-7B-v0.1](https://huggingface.co/NeuralNovel/Valor-7B-v0.1)\ \ on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).\n\ \nThe dataset is composed of 63 configuration, each one coresponding to one of the\ \ evaluated task.\n\nThe dataset has been created from 1 run(s). Each run can be\ \ found as a specific split in each configuration, the split being named using the\ \ timestamp of the run.The \"train\" split is always pointing to the latest results.\n\ \nAn additional configuration \"results\" store all the aggregated results of the\ \ run (and is used to compute and display the aggregated metrics on the [Open LLM\ \ Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).\n\ \nTo load the details from a run, you can for instance do the following:\n```python\n\ from datasets import load_dataset\ndata = load_dataset(\"open-llm-leaderboard/details_NeuralNovel__Valor-7B-v0.1\"\ ,\n\t\"harness_winogrande_5\",\n\tsplit=\"train\")\n```\n\n## Latest results\n\n\ These are the [latest results from run 2024-01-21T04:34:05.220321](https://huggingface.co/datasets/open-llm-leaderboard/details_NeuralNovel__Valor-7B-v0.1/blob/main/results_2024-01-21T04-34-05.220321.json)(note\ \ that their might be results for other tasks in the repos if successive evals didn't\ \ cover the same tasks. You find each in the results and the \"latest\" split for\ \ each eval):\n\n```python\n{\n \"all\": {\n \"acc\": 0.646546642495187,\n\ \ \"acc_stderr\": 0.03219553799568803,\n \"acc_norm\": 0.6461217235016347,\n\ \ \"acc_norm_stderr\": 0.03286614724425918,\n \"mc1\": 0.5605875152998776,\n\ \ \"mc1_stderr\": 0.0173745204825137,\n \"mc2\": 0.6983583637464785,\n\ \ \"mc2_stderr\": 0.015006114910118641\n },\n \"harness|arc:challenge|25\"\ : {\n \"acc\": 0.6911262798634812,\n \"acc_stderr\": 0.013501770929344003,\n\ \ \"acc_norm\": 0.7226962457337884,\n \"acc_norm_stderr\": 0.013082095839059374\n\ \ },\n \"harness|hellaswag|10\": {\n \"acc\": 0.6906990639314877,\n\ \ \"acc_stderr\": 0.004612608206670406,\n \"acc_norm\": 0.8658633738299144,\n\ \ \"acc_norm_stderr\": 0.0034010255178737255\n },\n \"harness|hendrycksTest-abstract_algebra|5\"\ : {\n \"acc\": 0.33,\n \"acc_stderr\": 0.04725815626252605,\n \ \ \"acc_norm\": 0.33,\n \"acc_norm_stderr\": 0.04725815626252605\n \ \ },\n \"harness|hendrycksTest-anatomy|5\": {\n \"acc\": 0.6148148148148148,\n\ \ \"acc_stderr\": 0.04203921040156279,\n \"acc_norm\": 0.6148148148148148,\n\ \ \"acc_norm_stderr\": 0.04203921040156279\n },\n \"harness|hendrycksTest-astronomy|5\"\ : {\n \"acc\": 0.6973684210526315,\n \"acc_stderr\": 0.037385206761196686,\n\ \ \"acc_norm\": 0.6973684210526315,\n \"acc_norm_stderr\": 0.037385206761196686\n\ \ },\n \"harness|hendrycksTest-business_ethics|5\": {\n \"acc\": 0.64,\n\ \ \"acc_stderr\": 0.04824181513244218,\n \"acc_norm\": 0.64,\n \ \ \"acc_norm_stderr\": 0.04824181513244218\n },\n \"harness|hendrycksTest-clinical_knowledge|5\"\ : {\n \"acc\": 0.7056603773584905,\n \"acc_stderr\": 0.02804918631569525,\n\ \ \"acc_norm\": 0.7056603773584905,\n \"acc_norm_stderr\": 0.02804918631569525\n\ \ },\n \"harness|hendrycksTest-college_biology|5\": {\n \"acc\": 0.7569444444444444,\n\ \ \"acc_stderr\": 0.0358687928008034,\n \"acc_norm\": 0.7569444444444444,\n\ \ \"acc_norm_stderr\": 0.0358687928008034\n },\n \"harness|hendrycksTest-college_chemistry|5\"\ : {\n \"acc\": 0.51,\n \"acc_stderr\": 0.05024183937956912,\n \ \ \"acc_norm\": 0.51,\n \"acc_norm_stderr\": 0.05024183937956912\n \ \ },\n \"harness|hendrycksTest-college_computer_science|5\": {\n \"acc\"\ : 0.54,\n \"acc_stderr\": 0.05009082659620333,\n \"acc_norm\": 0.54,\n\ \ \"acc_norm_stderr\": 0.05009082659620333\n },\n \"harness|hendrycksTest-college_mathematics|5\"\ : {\n \"acc\": 0.33,\n \"acc_stderr\": 0.04725815626252604,\n \ \ \"acc_norm\": 0.33,\n \"acc_norm_stderr\": 0.04725815626252604\n \ \ },\n \"harness|hendrycksTest-college_medicine|5\": {\n \"acc\": 0.6473988439306358,\n\ \ \"acc_stderr\": 0.03643037168958548,\n \"acc_norm\": 0.6473988439306358,\n\ \ \"acc_norm_stderr\": 0.03643037168958548\n },\n \"harness|hendrycksTest-college_physics|5\"\ : {\n \"acc\": 0.39215686274509803,\n \"acc_stderr\": 0.04858083574266345,\n\ \ \"acc_norm\": 0.39215686274509803,\n \"acc_norm_stderr\": 0.04858083574266345\n\ \ },\n \"harness|hendrycksTest-computer_security|5\": {\n \"acc\":\ \ 0.77,\n \"acc_stderr\": 0.04229525846816506,\n \"acc_norm\": 0.77,\n\ \ \"acc_norm_stderr\": 0.04229525846816506\n },\n \"harness|hendrycksTest-conceptual_physics|5\"\ : {\n \"acc\": 0.548936170212766,\n \"acc_stderr\": 0.032529096196131965,\n\ \ \"acc_norm\": 0.548936170212766,\n \"acc_norm_stderr\": 0.032529096196131965\n\ \ },\n \"harness|hendrycksTest-econometrics|5\": {\n \"acc\": 0.5,\n\ \ \"acc_stderr\": 0.047036043419179864,\n \"acc_norm\": 0.5,\n \ \ \"acc_norm_stderr\": 0.047036043419179864\n },\n \"harness|hendrycksTest-electrical_engineering|5\"\ : {\n \"acc\": 0.5724137931034483,\n \"acc_stderr\": 0.04122737111370332,\n\ \ \"acc_norm\": 0.5724137931034483,\n \"acc_norm_stderr\": 0.04122737111370332\n\ \ },\n \"harness|hendrycksTest-elementary_mathematics|5\": {\n \"acc\"\ : 0.4126984126984127,\n \"acc_stderr\": 0.02535574126305528,\n \"\ acc_norm\": 0.4126984126984127,\n \"acc_norm_stderr\": 0.02535574126305528\n\ \ },\n \"harness|hendrycksTest-formal_logic|5\": {\n \"acc\": 0.4444444444444444,\n\ \ \"acc_stderr\": 0.04444444444444449,\n \"acc_norm\": 0.4444444444444444,\n\ \ \"acc_norm_stderr\": 0.04444444444444449\n },\n \"harness|hendrycksTest-global_facts|5\"\ : {\n \"acc\": 0.31,\n \"acc_stderr\": 0.04648231987117316,\n \ \ \"acc_norm\": 0.31,\n \"acc_norm_stderr\": 0.04648231987117316\n \ \ },\n \"harness|hendrycksTest-high_school_biology|5\": {\n \"acc\": 0.7935483870967742,\n\ \ \"acc_stderr\": 0.02302589961718872,\n \"acc_norm\": 0.7935483870967742,\n\ \ \"acc_norm_stderr\": 0.02302589961718872\n },\n \"harness|hendrycksTest-high_school_chemistry|5\"\ : {\n \"acc\": 0.49261083743842365,\n \"acc_stderr\": 0.035176035403610084,\n\ \ \"acc_norm\": 0.49261083743842365,\n \"acc_norm_stderr\": 0.035176035403610084\n\ \ },\n \"harness|hendrycksTest-high_school_computer_science|5\": {\n \ \ \"acc\": 0.69,\n \"acc_stderr\": 0.04648231987117316,\n \"acc_norm\"\ : 0.69,\n \"acc_norm_stderr\": 0.04648231987117316\n },\n \"harness|hendrycksTest-high_school_european_history|5\"\ : {\n \"acc\": 0.7696969696969697,\n \"acc_stderr\": 0.03287666758603491,\n\ \ \"acc_norm\": 0.7696969696969697,\n \"acc_norm_stderr\": 0.03287666758603491\n\ \ },\n \"harness|hendrycksTest-high_school_geography|5\": {\n \"acc\"\ : 0.7878787878787878,\n \"acc_stderr\": 0.029126522834586808,\n \"\ acc_norm\": 0.7878787878787878,\n \"acc_norm_stderr\": 0.029126522834586808\n\ \ },\n \"harness|hendrycksTest-high_school_government_and_politics|5\": {\n\ \ \"acc\": 0.8963730569948186,\n \"acc_stderr\": 0.02199531196364424,\n\ \ \"acc_norm\": 0.8963730569948186,\n \"acc_norm_stderr\": 0.02199531196364424\n\ \ },\n \"harness|hendrycksTest-high_school_macroeconomics|5\": {\n \ \ \"acc\": 0.6384615384615384,\n \"acc_stderr\": 0.024359581465397,\n \ \ \"acc_norm\": 0.6384615384615384,\n \"acc_norm_stderr\": 0.024359581465397\n\ \ },\n \"harness|hendrycksTest-high_school_mathematics|5\": {\n \"\ acc\": 0.3111111111111111,\n \"acc_stderr\": 0.028226446749683512,\n \ \ \"acc_norm\": 0.3111111111111111,\n \"acc_norm_stderr\": 0.028226446749683512\n\ \ },\n \"harness|hendrycksTest-high_school_microeconomics|5\": {\n \ \ \"acc\": 0.6680672268907563,\n \"acc_stderr\": 0.03058869701378364,\n \ \ \"acc_norm\": 0.6680672268907563,\n \"acc_norm_stderr\": 0.03058869701378364\n\ \ },\n \"harness|hendrycksTest-high_school_physics|5\": {\n \"acc\"\ : 0.3509933774834437,\n \"acc_stderr\": 0.03896981964257375,\n \"\ acc_norm\": 0.3509933774834437,\n \"acc_norm_stderr\": 0.03896981964257375\n\ \ },\n \"harness|hendrycksTest-high_school_psychology|5\": {\n \"acc\"\ : 0.8458715596330275,\n \"acc_stderr\": 0.015480826865374303,\n \"\ acc_norm\": 0.8458715596330275,\n \"acc_norm_stderr\": 0.015480826865374303\n\ \ },\n \"harness|hendrycksTest-high_school_statistics|5\": {\n \"acc\"\ : 0.5185185185185185,\n \"acc_stderr\": 0.034076320938540516,\n \"\ acc_norm\": 0.5185185185185185,\n \"acc_norm_stderr\": 0.034076320938540516\n\ \ },\n \"harness|hendrycksTest-high_school_us_history|5\": {\n \"acc\"\ : 0.8431372549019608,\n \"acc_stderr\": 0.02552472232455334,\n \"\ acc_norm\": 0.8431372549019608,\n \"acc_norm_stderr\": 0.02552472232455334\n\ \ },\n \"harness|hendrycksTest-high_school_world_history|5\": {\n \"\ acc\": 0.7848101265822784,\n \"acc_stderr\": 0.026750826994676173,\n \ \ \"acc_norm\": 0.7848101265822784,\n \"acc_norm_stderr\": 0.026750826994676173\n\ \ },\n \"harness|hendrycksTest-human_aging|5\": {\n \"acc\": 0.6860986547085202,\n\ \ \"acc_stderr\": 0.031146796482972465,\n \"acc_norm\": 0.6860986547085202,\n\ \ \"acc_norm_stderr\": 0.031146796482972465\n },\n \"harness|hendrycksTest-human_sexuality|5\"\ : {\n \"acc\": 0.7709923664122137,\n \"acc_stderr\": 0.036853466317118506,\n\ \ \"acc_norm\": 0.7709923664122137,\n \"acc_norm_stderr\": 0.036853466317118506\n\ \ },\n \"harness|hendrycksTest-international_law|5\": {\n \"acc\":\ \ 0.7768595041322314,\n \"acc_stderr\": 0.03800754475228732,\n \"\ acc_norm\": 0.7768595041322314,\n \"acc_norm_stderr\": 0.03800754475228732\n\ \ },\n \"harness|hendrycksTest-jurisprudence|5\": {\n \"acc\": 0.7870370370370371,\n\ \ \"acc_stderr\": 0.0395783547198098,\n \"acc_norm\": 0.7870370370370371,\n\ \ \"acc_norm_stderr\": 0.0395783547198098\n },\n \"harness|hendrycksTest-logical_fallacies|5\"\ : {\n \"acc\": 0.7730061349693251,\n \"acc_stderr\": 0.03291099578615769,\n\ \ \"acc_norm\": 0.7730061349693251,\n \"acc_norm_stderr\": 0.03291099578615769\n\ \ },\n \"harness|hendrycksTest-machine_learning|5\": {\n \"acc\": 0.41964285714285715,\n\ \ \"acc_stderr\": 0.046840993210771065,\n \"acc_norm\": 0.41964285714285715,\n\ \ \"acc_norm_stderr\": 0.046840993210771065\n },\n \"harness|hendrycksTest-management|5\"\ : {\n \"acc\": 0.7475728155339806,\n \"acc_stderr\": 0.04301250399690878,\n\ \ \"acc_norm\": 0.7475728155339806,\n \"acc_norm_stderr\": 0.04301250399690878\n\ \ },\n \"harness|hendrycksTest-marketing|5\": {\n \"acc\": 0.8888888888888888,\n\ \ \"acc_stderr\": 0.020588491316092375,\n \"acc_norm\": 0.8888888888888888,\n\ \ \"acc_norm_stderr\": 0.020588491316092375\n },\n \"harness|hendrycksTest-medical_genetics|5\"\ : {\n \"acc\": 0.7,\n \"acc_stderr\": 0.046056618647183814,\n \ \ \"acc_norm\": 0.7,\n \"acc_norm_stderr\": 0.046056618647183814\n \ \ },\n \"harness|hendrycksTest-miscellaneous|5\": {\n \"acc\": 0.8275862068965517,\n\ \ \"acc_stderr\": 0.013507943909371803,\n \"acc_norm\": 0.8275862068965517,\n\ \ \"acc_norm_stderr\": 0.013507943909371803\n },\n \"harness|hendrycksTest-moral_disputes|5\"\ : {\n \"acc\": 0.7254335260115607,\n \"acc_stderr\": 0.024027745155265026,\n\ \ \"acc_norm\": 0.7254335260115607,\n \"acc_norm_stderr\": 0.024027745155265026\n\ \ },\n \"harness|hendrycksTest-moral_scenarios|5\": {\n \"acc\": 0.4480446927374302,\n\ \ \"acc_stderr\": 0.016631976628930595,\n \"acc_norm\": 0.4480446927374302,\n\ \ \"acc_norm_stderr\": 0.016631976628930595\n },\n \"harness|hendrycksTest-nutrition|5\"\ : {\n \"acc\": 0.7156862745098039,\n \"acc_stderr\": 0.02582916327275748,\n\ \ \"acc_norm\": 0.7156862745098039,\n \"acc_norm_stderr\": 0.02582916327275748\n\ \ },\n \"harness|hendrycksTest-philosophy|5\": {\n \"acc\": 0.7202572347266881,\n\ \ \"acc_stderr\": 0.02549425935069491,\n \"acc_norm\": 0.7202572347266881,\n\ \ \"acc_norm_stderr\": 0.02549425935069491\n },\n \"harness|hendrycksTest-prehistory|5\"\ : {\n \"acc\": 0.7253086419753086,\n \"acc_stderr\": 0.024836057868294677,\n\ \ \"acc_norm\": 0.7253086419753086,\n \"acc_norm_stderr\": 0.024836057868294677\n\ \ },\n \"harness|hendrycksTest-professional_accounting|5\": {\n \"\ acc\": 0.4645390070921986,\n \"acc_stderr\": 0.029752389657427047,\n \ \ \"acc_norm\": 0.4645390070921986,\n \"acc_norm_stderr\": 0.029752389657427047\n\ \ },\n \"harness|hendrycksTest-professional_law|5\": {\n \"acc\": 0.4589308996088657,\n\ \ \"acc_stderr\": 0.0127270848267998,\n \"acc_norm\": 0.4589308996088657,\n\ \ \"acc_norm_stderr\": 0.0127270848267998\n },\n \"harness|hendrycksTest-professional_medicine|5\"\ : {\n \"acc\": 0.6727941176470589,\n \"acc_stderr\": 0.028501452860396553,\n\ \ \"acc_norm\": 0.6727941176470589,\n \"acc_norm_stderr\": 0.028501452860396553\n\ \ },\n \"harness|hendrycksTest-professional_psychology|5\": {\n \"\ acc\": 0.6519607843137255,\n \"acc_stderr\": 0.01927099870822398,\n \ \ \"acc_norm\": 0.6519607843137255,\n \"acc_norm_stderr\": 0.01927099870822398\n\ \ },\n \"harness|hendrycksTest-public_relations|5\": {\n \"acc\": 0.6545454545454545,\n\ \ \"acc_stderr\": 0.04554619617541054,\n \"acc_norm\": 0.6545454545454545,\n\ \ \"acc_norm_stderr\": 0.04554619617541054\n },\n \"harness|hendrycksTest-security_studies|5\"\ : {\n \"acc\": 0.7510204081632653,\n \"acc_stderr\": 0.027682979522960234,\n\ \ \"acc_norm\": 0.7510204081632653,\n \"acc_norm_stderr\": 0.027682979522960234\n\ \ },\n \"harness|hendrycksTest-sociology|5\": {\n \"acc\": 0.845771144278607,\n\ \ \"acc_stderr\": 0.025538433368578337,\n \"acc_norm\": 0.845771144278607,\n\ \ \"acc_norm_stderr\": 0.025538433368578337\n },\n \"harness|hendrycksTest-us_foreign_policy|5\"\ : {\n \"acc\": 0.84,\n \"acc_stderr\": 0.03684529491774709,\n \ \ \"acc_norm\": 0.84,\n \"acc_norm_stderr\": 0.03684529491774709\n \ \ },\n \"harness|hendrycksTest-virology|5\": {\n \"acc\": 0.5421686746987951,\n\ \ \"acc_stderr\": 0.0387862677100236,\n \"acc_norm\": 0.5421686746987951,\n\ \ \"acc_norm_stderr\": 0.0387862677100236\n },\n \"harness|hendrycksTest-world_religions|5\"\ : {\n \"acc\": 0.8245614035087719,\n \"acc_stderr\": 0.029170885500727668,\n\ \ \"acc_norm\": 0.8245614035087719,\n \"acc_norm_stderr\": 0.029170885500727668\n\ \ },\n \"harness|truthfulqa:mc|0\": {\n \"mc1\": 0.5605875152998776,\n\ \ \"mc1_stderr\": 0.0173745204825137,\n \"mc2\": 0.6983583637464785,\n\ \ \"mc2_stderr\": 0.015006114910118641\n },\n \"harness|winogrande|5\"\ : {\n \"acc\": 0.8334648776637726,\n \"acc_stderr\": 0.010470796496781105\n\ \ },\n \"harness|gsm8k|5\": {\n \"acc\": 0.6914329037149356,\n \ \ \"acc_stderr\": 0.01272307604981591\n }\n}\n```" repo_url: https://huggingface.co/NeuralNovel/Valor-7B-v0.1 leaderboard_url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard point_of_contact: [e-mail] configs: - config_name: harness_arc_challenge_25 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|arc:challenge|25_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|arc:challenge|25_2024-01-21T04-34-05.220321.parquet' - config_name: harness_gsm8k_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|gsm8k|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|gsm8k|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hellaswag_10 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hellaswag|10_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hellaswag|10_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-anatomy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-astronomy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-business_ethics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_biology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_chemistry|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_computer_science|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_mathematics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_medicine|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_physics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-computer_security|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-econometrics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-formal_logic|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-global_facts|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_biology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_geography|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_physics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-human_aging|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-human_sexuality|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-international_law|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-jurisprudence|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-machine_learning|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-management|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-marketing|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-medical_genetics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-miscellaneous|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-moral_disputes|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-nutrition|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-philosophy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-prehistory|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_accounting|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_law|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_medicine|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_psychology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-public_relations|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-security_studies|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-sociology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-virology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-world_religions|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-anatomy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-astronomy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-business_ethics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_biology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_chemistry|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_computer_science|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_mathematics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_medicine|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-college_physics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-computer_security|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-econometrics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-formal_logic|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-global_facts|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_biology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_geography|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_physics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-human_aging|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-human_sexuality|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-international_law|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-jurisprudence|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-machine_learning|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-management|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-marketing|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-medical_genetics|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-miscellaneous|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-moral_disputes|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-nutrition|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-philosophy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-prehistory|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_accounting|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_law|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_medicine|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-professional_psychology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-public_relations|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-security_studies|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-sociology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-virology|5_2024-01-21T04-34-05.220321.parquet' - '**/details_harness|hendrycksTest-world_religions|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_abstract_algebra_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_anatomy_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-anatomy|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-anatomy|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_astronomy_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-astronomy|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-astronomy|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_business_ethics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-business_ethics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-business_ethics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_clinical_knowledge_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_college_biology_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-college_biology|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-college_biology|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_college_chemistry_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-college_chemistry|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-college_chemistry|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_college_computer_science_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-college_computer_science|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-college_computer_science|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_college_mathematics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-college_mathematics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-college_mathematics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_college_medicine_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-college_medicine|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-college_medicine|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_college_physics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-college_physics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-college_physics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_computer_security_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-computer_security|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-computer_security|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_conceptual_physics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_econometrics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-econometrics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-econometrics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_electrical_engineering_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_elementary_mathematics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_formal_logic_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-formal_logic|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-formal_logic|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_global_facts_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-global_facts|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-global_facts|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_biology_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_biology|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_biology|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_chemistry_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_computer_science_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_european_history_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_geography_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_geography|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_geography|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_government_and_politics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_macroeconomics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_mathematics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_microeconomics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_physics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_physics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_physics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_psychology_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_statistics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_us_history_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_high_school_world_history_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_human_aging_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-human_aging|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-human_aging|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_human_sexuality_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-human_sexuality|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-human_sexuality|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_international_law_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-international_law|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-international_law|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_jurisprudence_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-jurisprudence|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-jurisprudence|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_logical_fallacies_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_machine_learning_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-machine_learning|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-machine_learning|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_management_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-management|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-management|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_marketing_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-marketing|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-marketing|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_medical_genetics_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-medical_genetics|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-medical_genetics|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_miscellaneous_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-miscellaneous|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-miscellaneous|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_moral_disputes_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-moral_disputes|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-moral_disputes|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_moral_scenarios_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_nutrition_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-nutrition|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-nutrition|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_philosophy_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-philosophy|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-philosophy|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_prehistory_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-prehistory|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-prehistory|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_professional_accounting_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-professional_accounting|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-professional_accounting|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_professional_law_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-professional_law|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-professional_law|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_professional_medicine_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-professional_medicine|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-professional_medicine|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_professional_psychology_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-professional_psychology|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-professional_psychology|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_public_relations_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-public_relations|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-public_relations|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_security_studies_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-security_studies|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-security_studies|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_sociology_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-sociology|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-sociology|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_us_foreign_policy_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_virology_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-virology|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-virology|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_hendrycksTest_world_religions_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|hendrycksTest-world_religions|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|hendrycksTest-world_religions|5_2024-01-21T04-34-05.220321.parquet' - config_name: harness_truthfulqa_mc_0 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|truthfulqa:mc|0_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|truthfulqa:mc|0_2024-01-21T04-34-05.220321.parquet' - config_name: harness_winogrande_5 data_files: - split: 2024_01_21T04_34_05.220321 path: - '**/details_harness|winogrande|5_2024-01-21T04-34-05.220321.parquet' - split: latest path: - '**/details_harness|winogrande|5_2024-01-21T04-34-05.220321.parquet' - config_name: results data_files: - split: 2024_01_21T04_34_05.220321 path: - results_2024-01-21T04-34-05.220321.parquet - split: latest path: - results_2024-01-21T04-34-05.220321.parquet --- # Dataset Card for Evaluation run of NeuralNovel/Valor-7B-v0.1 <!-- Provide a quick summary of the dataset. --> Dataset automatically created during the evaluation run of model [NeuralNovel/Valor-7B-v0.1](https://huggingface.co/NeuralNovel/Valor-7B-v0.1) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard). The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task. The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results. An additional configuration "results" store all the aggregated results of the run (and is used to compute and display the aggregated metrics on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)). To load the details from a run, you can for instance do the following: ```python from datasets import load_dataset data = load_dataset("open-llm-leaderboard/details_NeuralNovel__Valor-7B-v0.1", "harness_winogrande_5", split="train") ``` ## Latest results These are the [latest results from run 2024-01-21T04:34:05.220321](https://huggingface.co/datasets/open-llm-leaderboard/details_NeuralNovel__Valor-7B-v0.1/blob/main/results_2024-01-21T04-34-05.220321.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval): ```python { "all": { "acc": 0.646546642495187, "acc_stderr": 0.03219553799568803, "acc_norm": 0.6461217235016347, "acc_norm_stderr": 0.03286614724425918, "mc1": 0.5605875152998776, "mc1_stderr": 0.0173745204825137, "mc2": 0.6983583637464785, "mc2_stderr": 0.015006114910118641 }, "harness|arc:challenge|25": { "acc": 0.6911262798634812, "acc_stderr": 0.013501770929344003, "acc_norm": 0.7226962457337884, "acc_norm_stderr": 0.013082095839059374 }, "harness|hellaswag|10": { "acc": 0.6906990639314877, "acc_stderr": 0.004612608206670406, "acc_norm": 0.8658633738299144, "acc_norm_stderr": 0.0034010255178737255 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.33, "acc_stderr": 0.04725815626252605, "acc_norm": 0.33, "acc_norm_stderr": 0.04725815626252605 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.6148148148148148, "acc_stderr": 0.04203921040156279, "acc_norm": 0.6148148148148148, "acc_norm_stderr": 0.04203921040156279 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.6973684210526315, "acc_stderr": 0.037385206761196686, "acc_norm": 0.6973684210526315, "acc_norm_stderr": 0.037385206761196686 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.64, "acc_stderr": 0.04824181513244218, "acc_norm": 0.64, "acc_norm_stderr": 0.04824181513244218 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.7056603773584905, "acc_stderr": 0.02804918631569525, "acc_norm": 0.7056603773584905, "acc_norm_stderr": 0.02804918631569525 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.7569444444444444, "acc_stderr": 0.0358687928008034, "acc_norm": 0.7569444444444444, "acc_norm_stderr": 0.0358687928008034 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.51, "acc_stderr": 0.05024183937956912, "acc_norm": 0.51, "acc_norm_stderr": 0.05024183937956912 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.54, "acc_stderr": 0.05009082659620333, "acc_norm": 0.54, "acc_norm_stderr": 0.05009082659620333 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.33, "acc_stderr": 0.04725815626252604, "acc_norm": 0.33, "acc_norm_stderr": 0.04725815626252604 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.6473988439306358, "acc_stderr": 0.03643037168958548, "acc_norm": 0.6473988439306358, "acc_norm_stderr": 0.03643037168958548 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.39215686274509803, "acc_stderr": 0.04858083574266345, "acc_norm": 0.39215686274509803, "acc_norm_stderr": 0.04858083574266345 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.77, "acc_stderr": 0.04229525846816506, "acc_norm": 0.77, "acc_norm_stderr": 0.04229525846816506 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.548936170212766, "acc_stderr": 0.032529096196131965, "acc_norm": 0.548936170212766, "acc_norm_stderr": 0.032529096196131965 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.5, "acc_stderr": 0.047036043419179864, "acc_norm": 0.5, "acc_norm_stderr": 0.047036043419179864 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.5724137931034483, "acc_stderr": 0.04122737111370332, "acc_norm": 0.5724137931034483, "acc_norm_stderr": 0.04122737111370332 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.4126984126984127, "acc_stderr": 0.02535574126305528, "acc_norm": 0.4126984126984127, "acc_norm_stderr": 0.02535574126305528 }, "harness|hendrycksTest-formal_logic|5": { "acc": 0.4444444444444444, "acc_stderr": 0.04444444444444449, "acc_norm": 0.4444444444444444, "acc_norm_stderr": 0.04444444444444449 }, "harness|hendrycksTest-global_facts|5": { "acc": 0.31, "acc_stderr": 0.04648231987117316, "acc_norm": 0.31, "acc_norm_stderr": 0.04648231987117316 }, "harness|hendrycksTest-high_school_biology|5": { "acc": 0.7935483870967742, "acc_stderr": 0.02302589961718872, "acc_norm": 0.7935483870967742, "acc_norm_stderr": 0.02302589961718872 }, "harness|hendrycksTest-high_school_chemistry|5": { "acc": 0.49261083743842365, "acc_stderr": 0.035176035403610084, "acc_norm": 0.49261083743842365, "acc_norm_stderr": 0.035176035403610084 }, "harness|hendrycksTest-high_school_computer_science|5": { "acc": 0.69, "acc_stderr": 0.04648231987117316, "acc_norm": 0.69, "acc_norm_stderr": 0.04648231987117316 }, "harness|hendrycksTest-high_school_european_history|5": { "acc": 0.7696969696969697, "acc_stderr": 0.03287666758603491, "acc_norm": 0.7696969696969697, "acc_norm_stderr": 0.03287666758603491 }, "harness|hendrycksTest-high_school_geography|5": { "acc": 0.7878787878787878, "acc_stderr": 0.029126522834586808, "acc_norm": 0.7878787878787878, "acc_norm_stderr": 0.029126522834586808 }, "harness|hendrycksTest-high_school_government_and_politics|5": { "acc": 0.8963730569948186, "acc_stderr": 0.02199531196364424, "acc_norm": 0.8963730569948186, "acc_norm_stderr": 0.02199531196364424 }, "harness|hendrycksTest-high_school_macroeconomics|5": { "acc": 0.6384615384615384, "acc_stderr": 0.024359581465397, "acc_norm": 0.6384615384615384, "acc_norm_stderr": 0.024359581465397 }, "harness|hendrycksTest-high_school_mathematics|5": { "acc": 0.3111111111111111, "acc_stderr": 0.028226446749683512, "acc_norm": 0.3111111111111111, "acc_norm_stderr": 0.028226446749683512 }, "harness|hendrycksTest-high_school_microeconomics|5": { "acc": 0.6680672268907563, "acc_stderr": 0.03058869701378364, "acc_norm": 0.6680672268907563, "acc_norm_stderr": 0.03058869701378364 }, "harness|hendrycksTest-high_school_physics|5": { "acc": 0.3509933774834437, "acc_stderr": 0.03896981964257375, "acc_norm": 0.3509933774834437, "acc_norm_stderr": 0.03896981964257375 }, "harness|hendrycksTest-high_school_psychology|5": { "acc": 0.8458715596330275, "acc_stderr": 0.015480826865374303, "acc_norm": 0.8458715596330275, "acc_norm_stderr": 0.015480826865374303 }, "harness|hendrycksTest-high_school_statistics|5": { "acc": 0.5185185185185185, "acc_stderr": 0.034076320938540516, "acc_norm": 0.5185185185185185, "acc_norm_stderr": 0.034076320938540516 }, "harness|hendrycksTest-high_school_us_history|5": { "acc": 0.8431372549019608, "acc_stderr": 0.02552472232455334, "acc_norm": 0.8431372549019608, "acc_norm_stderr": 0.02552472232455334 }, "harness|hendrycksTest-high_school_world_history|5": { "acc": 0.7848101265822784, "acc_stderr": 0.026750826994676173, "acc_norm": 0.7848101265822784, "acc_norm_stderr": 0.026750826994676173 }, "harness|hendrycksTest-human_aging|5": { "acc": 0.6860986547085202, "acc_stderr": 0.031146796482972465, "acc_norm": 0.6860986547085202, "acc_norm_stderr": 0.031146796482972465 }, "harness|hendrycksTest-human_sexuality|5": { "acc": 0.7709923664122137, "acc_stderr": 0.036853466317118506, "acc_norm": 0.7709923664122137, "acc_norm_stderr": 0.036853466317118506 }, "harness|hendrycksTest-international_law|5": { "acc": 0.7768595041322314, "acc_stderr": 0.03800754475228732, "acc_norm": 0.7768595041322314, "acc_norm_stderr": 0.03800754475228732 }, "harness|hendrycksTest-jurisprudence|5": { "acc": 0.7870370370370371, "acc_stderr": 0.0395783547198098, "acc_norm": 0.7870370370370371, "acc_norm_stderr": 0.0395783547198098 }, "harness|hendrycksTest-logical_fallacies|5": { "acc": 0.7730061349693251, "acc_stderr": 0.03291099578615769, "acc_norm": 0.7730061349693251, "acc_norm_stderr": 0.03291099578615769 }, "harness|hendrycksTest-machine_learning|5": { "acc": 0.41964285714285715, "acc_stderr": 0.046840993210771065, "acc_norm": 0.41964285714285715, "acc_norm_stderr": 0.046840993210771065 }, "harness|hendrycksTest-management|5": { "acc": 0.7475728155339806, "acc_stderr": 0.04301250399690878, "acc_norm": 0.7475728155339806, "acc_norm_stderr": 0.04301250399690878 }, "harness|hendrycksTest-marketing|5": { "acc": 0.8888888888888888, "acc_stderr": 0.020588491316092375, "acc_norm": 0.8888888888888888, "acc_norm_stderr": 0.020588491316092375 }, "harness|hendrycksTest-medical_genetics|5": { "acc": 0.7, "acc_stderr": 0.046056618647183814, "acc_norm": 0.7, "acc_norm_stderr": 0.046056618647183814 }, "harness|hendrycksTest-miscellaneous|5": { "acc": 0.8275862068965517, "acc_stderr": 0.013507943909371803, "acc_norm": 0.8275862068965517, "acc_norm_stderr": 0.013507943909371803 }, "harness|hendrycksTest-moral_disputes|5": { "acc": 0.7254335260115607, "acc_stderr": 0.024027745155265026, "acc_norm": 0.7254335260115607, "acc_norm_stderr": 0.024027745155265026 }, "harness|hendrycksTest-moral_scenarios|5": { "acc": 0.4480446927374302, "acc_stderr": 0.016631976628930595, "acc_norm": 0.4480446927374302, "acc_norm_stderr": 0.016631976628930595 }, "harness|hendrycksTest-nutrition|5": { "acc": 0.7156862745098039, "acc_stderr": 0.02582916327275748, "acc_norm": 0.7156862745098039, "acc_norm_stderr": 0.02582916327275748 }, "harness|hendrycksTest-philosophy|5": { "acc": 0.7202572347266881, "acc_stderr": 0.02549425935069491, "acc_norm": 0.7202572347266881, "acc_norm_stderr": 0.02549425935069491 }, "harness|hendrycksTest-prehistory|5": { "acc": 0.7253086419753086, "acc_stderr": 0.024836057868294677, "acc_norm": 0.7253086419753086, "acc_norm_stderr": 0.024836057868294677 }, "harness|hendrycksTest-professional_accounting|5": { "acc": 0.4645390070921986, "acc_stderr": 0.029752389657427047, "acc_norm": 0.4645390070921986, "acc_norm_stderr": 0.029752389657427047 }, "harness|hendrycksTest-professional_law|5": { "acc": 0.4589308996088657, "acc_stderr": 0.0127270848267998, "acc_norm": 0.4589308996088657, "acc_norm_stderr": 0.0127270848267998 }, "harness|hendrycksTest-professional_medicine|5": { "acc": 0.6727941176470589, "acc_stderr": 0.028501452860396553, "acc_norm": 0.6727941176470589, "acc_norm_stderr": 0.028501452860396553 }, "harness|hendrycksTest-professional_psychology|5": { "acc": 0.6519607843137255, "acc_stderr": 0.01927099870822398, "acc_norm": 0.6519607843137255, "acc_norm_stderr": 0.01927099870822398 }, "harness|hendrycksTest-public_relations|5": { "acc": 0.6545454545454545, "acc_stderr": 0.04554619617541054, "acc_norm": 0.6545454545454545, "acc_norm_stderr": 0.04554619617541054 }, "harness|hendrycksTest-security_studies|5": { "acc": 0.7510204081632653, "acc_stderr": 0.027682979522960234, "acc_norm": 0.7510204081632653, "acc_norm_stderr": 0.027682979522960234 }, "harness|hendrycksTest-sociology|5": { "acc": 0.845771144278607, "acc_stderr": 0.025538433368578337, "acc_norm": 0.845771144278607, "acc_norm_stderr": 0.025538433368578337 }, "harness|hendrycksTest-us_foreign_policy|5": { "acc": 0.84, "acc_stderr": 0.03684529491774709, "acc_norm": 0.84, "acc_norm_stderr": 0.03684529491774709 }, "harness|hendrycksTest-virology|5": { "acc": 0.5421686746987951, "acc_stderr": 0.0387862677100236, "acc_norm": 0.5421686746987951, "acc_norm_stderr": 0.0387862677100236 }, "harness|hendrycksTest-world_religions|5": { "acc": 0.8245614035087719, "acc_stderr": 0.029170885500727668, "acc_norm": 0.8245614035087719, "acc_norm_stderr": 0.029170885500727668 }, "harness|truthfulqa:mc|0": { "mc1": 0.5605875152998776, "mc1_stderr": 0.0173745204825137, "mc2": 0.6983583637464785, "mc2_stderr": 0.015006114910118641 }, "harness|winogrande|5": { "acc": 0.8334648776637726, "acc_stderr": 0.010470796496781105 }, "harness|gsm8k|5": { "acc": 0.6914329037149356, "acc_stderr": 0.01272307604981591 } } ``` ## Dataset Details ### Dataset Description <!-- Provide a longer summary of what this dataset is. --> - **Curated by:** [More Information Needed] - **Funded by [optional]:** [More Information Needed] - **Shared by [optional]:** [More Information Needed] - **Language(s) (NLP):** [More Information Needed] - **License:** [More Information Needed] ### Dataset Sources [optional] <!-- Provide the basic links for the dataset. --> - **Repository:** [More Information Needed] - **Paper [optional]:** [More Information Needed] - **Demo [optional]:** [More Information Needed] ## Uses <!-- Address questions around how the dataset is intended to be used. --> ### Direct Use <!-- This section describes suitable use cases for the dataset. --> [More Information Needed] ### Out-of-Scope Use <!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. --> [More Information Needed] ## Dataset Structure <!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. --> [More Information Needed] ## Dataset Creation ### Curation Rationale <!-- Motivation for the creation of this dataset. --> [More Information Needed] ### Source Data <!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). --> #### Data Collection and Processing <!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. --> [More Information Needed] #### Who are the source data producers? <!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. --> [More Information Needed] ### Annotations [optional] <!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. --> #### Annotation process <!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. --> [More Information Needed] #### Who are the annotators? <!-- This section describes the people or systems who created the annotations. --> [More Information Needed] #### Personal and Sensitive Information <!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. --> [More Information Needed] ## Bias, Risks, and Limitations <!-- This section is meant to convey both technical and sociotechnical limitations. --> [More Information Needed] ### Recommendations <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. --> Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations. ## Citation [optional] <!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. --> **BibTeX:** [More Information Needed] **APA:** [More Information Needed] ## Glossary [optional] <!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. --> [More Information Needed] ## More Information [optional] [More Information Needed] ## Dataset Card Authors [optional] [More Information Needed] ## Dataset Card Contact [More Information Needed]该数据集是在评估模型NeuralNovel/Valor-7B-v0.1时自动创建的，用于Open LLM Leaderboard的评估。数据集包含63个配置，每个配置对应一个评估任务。数据集由1次运行创建，每次运行的结果存储为特定配置中的一个分割，分割名称使用运行的时间戳。train分割始终指向最新的结果。此外，还有一个名为results的配置，存储了所有运行的聚合结果，用于计算和显示Open LLM Leaderboard上的聚合指标。

原始信息汇总

数据集概述

数据集名称：Evaluation run of NeuralNovel/Valor-7B-v0.1

数据集组成

• 该数据集包含63个配置，每个配置对应一个评估任务。
• 数据集由1次运行生成，每个运行的结果存储在特定的分割中，分割名称使用运行的时间戳。
• "train"分割始终指向最新的结果。
• 一个额外的配置"results"存储所有运行的聚合结果，用于计算和显示在Open LLM Leaderboard上的聚合指标。

数据加载示例

python from datasets import load_dataset data = load_dataset("open-llm-leaderboard/details_NeuralNovel__Valor-7B-v0.1", "harness_winogrande_5", split="train")

最新结果

• 最新结果来自2024-01-21T04:34:05.220321的运行，包含多个任务的评估结果。

配置详情

• harness_arc_challenge_25

  • 分割：2024_01_21T04_34_05.220321, latest
  • 路径：**/details_harness|arc:challenge|25_2024-01-21T04-34-05.220321.parquet

• harness_gsm8k_5

  • 分割：2024_01_21T04_34_05.220321, latest
  • 路径：**/details_harness|gsm8k|5_2024-01-21T04-34-05.220321.parquet

• harness_hellaswag_10

  • 分割：2024_01_21T04_34_05.220321, latest
  • 路径：**/details_harness|hellaswag|10_2024-01-21T04-34-05.220321.parquet

• harness_hendrycksTest_5

  • 分割：2024_01_21T04_34_05.220321
  • 路径：多个路径，包括不同任务的parquet文件

搜集汇总

数据集介绍

构建方式

在大型语言模型评测领域，Open LLM Leaderboard为模型性能的量化评估提供了标准化平台。该数据集正是为记录NeuralNovel/Valor-7B-v0.1模型在排行榜上的评测过程而自动生成的。其构建方式依托于一次完整的评测运行，针对63个不同的评估任务，每个任务对应一个独立的数据配置。在每个配置中，以运行时间戳为标识创建了特定的数据拆分，其中“train”拆分始终指向最新一次的评测结果。此外，一个名为“results”的独立配置专门用于存储该次运行的所有聚合指标，为排行榜上综合分数的计算与展示提供数据支撑。

特点

该数据集展现出精细化的结构化特征，其核心在于将复杂的模型评测结果拆解为63个任务级别的配置，每个配置聚焦于如ARC挑战赛、HellaSwag、GSM8K以及涵盖57个学科的MMLU等具体基准。数据集的版本化机制尤为突出，通过时间戳命名的拆分实现运行结果的追溯，确保了评测历史的可复现性。同时，“results”配置中包含了如准确率及其标准误差等详尽统计指标，不仅呈现了模型在常识推理、数学解题、知识问答等维度的多面表现，也为深入分析模型在不同难度与领域任务上的能力分布提供了宝贵数据。

使用方法

研究人员可通过Hugging Face的datasets库便捷地调用该数据集。加载时需指定具体任务配置，例如使用`load_dataset("open-llm-leaderboard/details_NeuralNovel__Valor-7B-v0.1", "harness_winogrande_5", split="train")`即可获取Winogrande任务的最新评测细节。若需追溯历史结果，可通过指定对应时间戳的拆分名称来实现。此外，直接访问“results”配置，可一次性加载该次运行的全部聚合指标，便于进行模型间的横向对比或纵向分析。这种灵活的访问方式，使其成为复现评测结果、开展模型能力研究的重要工具。

背景与挑战

背景概述

在大型语言模型（LLM）迅猛发展的浪潮中，如何系统、公正地评估模型性能成为学界与工业界共同关注的核心议题。Open LLM Leaderboard由Hugging Face团队于2023年发起，旨在构建一个标准化的开源模型评测平台，以解决模型间横向比较缺乏统一基准的痛点。该数据集围绕NeuralNovel团队开发的Valor-7B-v0.1模型，于2024年1月21日完成评测，记录了其在63项任务上的详尽表现，涵盖常识推理（如HellaSwag）、数学推理（如GSM8K）及多学科知识（如MMLU）等维度。作为Leaderboard生态的重要组成部分，该数据集不仅为Valor-7B-v0.1提供了透明的性能档案，更推动了LLM评测范式的透明化与可复现性，对后续模型迭代与社区协作具有深远影响。

当前挑战

当前数据集面临的核心挑战体现在两个层面。在领域问题层面，LLM评测需应对任务多样性与评估指标一致性之间的张力——例如常识推理任务（如ARC-Challenge）与数学推理任务（如GSM8K）对模型能力的要求截然不同，单一指标难以全面反映模型泛化能力。在构建过程中，数据集需解决评测流程的自动化与标准化难题：包括确保不同运行批次间任务覆盖的一致性、处理多源异构评测框架（如LM Evaluation Harness）的输出格式对齐，以及应对模型版本迭代导致的历史结果回溯复杂性。此外，评测结果中部分任务（如hendrycksTest-college_mathematics）的低准确率（0.33）揭示了模型在专业领域知识上的脆弱性，这对数据集的鲁棒性分析与模型改进方向提出了更高要求。

常用场景

经典使用场景

在大型语言模型评估领域，Open LLM Leaderboard上的评估运行数据集为模型性能的量化分析提供了标准化基准。该数据集记录了NeuralNovel/Valor-7B-v0.1模型在63个配置任务上的详细评估结果，涵盖ARC挑战集、HellaSwag常识推理、GSM8K数学问题求解以及涵盖57个学科的MMLU测试等经典基准。研究者通过加载特定任务的配置与分割，能够精准复现模型在各项能力维度上的表现，从而系统性地剖析模型在推理、知识储备与语言理解等方面的优劣。

实际应用

在实际应用中，该数据集为模型选型与部署决策提供了关键参考。企业或研究机构在挑选适合特定场景的语言模型时，可依据该数据集中的详细评估结果，快速定位在目标领域表现优异的模型。例如，在需要高精度数学推理的教育场景中，GSM8K任务的准确率成为重要筛选指标；而在知识问答系统中，MMLU各学科成绩则直接反映了模型的知识覆盖面与可靠性。这种数据驱动的模型评估方式显著降低了试错成本，提升了应用部署的效率与精准度。

衍生相关工作

该数据集衍生了一系列重要的学术工作，尤其是围绕Open LLM Leaderboard评估体系的研究。后续工作包括对评估结果进行元分析，以揭示不同模型家族在特定任务上的系统性偏差；开发基于该数据集的可视化工具，帮助研究者直观比较模型能力轮廓；以及将其作为基准，验证新型评估方法或指标的有效性。此外，该数据集还激励了社区对模型评估标准化与透明化的深入探讨，催生了更多关于评估流程优化与结果可解释性的创新性研究，进一步巩固了其在大语言模型评测领域的基石地位。