OALL/details_lemon-mint__gemma-ko-7b-instruct-v0.62
收藏数据集概述
该数据集是在评估模型lemon-mint/gemma-ko-7b-instruct-v0.62的过程中自动创建的。数据集包含136个配置，每个配置对应一个评估任务。
数据集结构
- 配置数量：136个配置
- 数据来源：从1次运行中创建，每个运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。
- 训练分割："train"分割始终指向最新的结果。
- 结果配置：一个额外的配置"results"存储所有运行的聚合结果。
数据加载示例
python from datasets import load_dataset data = load_dataset("OALL/details_lemon-mint__gemma-ko-7b-instruct-v0.62", "lighteval_xstory_cloze_ar_0", split="train")
最新结果
以下是2024-05-23T16:02:48.223968运行的最新结果：
python { "all": { "acc_norm": 0.4488043389568396, "acc_norm_stderr": 0.03830988328030329, "acc": 0.6234281932495036, "acc_stderr": 0.012468914489659358 }, "community|acva:Algeria|0": { "acc_norm": 0.5230769230769231, "acc_norm_stderr": 0.0358596530894741 }, "community|acva:Ancient_Egypt|0": { "acc_norm": 0.06666666666666667, "acc_norm_stderr": 0.014076929472824472 }, "community|acva:Arab_Empire|0": { "acc_norm": 0.3132075471698113, "acc_norm_stderr": 0.02854479331905533 }, "community|acva:Arabic_Architecture|0": { "acc_norm": 0.47692307692307695, "acc_norm_stderr": 0.0358596530894741 }, "community|acva:Arabic_Art|0": { "acc_norm": 0.40512820512820513, "acc_norm_stderr": 0.03524577495610961 }, "community|acva:Arabic_Astronomy|0": { "acc_norm": 0.4666666666666667, "acc_norm_stderr": 0.03581804596782233 }, "community|acva:Arabic_Calligraphy|0": { "acc_norm": 0.792156862745098, "acc_norm_stderr": 0.025459893390593815 }, "community|acva:Arabic_Ceremony|0": { "acc_norm": 0.5459459459459459, "acc_norm_stderr": 0.036704531918025717 }, "community|acva:Arabic_Clothing|0": { "acc_norm": 0.517948717948718, "acc_norm_stderr": 0.03587477098773825 }, "community|acva:Arabic_Culture|0": { "acc_norm": 0.26153846153846155, "acc_norm_stderr": 0.03155228802742767 }, "community|acva:Arabic_Food|0": { "acc_norm": 0.558974358974359, "acc_norm_stderr": 0.0356473293185358 }, "community|acva:Arabic_Funeral|0": { "acc_norm": 0.4105263157894737, "acc_norm_stderr": 0.050738635645512106 }, "community|acva:Arabic_Geography|0": { "acc_norm": 0.6275862068965518, "acc_norm_stderr": 0.0402873153294756 }, "community|acva:Arabic_History|0": { "acc_norm": 0.30256410256410254, "acc_norm_stderr": 0.03298070870085619 }, "community|acva:Arabic_Language_Origin|0": { "acc_norm": 0.6, "acc_norm_stderr": 0.05052911526399114 }, "community|acva:Arabic_Literature|0": { "acc_norm": 0.4827586206896552, "acc_norm_stderr": 0.04164188720169377 }, "community|acva:Arabic_Math|0": { "acc_norm": 0.30256410256410254, "acc_norm_stderr": 0.03298070870085618 }, "community|acva:Arabic_Medicine|0": { "acc_norm": 0.46206896551724136, "acc_norm_stderr": 0.041546596717075474 }, "community|acva:Arabic_Music|0": { "acc_norm": 0.2589928057553957, "acc_norm_stderr": 0.037291986581642324 }, "community|acva:Arabic_Ornament|0": { "acc_norm": 0.6358974358974359, "acc_norm_stderr": 0.03454653867786389 }, "community|acva:Arabic_Philosophy|0": { "acc_norm": 0.5793103448275863, "acc_norm_stderr": 0.0411391498118926 }, "community|acva:Arabic_Physics_and_Chemistry|0": { "acc_norm": 0.6051282051282051, "acc_norm_stderr": 0.03509545602262038 }, "community|acva:Arabic_Wedding|0": { "acc_norm": 0.4666666666666667, "acc_norm_stderr": 0.03581804596782233 }, "community|acva:Bahrain|0": { "acc_norm": 0.3333333333333333, "acc_norm_stderr": 0.07106690545187012 }, "community|acva:Comoros|0": { "acc_norm": 0.37777777777777777, "acc_norm_stderr": 0.07309112127323451 }, "community|acva:Egypt_modern|0": { "acc_norm": 0.3263157894736842, "acc_norm_stderr": 0.04835966701461423 }, "community|acva:InfluenceFromAncientEgypt|0": { "acc_norm": 0.5897435897435898, "acc_norm_stderr": 0.035314937123266714 }, "community|acva:InfluenceFromByzantium|0": { "acc_norm": 0.7310344827586207, "acc_norm_stderr": 0.036951833116502325 }, "community|acva:InfluenceFromChina|0": { "acc_norm": 0.28205128205128205, "acc_norm_stderr": 0.03230798601799115 }, "community|acva:InfluenceFromGreece|0": { "acc_norm": 0.6410256410256411, "acc_norm_stderr": 0.03444042881521377 }, "community|acva:InfluenceFromIslam|0": { "acc_norm": 0.3793103448275862, "acc_norm_stderr": 0.04043461861916747 }, "community|acva:InfluenceFromPersia|0": { "acc_norm": 0.7314285714285714, "acc_norm_stderr": 0.033600151915923894 }, "community|acva:InfluenceFromRome|0": { "acc_norm": 0.5846153846153846, "acc_norm_stderr": 0.03538013280575029 }, "community|acva:Iraq|0": { "acc_norm": 0.5529411764705883, "acc_norm_stderr": 0.054247803536170265 }, "community|acva:Islam_Education|0": { "acc_norm": 0.5230769230769231, "acc_norm_stderr": 0.0358596530894741 }, "community|acva:Islam_branches_and_schools|0": { "acc_norm": 0.48, "acc_norm_stderr": 0.037874566117919985 }, "community|acva:Islamic_law_system|0": { "acc_norm": 0.5282051282051282, "acc_norm_stderr": 0.035840746749208334 }, "community|acva:Jordan|0": { "acc_norm": 0.4222222222222222, "acc_norm_stderr": 0.07446027270295806 }, "community|acva:Kuwait|0": { "acc_norm": 0.28888888888888886, "acc_norm_stderr": 0.06832943242540508 }, "community|acva:Lebanon|0": { "acc_norm": 0.17777777777777778, "acc_norm_stderr": 0.05763774795025094 }, "community|acva:Libya|0": { "acc_norm": 0.4666666666666667, "acc_norm_stderr": 0.0752101433090355 }, "community|acva:Mauritania|0": { "acc_norm": 0.4, "acc_norm_stderr": 0.07385489458759965 }, "community|acva:Mesopotamia_civilization|0": { "acc_norm": 0.5161290322580645, "acc_norm_stderr": 0.040270179608539264 }, "community|acva:Morocco|0": { "acc_norm": 0.24444444444444444, "acc_norm_stderr": 0.06478835438716998 }, "community|acva:Oman|0": { "acc_norm": 0.35555555555555557, "acc_norm_stderr": 0.07216392363431012 }, "community|acva:Palestine|0": { "acc_norm": 0.25882352941176473, "acc_norm_stderr": 0.047788461203740945 }, "community|acva:Qatar|0": { "acc_norm": 0.4222222222222222, "acc_norm_stderr": 0.07446027270295806 }, "community|acva:Saudi_Arabia|0": { "acc_norm": 0.358974358974359, "acc_norm_stderr": 0.03444042881521375 }, "community|acva:Somalia|0": { "acc_norm": 0.
