OALL/details_ibivibiv__llama3-8b-instruct-summary-combined
收藏数据集概述
数据集基本信息
- 名称: Evaluation run of ibivibiv/llama3-8b-instruct-summary-combined
- 来源: 自动创建于模型评估过程中
- 配置数量: 136
- 创建次数: 1次
数据集结构
- 配置: 每个配置对应一个评估任务
- 分割: 每个运行结果作为一个特定的分割，分割名称使用运行的时间戳
- 训练分割: 始终指向最新的结果
- 结果配置: 存储所有运行的聚合结果
数据加载示例
python from datasets import load_dataset data = load_dataset("OALL/details_ibivibiv__llama3-8b-instruct-summary-combined", "lighteval_xstory_cloze_ar_0", split="train")
最新结果
- 时间戳: 2024-06-24T00:29:16.784254
- 结果: 包含多个任务的评估结果，具体结果如下：
任务结果示例
-
任务: community|acva:Algeria|0
- acc_norm: 0.5230769230769231
- acc_norm_stderr: 0.0358596530894741
-
任务: community|acva:Ancient_Egypt|0
- acc_norm: 0.050793650793650794
- acc_norm_stderr: 0.01239139518482262
-
任务: community|acva:Arab_Empire|0
- acc_norm: 0.30943396226415093
- acc_norm_stderr: 0.028450154794118627
-
任务: community|acva:Arabic_Architecture|0
- acc_norm: 0.4564102564102564
- acc_norm_stderr: 0.035761230969912135
-
任务: community|acva:Arabic_Art|0
- acc_norm: 0.37435897435897436
- acc_norm_stderr: 0.03474608430626236
-
任务: community|acva:Arabic_Astronomy|0
- acc_norm: 0.4666666666666667
- acc_norm_stderr: 0.03581804596782233
-
任务: community|acva:Arabic_Calligraphy|0
- acc_norm: 0.6
- acc_norm_stderr: 0.03073893117471353
-
任务: community|acva:Arabic_Ceremony|0
- acc_norm: 0.5243243243243243
- acc_norm_stderr: 0.0368168445060319
-
任务: community|acva:Arabic_Clothing|0
- acc_norm: 0.5128205128205128
- acc_norm_stderr: 0.03588610523192215
-
任务: community|acva:Arabic_Culture|0
- acc_norm: 0.23076923076923078
- acc_norm_stderr: 0.0302493752938313
-
任务: community|acva:Arabic_Food|0
- acc_norm: 0.441025641025641
- acc_norm_stderr: 0.0356473293185358
-
任务: community|acva:Arabic_Funeral|0
- acc_norm: 0.4
- acc_norm_stderr: 0.050529115263991134
-
任务: community|acva:Arabic_Geography|0
- acc_norm: 0.6137931034482759
- acc_norm_stderr: 0.04057324734419035
-
任务: community|acva:Arabic_History|0
- acc_norm: 0.30256410256410254
- acc_norm_stderr: 0.03298070870085619
-
任务: community|acva:Arabic_Language_Origin|0
- acc_norm: 0.5473684210526316
- acc_norm_stderr: 0.051339113773544845
-
任务: community|acva:Arabic_Literature|0
- acc_norm: 0.4689655172413793
- acc_norm_stderr: 0.04158632762097828
-
任务: community|acva:Arabic_Math|0
- acc_norm: 0.30256410256410254
- acc_norm_stderr: 0.03298070870085618
-
任务: community|acva:Arabic_Medicine|0
- acc_norm: 0.46206896551724136
- acc_norm_stderr: 0.041546596717075474
-
任务: community|acva:Arabic_Music|0
- acc_norm: 0.23741007194244604
- acc_norm_stderr: 0.036220593237998276
-
任务: community|acva:Arabic_Ornament|0
- acc_norm: 0.4717948717948718
- acc_norm_stderr: 0.035840746749208334
-
任务: community|acva:Arabic_Philosophy|0
- acc_norm: 0.5793103448275863
- acc_norm_stderr: 0.0411391498118926
-
任务: community|acva:Arabic_Physics_and_Chemistry|0
- acc_norm: 0.5333333333333333
- acc_norm_stderr: 0.03581804596782232
-
任务: community|acva:Arabic_Wedding|0
- acc_norm: 0.41025641025641024
- acc_norm_stderr: 0.03531493712326671
-
任务: community|acva:Bahrain|0
- acc_norm: 0.3111111111111111
- acc_norm_stderr: 0.06979205927323111
-
任务: community|acva:Comoros|0
- acc_norm: 0.37777777777777777
- acc_norm_stderr: 0.07309112127323451
-
任务: community|acva:Egypt_modern|0
- acc_norm: 0.3157894736842105
- acc_norm_stderr: 0.04794350420740798
-
任务: community|acva:InfluenceFromAncientEgypt|0
- acc_norm: 0.6
- acc_norm_stderr: 0.035172622905632896
-
任务: community|acva:InfluenceFromByzantium|0
- acc_norm: 0.7172413793103448
- acc_norm_stderr: 0.03752833958003337
-
任务: community|acva:InfluenceFromChina|0
- acc_norm: 0.26153846153846155
- acc_norm_stderr: 0.03155228802742769
-
任务: community|acva:InfluenceFromGreece|0
- acc_norm: 0.6307692307692307
- acc_norm_stderr: 0.034648411418637566
-
任务: community|acva:InfluenceFromIslam|0
- acc_norm: 0.296551724137931
- acc_norm_stderr: 0.03806142687309993
-
任务: community|acva:InfluenceFromPersia|0
- acc_norm: 0.6971428571428572
- acc_norm_stderr: 0.03483414676585986
-
任务: community|acva:InfluenceFromRome|0
- acc_norm: 0.5743589743589743
- acc_norm_stderr: 0.03549871080367708
-
任务: community|acva:Iraq|0
- acc_norm: 0.5058823529411764
- acc_norm_stderr: 0.05455069703232772
-
任务: community|acva:Islam_Education|0
- acc_norm: 0.4512820512820513
- acc_norm_stderr: 0.03572709860318392
-
任务: community|acva:Islam_branches_and_schools|0
- acc_norm: 0.4342857142857143
- acc_norm_stderr: 0.037576101528126626
-
任务: community|acva:Islamic_law_system|0
- acc_norm: 0.4256410256410256
- acc_norm_stderr: 0.035498710803677086
-
任务: community|acva:Jordan|0
- acc_norm: 0.3333333333333333
- acc_norm_stderr: 0.07106690545187012
-
任务: community|acva:Kuwait|0
- acc_norm: 0.26666666666666666
- acc_norm_stderr: 0.06666666666666667
-
任务: community|acva:Lebanon|0
- acc_norm: 0.17777777777777778
- acc_norm_stderr: 0.05763774795025094
-
任务: community|acva:Libya|0
- acc_norm: 0.4444444444444444
- acc_norm_stderr: 0.07491109582924914
-
任务: community|acva:Mauritania|0
- acc_norm: 0.4222222222222222
- acc_norm_stderr: 0.07446027270295805
-
任务: community|acva:Mesopotamia_civilization|0
- acc_norm: 0.5225806451612903
- acc_norm_stderr: 0.0402500394824441
-
任务: community|acva:Morocco|0
- acc_norm: 0.2222222222222222
- acc_norm_stderr: 0.06267511942419628
-
任务: community|acva:Oman|0
- acc_norm: 0.17777777777777778
- acc_norm_stderr: 0.05763774795025094
-
任务: community|acva:Palestine|0
- acc_norm: 0.24705882352941178
- acc_norm_stderr: 0.047058823529411785
-
任务: community|acva:Qatar|0
- acc_norm: 0.4
- acc_norm_stderr: 0.07385489458759964
-
任务: community|acva:Saudi_Arabia|0
- acc_norm: 0.3333333333333333
- acc_norm_stderr: 0.03384487217112065
-
任务: community|acva:Somalia|0
- acc_norm: 0.35555555555555557
- acc_norm_stderr: 0.07216392363431012
-
任务: community|acva:Sudan|0
- acc_norm: 0.35555555555555557
- acc_norm_stderr: 0.07216392363431012
-
任务: community|acva:Syria|0
- acc_norm: 0.3333333333333333
- acc_norm_stderr: 0.07106690545187012
-
任务: community|acva:Tunisia|0
- acc_norm: 0.3111111111111111
- acc_norm_stderr: 0.06979205927323111
-
任务: community|acva:United_Arab_Em
