OALL/details_MaziyarPanahi__Calme-4x7B-MoE-v0.1
收藏Hugging Face2024-06-17 更新2024-06-29 收录
下载链接：
https://hf-mirror.com/datasets/OALL/details_MaziyarPanahi__Calme-4x7B-MoE-v0.1
下载链接
链接失效反馈官方服务：
资源简介：
该数据集是在评估模型MaziyarPanahi/Calme-4x7B-MoE-v0.1时自动创建的。数据集由136个配置组成，每个配置对应一个评估任务。数据集是从1次运行中创建的，每次运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳命名。train分割始终指向最新的结果。此外，还有一个名为results的配置存储了所有运行的聚合结果。
The dataset was automatically created during the evaluation run of model MaziyarPanahi/Calme-4x7B-MoE-v0.1. The dataset is composed of 136 configurations, each corresponding to one of the evaluated tasks. The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run. The train split always points to the latest results. Additionally, a configuration named results stores all the aggregated results of the run.
提供机构：
OALL
原始信息汇总
数据集概述
数据集基本信息
- 名称: Evaluation run of MaziyarPanahi/Calme-4x7B-MoE-v0.1
- 来源: 自动创建于模型评估过程中
- 配置数量: 136
- 创建次数: 1次
数据集结构
- 配置: 每个配置对应一个评估任务
- 分割: 每个运行结果作为特定分割存储，分割名称使用运行的时间戳
- 最新结果: "train" 分割指向最新结果
- 汇总结果: 额外配置 "results" 存储所有运行的汇总结果
数据加载示例
python from datasets import load_dataset data = load_dataset("OALL/details_MaziyarPanahi__Calme-4x7B-MoE-v0.1", "lighteval_xstory_cloze_ar_0", split="train")
最新结果
- 时间戳: 2024-06-17T16:16:31.117475
- 任务结果: 包含多个任务的评估结果，具体结果如下：
- all:
- acc_norm: 0.4986409419143599
- acc_norm_stderr: 0.037232181309916124
- acc: 0.5704831237590999
- acc_stderr: 0.012738639381354
- community|acva:Algeria|0:
- acc_norm: 0.6051282051282051
- acc_norm_stderr: 0.03509545602262038
- community|acva:Ancient_Egypt|0:
- acc_norm: 0.7301587301587301
- acc_norm_stderr: 0.02504943894585861
- community|acva:Arab_Empire|0:
- acc_norm: 0.47547169811320755
- acc_norm_stderr: 0.030735822206205608
- community|acva:Arabic_Architecture|0:
- acc_norm: 0.6512820512820513
- acc_norm_stderr: 0.034215338466705415
- community|acva:Arabic_Art|0:
- acc_norm: 0.6307692307692307
- acc_norm_stderr: 0.03464841141863756
- community|acva:Arabic_Astronomy|0:
- acc_norm: 0.4717948717948718
- acc_norm_stderr: 0.035840746749208334
- community|acva:Arabic_Calligraphy|0:
- acc_norm: 0.5764705882352941
- acc_norm_stderr: 0.03100369860682665
- community|acva:Arabic_Ceremony|0:
- acc_norm: 0.6648648648648648
- acc_norm_stderr: 0.03479907984892718
- community|acva:Arabic_Clothing|0:
- acc_norm: 0.5487179487179488
- acc_norm_stderr: 0.03572709860318392
- community|acva:Arabic_Culture|0:
- acc_norm: 0.6666666666666666
- acc_norm_stderr: 0.033844872171120644
- community|acva:Arabic_Food|0:
- acc_norm: 0.6410256410256411
- acc_norm_stderr: 0.03444042881521377
- community|acva:Arabic_Funeral|0:
- acc_norm: 0.7789473684210526
- acc_norm_stderr: 0.04279942901425772
- community|acva:Arabic_Geography|0:
- acc_norm: 0.5862068965517241
- acc_norm_stderr: 0.04104269211806232
- community|acva:Arabic_History|0:
- acc_norm: 0.5743589743589743
- acc_norm_stderr: 0.03549871080367708
- community|acva:Arabic_Language_Origin|0:
- acc_norm: 0.8
- acc_norm_stderr: 0.041256849850351704
- community|acva:Arabic_Literature|0:
- acc_norm: 0.7034482758620689
- acc_norm_stderr: 0.03806142687309993
- community|acva:Arabic_Math|0:
- acc_norm: 0.37948717948717947
- acc_norm_stderr: 0.03483959266365358
- community|acva:Arabic_Medicine|0:
- acc_norm: 0.7724137931034483
- acc_norm_stderr: 0.03493950380131184
- community|acva:Arabic_Music|0:
- acc_norm: 0.7410071942446043
- acc_norm_stderr: 0.03729198658164231
- community|acva:Arabic_Ornament|0:
- acc_norm: 0.7897435897435897
- acc_norm_stderr: 0.029256125643046842
- community|acva:Arabic_Philosophy|0:
- acc_norm: 0.7172413793103448
- acc_norm_stderr: 0.037528339580033376
- community|acva:Arabic_Physics_and_Chemistry|0:
- acc_norm: 0.6102564102564103
- acc_norm_stderr: 0.035014247762563705
- community|acva:Arabic_Wedding|0:
- acc_norm: 0.8
- acc_norm_stderr: 0.028718326344709482
- community|acva:Bahrain|0:
- acc_norm: 0.6666666666666666
- acc_norm_stderr: 0.07106690545187012
- community|acva:Comoros|0:
- acc_norm: 0.4888888888888889
- acc_norm_stderr: 0.07535922203472523
- community|acva:Egypt_modern|0:
- acc_norm: 0.6421052631578947
- acc_norm_stderr: 0.04944436957628254
- community|acva:InfluenceFromAncientEgypt|0:
- acc_norm: 0.8153846153846154
- acc_norm_stderr: 0.027855716655754162
- community|acva:InfluenceFromByzantium|0:
- acc_norm: 0.8758620689655172
- acc_norm_stderr: 0.027478236983636616
- community|acva:InfluenceFromChina|0:
- acc_norm: 0.4512820512820513
- acc_norm_stderr: 0.03572709860318392
- community|acva:InfluenceFromGreece|0:
- acc_norm: 0.8205128205128205
- acc_norm_stderr: 0.027552343052171045
- community|acva:InfluenceFromIslam|0:
- acc_norm: 0.8620689655172413
- acc_norm_stderr: 0.02873563218390807
- community|acva:InfluenceFromPersia|0:
- acc_norm: 0.7942857142857143
- acc_norm_stderr: 0.03064403697477198
- community|acva:InfluenceFromRome|0:
- acc_norm: 0.6974358974358974
- acc_norm_stderr: 0.03298070870085616
- community|acva:Iraq|0:
- acc_norm: 0.6352941176470588
- acc_norm_stderr: 0.05251932770420082
- community|acva:Islam_Education|0:
- acc_norm: 0.7589743589743589
- acc_norm_stderr: 0.030707489381124213
- community|acva:Islam_branches_and_schools|0:
- acc_norm: 0.6457142857142857
- acc_norm_stderr: 0.036259548638451475
- community|acva:Islamic_law_system|0:
- acc_norm: 0.7128205128205128
- acc_norm_stderr: 0.03248373338539885
- community|acva:Jordan|0:
- acc_norm: 0.5777777777777777
- acc_norm_stderr: 0.07446027270295805
- community|acva:Kuwait|0:
- acc_norm: 0.7555555555555555
- acc_norm_stderr: 0.06478835438717001
- community|acva:Lebanon|0:
- acc_norm: 0.6444444444444445
- acc_norm_stderr: 0.07216392363431014
- community|acva:Libya|0:
- acc_norm: 0.6
- acc_norm_stderr: 0.07385489458759964
- community|acva:Mauritania|0:
- acc_norm: 0.6444444444444445
- acc_norm_stderr: 0.07216392363431011
- community|acva:Mesopotamia_civilization|0:
- acc_norm: 0.6451612903225806
- acc_norm_stderr: 0.03855576159143203
- community|acva:Morocco|0:
- acc_norm: 0.6888888888888889
- acc_norm_stderr: 0.06979205927323111
- community|acva:Oman|0:
- acc_norm: 0.7777777777777778
- acc_norm_stderr: 0.06267511942419626
- community|acva:Palestine|0:
- acc_norm: 0.6823529411764706
- acc_norm_stderr: 0.05079691179733583
- community|acva:Qatar|0:
- acc_norm: 0.7111111111111111
- acc_norm_stderr: 0.06832943242540508
- community|acva:Saudi_Arabia|0:
- acc_norm: 0.517948717948718
- acc_norm_stderr: 0.03587477098773826
- community|acva:Somalia|0:
- acc_norm: 0.5777777777777777
- acc_norm_stderr: 0.07446027270295806
- community|acva:Sudan|0:
- acc_norm: 0.7111111111111111
- acc_norm_stderr: 0.06832943242540505
- community|acva:Syria|0:
- acc_norm: 0.6444444444444445
- acc_norm_stderr: 0.07216392363431014
- community|acva:Tunisia|0:
- acc_norm: 0.6444444444444445
- acc_norm_stderr: 0.07216392363431014
- community|acva:United_Arab_Emirates|0:
- acc_norm: 0.647058823529
- all:
