pharaouk/dharma-test2

--- configs: - config_name: default data_files: - split: 'dharma-test2_shuffled' path: final/dharma-test2_eval_shuffled* - split: 'dharma-test2_unshuffled' path: final/dharma-test2_eval_unshuffled* --- # "dharma-test2 Dataset" A dharma evaluation dataset with the following configuration: ||| Subject: MMLU, Size: 12 ||| ||| Subject: ARC-Challenge, Size: 12 ||| ||| Subject: ARC-Easy, Size: 12 ||| ||| Subject: BoolQ, Size: 12 ||| ||| Subject: winogrande, Size: 12 ||| ||| Subject: openbookqa, Size: 12 ||| ||| Subject: truthful_qa, Size: 12 ||| ||| Subject: agieval, Size: 12 ||| Made with https://github.com/pharaouk/dharma 🚀

原始信息汇总

dharma-test2 Dataset 概述

数据集配置

• 默认配置 (default):
  • 数据文件:
    • 分割: dharma-test2_shuffled
      • 路径: final/dharma-test2_eval_shuffled*
    • 分割: dharma-test2_unshuffled
      • 路径: final/dharma-test2_eval_unshuffled*

数据集内容

• 主题与大小:
  • MMLU: 大小为 12
  • ARC-Challenge: 大小为 12
  • ARC-Easy: 大小为 12
  • BoolQ: 大小为 12
  • winogrande: 大小为 12
  • openbookqa: 大小为 12
  • truthful_qa: 大小为 12
  • agieval: 大小为 12