Zaid/mmlu-random-D

该数据集包含多个主题的问答数据，涵盖了抽象代数、解剖学、天文学、商业伦理、临床知识、大学生物学、大学化学、大学计算机科学、大学数学、大学医学、大学物理学、计算机安全、概念物理学、计量经济学、电气工程、初等数学、形式逻辑、全球事实、高中生物学、高中化学、高中计算机科学、高中欧洲历史、高中地理、高中政府与政治、高中宏观经济学、高中数学、高中微观经济学、高中物理学、高中心理学、高中统计学、高中美国历史、高中世界历史、人类衰老、人类性行为、国际法、法理学、逻辑谬误和机器学习等主题。每个数据集包含问题、主题、选项和答案，并分为测试集、验证集和开发集。

The dataset includes multiple configurations, each representing questions from different subjects. Each configuration contains features such as question, subject, choices, and answer. The dataset is divided into test, validation, and dev splits, each with different numbers of bytes and examples.

原始信息汇总

数据集概述

数据集配置

抽象代数 (abstract_algebra)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 21316 bytes, 100 examples
  • validation: 2232 bytes, 11 examples
  • dev: 918 bytes, 5 examples
• 下载大小: 17175 bytes
• 数据集大小: 24466 bytes

全部 (all)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 6967453 bytes, 14042 examples
  • validation: 763484 bytes, 1531 examples
  • dev: 125353 bytes, 285 examples
• 下载大小: 3987560 bytes
• 数据集大小: 7856290 bytes

解剖学 (anatomy)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 34594 bytes, 135 examples
  • validation: 3282 bytes, 14 examples
  • dev: 1010 bytes, 5 examples
• 下载大小: 28913 bytes
• 数据集大小: 38886 bytes

天文学 (astronomy)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 48735 bytes, 152 examples
  • validation: 5223 bytes, 16 examples
  • dev: 2129 bytes, 5 examples
• 下载大小: 39371 bytes
• 数据集大小: 56087 bytes

商业伦理 (business_ethics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 35140 bytes, 100 examples
  • validation: 3235 bytes, 11 examples
  • dev: 2273 bytes, 5 examples
• 下载大小: 31636 bytes
• 数据集大小: 40648 bytes

临床知识 (clinical_knowledge)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 68572 bytes, 265 examples
  • validation: 7290 bytes, 29 examples
  • dev: 1308 bytes, 5 examples
• 下载大小: 51595 bytes
• 数据集大小: 77170 bytes

大学生物学 (college_biology)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 51521 bytes, 144 examples
  • validation: 5111 bytes, 16 examples
  • dev: 1615 bytes, 5 examples
• 下载大小: 42960 bytes
• 数据集大小: 58247 bytes

大学化学 (college_chemistry)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 26796 bytes, 100 examples
  • validation: 2484 bytes, 8 examples
  • dev: 1424 bytes, 5 examples
• 下载大小: 26817 bytes
• 数据集大小: 30704 bytes

大学计算机科学 (college_computer_science)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 45429 bytes, 100 examples
  • validation: 4959 bytes, 11 examples
  • dev: 2893 bytes, 5 examples
• 下载大小: 40995 bytes
• 数据集大小: 53281 bytes

大学数学 (college_mathematics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 26999 bytes, 100 examples
  • validation: 2909 bytes, 11 examples
  • dev: 1596 bytes, 5 examples
• 下载大小: 26807 bytes
• 数据集大小: 31504 bytes

大学医学 (college_medicine)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 85845 bytes, 173 examples
  • validation: 8337 bytes, 22 examples
  • dev: 1758 bytes, 5 examples
• 下载大小: 56271 bytes
• 数据集大小: 95940 bytes

大学物理 (college_physics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 32107 bytes, 102 examples
  • validation: 3687 bytes, 11 examples
  • dev: 1495 bytes, 5 examples
• 下载大小: 29502 bytes
• 数据集大小: 37289 bytes

计算机安全 (computer_security)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 29212 bytes, 100 examples
  • validation: 4768 bytes, 11 examples
  • dev: 1194 bytes, 5 examples
• 下载大小: 30167 bytes
• 数据集大小: 35174 bytes

概念物理 (conceptual_physics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 45867 bytes, 235 examples
  • validation: 5034 bytes, 26 examples
  • dev: 1032 bytes, 5 examples
• 下载大小: 34887 bytes
• 数据集大小: 51933 bytes

计量经济学 (econometrics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 48359 bytes, 114 examples
  • validation: 5147 bytes, 12 examples
  • dev: 1712 bytes, 5 examples
• 下载大小: 36018 bytes
• 数据集大小: 55218 bytes

电气工程 (electrical_engineering)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 28900 bytes, 145 examples
  • validation: 3307 bytes, 16 examples
  • dev: 1090 bytes, 5 examples
• 下载大小: 26719 bytes
• 数据集大小: 33297 bytes

初等数学 (elementary_mathematics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 79924 bytes, 378 examples
  • validation: 10042 bytes, 41 examples
  • dev: 1558 bytes, 5 examples
• 下载大小: 54899 bytes
• 数据集大小: 91524 bytes

形式逻辑 (formal_logic)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 51789 bytes, 126 examples
  • validation: 6464 bytes, 14 examples
  • dev: 1825 bytes, 5 examples
• 下载大小: 32818 bytes
• 数据集大小: 60078 bytes

全球事实 (global_facts)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 19991 bytes, 100 examples
  • validation: 2013 bytes, 10 examples
  • dev: 1297 bytes, 5 examples
• 下载大小: 19296 bytes
• 数据集大小: 23301 bytes

高中生物学 (high_school_biology)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 116850 bytes, 310 examples
  • validation: 11746 bytes, 32 examples
  • dev: 1776 bytes, 5 examples
• 下载大小: 78207 bytes
• 数据集大小: 130372 bytes

高中化学 (high_school_chemistry)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 63527 bytes, 203 examples
  • validation: 7630 bytes, 22 examples
  • dev: 1333 bytes, 5 examples
• 下载大小: 45776 bytes
• 数据集大小: 72490 bytes

高中计算机科学 (high_school_computer_science)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 47664 bytes, 100 examples
  • validation: 3619 bytes, 9 examples
  • dev: 3066 bytes, 5 examples
• 下载大小: 39051 bytes
• 数据集大小: 54349 bytes

高中欧洲历史 (high_school_european_history)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 275568 bytes, 165 examples
  • validation: 30196 bytes, 18 examples
  • dev: 11712 bytes, 5 examples
• 下载大小: 196187 bytes
• 数据集大小: 317476 bytes

高中地理 (high_school_geography)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 46972 bytes, 198 examples
  • validation: 4870 bytes, 22 examples
  • dev: 1516 bytes, 5 examples
• 下载大小: 38167 bytes
• 数据集大小: 53358 bytes

高中政府与政治 (high_school_government_and_politics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 73589 bytes, 193 examples
  • validation: 7870 bytes, 21 examples
  • dev: 1962 bytes, 5 examples
• 下载大小: 52709 bytes
• 数据集大小: 83421 bytes

高中宏观经济学 (high_school_macroeconomics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 129375 bytes, 390 examples
  • validation: 14298 bytes, 43 examples
  • dev: 1466 bytes, 5 examples
• 下载大小: 68739 bytes
• 数据集大小: 145139 bytes

高中数学 (high_school_mathematics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 62132 bytes, 270 examples
  • validation: 6536 bytes, 29 examples
  • dev: 1420 bytes, 5 examples
• 下载大小: 45161 bytes
• 数据集大小: 70088 bytes

高中微观经济学 (high_school_microeconomics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 82831 bytes, 238 examples
  • validation: 8321 bytes, 26 examples
  • dev: 1436 bytes, 5 examples
• 下载大小: 49862 bytes
• 数据集大小: 92588 bytes

高中物理 (high_school_physics)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 62999 bytes, 151 examples
  • validation: 7150 bytes, 17 examples
  • dev: 1592 bytes, 5 examples
• 下载大小: 45477 bytes
• 数据集大小: 71741 bytes

高中心理学 (high_school_psychology)

• 特征:
  • question: string
  • subject: string
  • choices: sequence of string
  • answer: class_label (A, B, C, D)
• 分割:
  • test: 173565 bytes, 545 examples
  • validation: 18817 bytes, 60 examples
  • dev: 2023 bytes, 5 examples