bench-temp/mmlu-pt-undergraduate-ablation-v2-notink-easy50
收藏资源简介:
该数据集是一个多学科领域的问答任务数据集,包含多个学科分割,如会计、建筑、商业管理、经济学、健康与生物科学、人文、语言、法律和STEM(科学、技术、工程和数学)。每个数据样本具有以下特征:任务原始文本(task_raw)、问题ID(question_id)、难度正确数量(difficulty_num_correct)和难度分数(difficulty_score)。数据集旨在评估问题难度和学科分类,总数据集大小为632,486字节,涵盖6,778个示例(以法律学科为例)。
This dataset is a multi-disciplinary question-answering task dataset that includes splits across various fields such as accounting, architecture, business administration, economics, health and biological sciences, humanities, languages, law, and STEM (Science, Technology, Engineering, and Mathematics). Each data sample features: task_raw (raw task text), question_id (question identifier), difficulty_num_correct (number of correct responses for difficulty assessment), and difficulty_score (difficulty score). The dataset is designed to evaluate question difficulty and subject classification, with a total dataset size of 632,486 bytes and covering 6,778 examples (e.g., in the law split).



