MMMU_Pro
收藏arXiv2025-09-30 收录
下载链接:
https://huggingface.co/datasets/MMMU/MMMU_Pro
下载链接
链接失效反馈官方服务:
资源简介:
该数据集名为MMMU_Pro,是一个经过强化的多模态基准测试,旨在严格评估大型语言模型(LVLMs)的真实理解能力。它按照难度等级被划分为简单、中等和困难三个层次。该数据集的任务是评估模型在多项选择题中的预测表现。
This dataset, named MMMU_Pro, is an enhanced multimodal benchmark designed to rigorously evaluate the real-world comprehension capabilities of large vision-language models (LVLMs). It is categorized into three difficulty tiers: easy, medium, and hard. The task of this dataset is to assess the predictive performance of models on multiple-choice questions.
提供机构:
Hugging Face



