Inst-IT/Inst-IT-Bench
收藏Hugging Face2024-12-16 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/Inst-IT/Inst-IT-Bench
下载链接
链接失效反馈官方服务：
资源简介：
Inst-IT Bench是一个细粒度的多模态基准数据集，用于评估多模态模型在实例级别的理解能力。数据集包含图像和视频两部分，图像部分包含1,036个问答对和338张图像，视频部分包含1,001个问答对和206个视频。每个问答对都有开放式和多项选择题两种形式。数据集旨在提供更深入的实例级理解能力评估，弥补现有多模态基准在全局理解上的不足。
Inst-IT Bench is a fine-grained multimodal benchmark designed to evaluate the instance-level multimodal understanding capabilities of large multimodal models (LMMs). The dataset includes both image and video splits, containing 1,036 QA pairs and 1,001 QA pairs respectively, with each QA pair available in both open-ended and multiple-choice formats. The dataset aims to provide in-depth evaluation of models instance-level understanding in images and videos.
提供机构：
Inst-IT
