crag-mm-2025/crag-mm-multi-turn-debug-public

CRAG-MM数据集是一个高质量的多模态对话基准，包含关于图像的不同复杂度的对话，旨在评估AI系统的视觉理解和对话能力。该数据集是一个视觉问答基准，专注于事实性问题，提供独特的图像和问答集合，以实现对可穿戴设备的全面评估。数据集包括由RayBan Meta智能眼镜捕获的第一人称图像和公共图像（网址），涵盖13个领域。它包含4种类型的问题，从只需查看图像即可回答的简单查询到需要多源检索和推理的复杂问题。CRAG-MM包括单轮和多轮对话，提供了对MM-RAG解决方案的全面评估。

The CRAG-MM dataset is a high-quality conversational benchmark for multimodal assistants, featuring conversations about images with varied complexity levels, designed to evaluate AI systems visual understanding and conversational abilities. It is a visual question-answering benchmark that focuses on factual questions, offering a unique collection of image and question-answering sets to enable comprehensive assessment of wearable devices. The dataset includes egocentric images captured by RayBan Meta smart glasses and public images (urls), covering 13 domains. It features 4 types of questions, from simple queries answerable by looking at the image to complex ones requiring multi-source retrieval and reasoning. CRAG-MM encompasses both single-turn and multi-turn conversations, providing a comprehensive evaluation of MM-RAG solutions.