QCRI/DisasterVQA

DisasterVQA是一个用于评估视觉语言模型在灾难响应视觉问答任务上的基准数据集。它包含1,395张真实世界灾难图像和4,405个专家标注的问答对，涵盖洪水、野火和地震等灾害类型。问题类型包括二元（是/否）、多项选择和开放式问题，内容涉及情境感知和操作决策任务，并基于人道主义框架（如FEMA ESF和OCHA MIRA）。DisasterVQA is a benchmark dataset for evaluating vision-language models on disaster response visual question answering (VQA) tasks. It comprises 1,395 real-world disaster images and 4,405 expert-annotated question-answer pairs, covering disaster types such as floods, wildfires, and earthquakes. The question types include binary (yes/no), multiple-choice, and open-ended questions, with content involving situational awareness and operational decision-making tasks, and is developed based on humanitarian frameworks such as FEMA ESF and OCHA MIRA.