VisArgs
收藏资源简介:
VisArgs数据集由延世大学等机构创建,包含1,611张图像,专门用于视觉论证理解。数据集内容包括广告和卡通图像,每张图像配有视觉前提、常识前提和论证树等三种文本注释。创建过程中,首先使用GPT-4-O模型生成初步注释,然后由专业人员进行精细调整。该数据集主要应用于评估机器对视觉论证的理解能力,特别是在视觉前提的定位、识别和结论推断方面。
The VisArgs dataset was developed by institutions including Yonsei University, and consists of 1,611 images dedicated to visual argumentation understanding. The dataset encompasses advertising and cartoon images, with three types of textual annotations for each image: visual premise, common-sense premise, and argument tree. During its creation, preliminary annotations were first generated using the GPT-4-O model, followed by meticulous refinement conducted by professional annotators. This dataset is primarily utilized to assess machines' capability to comprehend visual arguments, particularly in the tasks of visual premise localization, recognition, and conclusion inference.
视觉论证理解数据集
数据集概述
该数据集用于视觉论证理解,包含图像、视觉前提、结论、边界框、常识前提和推理步骤。数据集可通过Hugging Face访问。
数据加载
python from datasets import load_dataset
加载主数据
dset = load_dataset("jiwan-chung/visargs", "annotations")
加载预定义的负样本集,用于“前提识别”任务
dset = load_dataset("jiwan-chung/visargs", "negatives")
数据实例
json { url: https://i.pinimg.com/originals/5e/7f/10/5e7f108728fb848eb8e3cccfdd62ef8f.jpg, visual_premises: [ A small plant is growing inside a plastic bag., The bag contains a bit of soil., The bag is tied at the top, enclosing the plant. ], conclusion: The image represents the struggle of nature to survive in a human-made, constraining environment, highlighting the need for environmental awareness and protection., b_box: [ {h: 41, startX: 302, startY: 554, w: 72}, {h: 51, startX: 223, startY: 589, w: 229}, {h: 421, startX: 46, startY: 219, w: 407} ], commonsense_premises: [ Plants require soil, water, light, and air to grow., Plastic bags are not a natural environment for plant growth and can restrict access to necessary resources., The act of enclosing the plant in a bag could symbolize suffocation or limitation of growth. ], reasoning_steps: [ (VP1, VP2, CP1 -> IC1): The small plant is growing, showing its resilience and need for natural resources., "(VP3, CP2, CP3 -> IC2): The plastic bag enclosing the plant symbolizes human-imposed constraints on natures growth and survival.", "(IC1, IC2 -> C): The image represents natures struggle to survive in a constrained environment, emphasizing the importance of environmental protection." ] }




