MERA-evaluation/ruCLEVR
收藏Hugging Face2024-12-12 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/MERA-evaluation/ruCLEVR
下载链接
链接失效反馈官方服务：
资源简介：
RuCLEVR是一个视觉问答（VQA）数据集，专为俄语设计，旨在评估多模态语言模型在视觉推理方面的能力。数据集包含自动生成的3D对象图像和基于这些图像的问题，问题分为多个家族，如属性查询、比较、存在性、计数和整数比较等。数据集的创建包括新样本的生成和颜色替换的数据增强两种策略。评估方法包括精确匹配（Exact match）指标。
RuCLEVR is a Visual Question Answering (VQA) dataset designed for the Russian language, aimed at evaluating the visual reasoning capabilities of multimodal language models. The dataset includes automatically generated images of 3D objects and questions based on these images, organized into families such as attribute queries, comparisons, existence, counting, and integer comparison. The dataset creation involves two strategies: generation of new samples and data augmentation with color replacement. The evaluation method includes the Exact match metric.
提供机构：
MERA-evaluation
