UBC-NLP/PEARL-X

PEARL-X（PEARL扩展）是一个专门设计的基准数据集，旨在通过关注在多种阿拉伯语境中以不同方式表现出的共享文化概念，来评估细微的文化理解能力。它包含了单图像和多图像的问答任务，挑战模型比较、对比和综合关于在文化上共享但视觉上不同的项目（例如，不同类型的咖啡、传统服饰）的信息。

PEARL-X (PEARL eXtension) is a specialized benchmark designed to evaluate nuanced cultural understanding by focusing on shared cultural concepts that manifest differently across various Arab contexts. It incorporates both single-image and multi-image question-answering tasks, challenging models to compare, contrast, and synthesize information about culturally shared yet visually distinct items (e.g., different types of coffee, traditional attire).