ONE-Lab/GUI-World

GUI-World是一个用于评估多模态大型语言模型在动态和复杂GUI环境中的综合基准数据集。它包含覆盖六种GUI场景和八种GUI导向问题的广泛注释。该数据集旨在推动开发能够感知和与静态及动态GUI元素互动的稳健GUI代理。

GUI-World introduces a comprehensive benchmark for evaluating MLLMs in dynamic and complex GUI environments. It features extensive annotations covering six GUI scenarios and eight types of GUI-oriented questions. The dataset aims to advance the development of robust GUI agents capable of perceiving and interacting with both static and dynamic GUI elements.