vyokky/GUI-360

GUI-360°是一个大规模、全面的数据集和基准测试套件，旨在推动计算机使用代理（CUAs）的发展。它通过高度自动化的管道解决了现实世界CUA任务稀缺、多模态轨迹自动收集和注释管道的缺失以及统一评估GUI定位、屏幕解析和动作预测的基准测试套件缺失等问题。该数据集包含了超过120万次执行的动作步骤，涵盖数千个轨迹，应用于流行的Windows办公应用中，包括完整分辨率的截图、可访问性元数据、实例化目标、中间推理轨迹以及成功和失败的动作轨迹。

GUI-360° is a large-scale, comprehensive dataset and benchmark suite designed to advance computer-using agents (CUAs). It addresses the scarcity of real-world CUA tasks, the lack of automated collection-and-annotation pipelines for multi-modal trajectories, and the absence of a unified benchmark that jointly evaluates GUI grounding, screen parsing, and action prediction with a largely automated pipeline for query sourcing, environment-template construction, task instantiation, batched execution, and LLM-driven quality filtering. The dataset contains over 1.2M executed action steps across thousands of trajectories in popular Windows office applications, including full-resolution screenshots, accessibility metadata when available, instantiated goals, intermediate reasoning traces, and both successful and failed action trajectories.