PixelHelp

PixelHelp 包含 4 个任务类别的 187 个多步骤指令，这些指令在 https://support.google.com/pixelphone 中定义并由人工注释。该数据集包括 88 个常规任务，例如配置帐户、38 个 Gmail 任务、31 个 Chrome 任务和 30 个照片相关任务。该数据集是原始 PixelHelp 数据集的更新开源版本，用于在论文“将自然语言指令映射到移动 UI 动作序列”中测试模型的端到端接地质量。在此版本的数据集上获得了类似的准确性。PixelHelp comprises 187 multi-step instructions across four task categories, which are defined on https://support.google.com/pixelphone and manually annotated by human annotators. This dataset includes 88 general tasks such as account configuration, 38 Gmail-related tasks, 31 Chrome-related tasks, and 30 photo-related tasks. It is an updated open-source version of the original PixelHelp dataset, which is used to test the end-to-end grounding quality of models in the paper "Mapping Natural Language Instructions to Mobile UI Action Sequences". Similar accuracy has been achieved on this version of the dataset.

搜集汇总

背景与挑战

背景概述

PixelHelp数据集包含187个多步骤指令，涵盖4个任务类别（常规、Gmail、Chrome和照片任务），主要用于测试自然语言指令到移动UI动作序列的映射能力。该数据集由Google Research于2020年发布，是相关研究论文的基础数据。