Alibaba-DAMO-Academy/RynnEC-Bench

RynnEC-Bench是一个针对细粒度Embodied Understanding模型的评估数据集，包含507个真实家庭场景的视频片段。它通过对象认知和空间认知两个维度对模型进行评估，提供了对象属性认知和指代对象分割两种任务的数据，以及用于形成3D空间意识的数据。数据集还包括一个较小的子集RynnEC-Bench-mini。RynnEC-Bench is an evaluation dataset for fine-grained Embodied Understanding models, consisting of 507 video clips captured in real household scenarios. It evaluates models on two dimensions: object cognition and spatial cognition, providing data for object property cognition, referring object segmentation tasks, and data for forming 3D spatial awareness. The dataset also includes a smaller subset, RynnEC-Bench-mini.