EPIC-KITCHENS VISOR

We introduce VISOR, a new dataset of pixel annotations and a benchmark suite for segmenting hands and active objects in egocentric video. VISOR annotates videos from EPIC-KITCHENS, which comes with a new set of challenges not encountered in current video segmentation datasets. Specifically, we need to ensure both short- and long-term consistency of pixel-level annotations as objects undergo transformative interactions, e.g. an onion is peeled, diced and cooked - where we aim to obtain accurate pixel-level annotations of the peel, onion pieces, chopping board, knife, pan, as well as the acting hands. VISOR introduces an annotation pipeline, AI-powered in parts, for scalability and quality. Data published under the Creative Commons Attribution-NonCommerial 4.0 International License.

搜集汇总

背景与挑战

背景概述

EPIC-KITCHENS VISOR是一个用于第一人称视角视频中手部和活动物体像素级分割的数据集，基于EPIC-KITCHENS视频构建，专注于物体在交互过程中的长期和短期注释一致性。该数据集包含稀疏和密集注释，总大小28.4 GiB，发布于2022年，适用于非商业用途的计算机视觉研究。