Holoscopic 3D Micro-Gesture Database

HoMG database was recorded using a holoscopic 3D camera, which have 3 conventional gestures from 40 participants under different settings and conditions. The principle of holoscopic 3D (H3D) imaging mimics fly’s eye technique that captures a true 3D optical model of the scene using a microlens array. For the purpose of H3D micro-gesture recognition. HoMG database has two subsets. The video subset has 960 videos and the image subset has 30635 images, while both have three type of microgestures (classes). Each subset has been devided into three partitions: training set, validation set and testing set where there is not overlap between them in term of the subjects. The database has been used for Holoscopic Micro-Gesture Recognition Challenge 2018 (HoMGR 2018) that was held at IEEE Face & Gesture 2018 (FG2018 ) - Xi'an, China, 15-19th May 2018 (https://fg2018.cse.sc.edu/Challenges.html). The database is now public available for wider research community in the research areas of holoscopic 3D image processing, machine learning for gesture recognition and its application in AR and VR.

HoMG数据库采用全视三维（holoscopic 3D）相机采集构建，涵盖40名参与者在不同设置与实验条件下的3类常规手势数据。全视三维成像技术的原理模仿复眼成像机制，通过微透镜阵列捕获场景的真实三维光学模型，本数据集的构建目标为全视三维微手势识别任务。HoMG数据库包含两个子集：视频子集与图像子集，其中视频子集包含960段视频，图像子集包含30635张图像，二者均覆盖3类微手势（类别）。每个子集均被划分为训练集、验证集与测试集，且三类数据集在受试者层面无数据重叠。该数据集曾用于2018年全视三维微手势识别挑战赛（Holoscopic Micro-Gesture Recognition Challenge 2018，简称HoMGR 2018），该赛事于2018年5月15日至19日在中国西安举办的IEEE面部与手势国际会议2018（IEEE Face & Gesture 2018，FG2018）中开展，赛事官网为https://fg2018.cse.sc.edu/Challenges.html。目前该数据集已对外开放，可供全视三维图像处理、手势识别相关机器学习研究及其在增强现实（AR）与虚拟现实（VR）领域的应用等方向的广大科研群体使用。