Holoscopic 3D Micro-Gesture Database

HoMG database was recorded using a holoscopic 3D camera, which have 3 conventional gestures from 40 participants under different settings and conditions. The principle of holoscopic 3D (H3D) imaging mimics fly’s eye technique that captures a true 3D optical model of the scene using a microlens array. For the purpose of H3D micro-gesture recognition. HoMG database has two subsets. The video subset has 960 videos and the image subset has 30635 images, while both have three type of microgestures (classes). Each subset has been devided into three partitions: training set, validation set and testing set where there is not overlap between them in term of the subjects. The database has been used for Holoscopic Micro-Gesture Recognition Challenge 2018 (HoMGR 2018) that was held at IEEE Face & Gesture 2018 (FG2018 ) - Xi'an, China, 15-19th May 2018 (https://fg2018.cse.sc.edu/Challenges.html). The database is now public available for wider research community in the research areas of holoscopic 3D image processing, machine learning for gesture recognition and its application in AR and VR.

HoMG数据库（HoMG database）采用全视三维（holoscopic 3D, H3D）相机录制，包含40名参与者在不同设置与实验条件下的3类常规微手势数据。全视三维成像技术模仿复眼成像原理，通过微透镜阵列采集场景的真实三维光学模型，本数据集专为全视三维微手势（micro-gesture）识别任务构建。HoMG数据库包含两个子集：视频子集含960段视频，图像子集含30635张图像，二者均涵盖3类微手势（类别）。每个子集均被划分为训练集、验证集与测试集，且三类集合在受试者层面不存在数据重叠。该数据集曾用于2018年全视三维微手势识别挑战赛（Holoscopic Micro-Gesture Recognition Challenge 2018, HoMGR 2018），该赛事于2018年5月15日至19日在中国西安举办的IEEE国际人脸与手势感知会议（IEEE Face & Gesture 2018, FG2018）中举行，赛事官网为https://fg2018.cse.sc.edu/Challenges.html。目前该数据库已面向全视三维图像处理、手势识别机器学习及其在增强现实（AR）与虚拟现实（VR）领域的应用等研究方向的广大科研群体公开。