Holoscopic 3D Micro-Gesture Database

HoMG database was recorded using a holoscopic 3D camera, which have 3 conventional gestures from 40 participants under different settings and conditions. The principle of holoscopic 3D (H3D) imaging mimics fly’s eye technique that captures a true 3D optical model of the scene using a microlens array. For the purpose of H3D micro-gesture recognition. HoMG database has two subsets. The video subset has 960 videos and the image subset has 30635 images, while both have three type of microgestures (classes). Each subset has been devided into three partitions: training set, validation set and testing set where there is not overlap between them in term of the subjects. The database has been used for Holoscopic Micro-Gesture Recognition Challenge 2018 (HoMGR 2018) that was held at IEEE Face & Gesture 2018 (FG2018 ) - Xi'an, China, 15-19th May 2018 (https://fg2018.cse.sc.edu/Challenges.html). The database is now public available for wider research community in the research areas of holoscopic 3D image processing, machine learning for gesture recognition and its application in AR and VR.

HoMG数据库（HoMG database）采用全视3D相机（holoscopic 3D camera）录制，收录了40名参与者在不同设置与工况下完成的3类常规手势样本。全视3D（H3D）成像技术效仿复眼原理，通过微透镜阵列捕获场景的真实三维光学模型，本数据集专为全视3D微手势（micro-gesture）识别任务构建。HoMG数据库包含两个子集：视频子集与图像子集。其中视频子集包含960段视频，图像子集包含30635张图像，两类子集均涵盖3类微手势类别。每个子集均被划分为训练集（training set）、验证集（validation set）与测试集（testing set），且三者在受试者维度上无重叠。该数据集曾用于2018年全视微手势识别挑战赛（Holoscopic Micro-Gesture Recognition Challenge 2018，简称HoMGR 2018），该赛事于2018年5月15日至19日在中国西安举办的IEEE 2018面部与手势国际会议（IEEE Face & Gesture 2018，FG2018）期间举办，赛事官方页面为https://fg2018.cse.sc.edu/Challenges.html。目前该数据库已面向全视3D图像处理、面向手势识别的机器学习及其在增强现实（AR）与虚拟现实（VR）领域的应用等研究方向的广大科研群体开放共享。