HUMAN4D - Subject #1 (multi-RGBD + 2d/3d pose)

HUMAN4D: A Human-Centric Multimodal Dataset for Motions & Immersive Media (Subject #1) The dataset was captured with the use of VCL Volumetric Capture free software (https://github.com/VCL3D/VolumetricCapture) device_repository.json includes the camera instrinsic parameters. pose.zip includes the camera extrinsic calibration parameters. offsets.zip include the frame offset between the pose ids (name_of_file==id) and the group frame ids of the RGBD data (first number before underscore in the filename of each file) S1_activities.txt files that maps the zip filenames with data for specific activities. HUMAN4D is a large and multimodal 4D dataset that contains a variety of human activities simultaneously captured by a professional marker-based MoCap, a volumetric capture and an audio recording system. By capturing 2 female and 2 male professional actors performing various full-body movements and expressions, HUMAN4D provides a diverse set of motions and poses encountered as part of single- and multi-person daily, physical and social activities (jumping, dancing, etc.), along with multi-RGBD (mRGBD), volumetric and audio data. Despite the existence of multi-view color datasets captured with the use of hardware (HW) synchronization, to the best of our knowledge, HUMAN4D is the first and only public resource that provides volumetric depth maps with high synchronization precision due to the use of intra- and inter-sensor HW-SYNC.

HUMAN4D：以人为中心的动作与沉浸式媒体多模态数据集（受试者1）。本数据集借助VCL体积捕获（Volumetric Capture）免费软件（https://github.com/VCL3D/VolumetricCapture）完成采集。其中，device_repository.json包含相机内参；pose.zip包含相机外参校准参数；offsets.zip包含姿态ID（文件名即ID）与RGBD数据组帧ID（各文件文件名中下划线前的首个数字）之间的帧偏移量。S1_activities.txt文件用于建立压缩包文件名与特定活动对应数据的映射关系。HUMAN4D是一个大型多模态4D数据集，涵盖丰富的人类活动类型，由专业标记式动作捕捉（MoCap）系统、体积捕获系统与音频录制系统同步采集完成。该数据集招募2名女性与2名男性专业演员，令其完成各类全身动作与表情表演，由此提供了单人、多人日常活动、肢体活动与社交活动（如跳跃、舞蹈等）中多样的动作与姿态集合，同时配套多RGBD（mRGBD）数据、体积数据与音频数据。尽管已有部分多视图彩色数据集借助硬件（Hardware, HW）同步方式完成采集，但据我们所知，HUMAN4D是首个且唯一公开的、通过传感器内部与跨传感器硬件同步（HW-SYNC）实现高精度同步的体深度图数据集。