SUMediPose

<p>This dataset was developed to aid in medical-grade markerless motion capture for 2D and 3D Pose Estimation. </p>

<p>We introduce a multimodal dataset comprising 3,444 videos, 2,896,943 image frames, and 3,804,413 corresponding 3D and 2D marker-based motion capture keypoint coordinates. The dataset includes 28 participants performing seven strength and conditioning actions at three different speeds. Video and image data were captured using a custom-developed multi-RGB-camera system, while the marker-based 3D data was acquired using the Vicon system and projected into the cameras' 3D and 2D spaces. The multi-RGB-camera system consists of six cameras arranged in a circular formation around the subject, offering a full 360-degree view of the scene from the same height and resulting in a diverse set of viewing angles. The recording setup was designed to allow both capture systems to record participants' movements simultaneously, synchronizing the data to provide ground truth 3D data, which was then back-projected to generate 2D-pixel keypoint data for each corresponding image frame. This design enables the dataset to support both 2D and 3D pose estimation tasks. A professional placed an extensive array of markers on each participant to ensure anatomical accuracy, adhering to industry standards.</p>

<p>The dataset also includes all intrinsic and extrinsic camera parameters, as well as origin axis data, necessary for performing any 3D or 2D projections. This allows the dataset to be adjusted and tailored to meet specific research or application needs.</p>