FixMyPose Dataset

FixMyPose is a dataset for automated pose correction. It consists of descriptions to correct a "current" pose to look like a "target" pose, in English and Hindi. The collected descriptions have interesting linguistic properties such as egocentric relations to environment objects, analogous references, etc., requiring an understanding of spatial relations and commonsense knowledge about postures.

Further, to avoid ML biases, the dataset maintains a balance across characters with diverse demographics, who perform a variety of movements in several interior environments (e.g., homes, offices).

This dataset introduces the pose-correctional-captioning task and its reverse target-pose-retrieval task. During the correctional-captioning task, models must generate descriptions of how to move from the current to target pose image, whereas in the retrieval task, models should select the correct target pose given the initial pose and correctional description.

FixMyPose 是一款旨在实现姿态自动校正的数据集。该数据集包含将“当前”姿态校正为“目标”姿态的描述，这些描述以英语和印地语呈现。所收集的描述中蕴含着丰富的语言学特性，例如以自我为中心的环境对象关系、类比参照等，这要求对空间关系以及关于姿态的常识性知识有所理解。此外，为避免机器学习中的偏差，该数据集在具有不同人口统计学特征的各类角色之间保持平衡，这些角色在多种室内环境中（例如家庭、办公室）进行多样化的动作。该数据集引入了姿态校正配对任务及其逆向的目标姿态检索任务。在姿态校正配对任务中，模型需生成从当前姿态到目标姿态图像的移动描述；而在检索任务中，模型应基于初始姿态和校正描述选择正确的目标姿态。