THU-HRIA dataset(Human-Robot Interactive Action Dataset From The Perspective Of Service Robot)

Most of the existing human action datasets are common human actions in daily scenes（e.g. NTU RGB+D series, Kinetics series）, not created for Human-Robot Interaction(HRI), and most of them are not collected based on the perspective of the service robot, which can not meet the needs of vision-based interactive action recognition. This dataset is named as “Human-Robot Interactive Action Dataset From The Perspective Of Service Robot (THU-HRIA dataset) “ ,which is created for indoor service robot action interaction, collected by Tsinghua University. THU-HRIA Dataset uses a kinectV2 as multimodal sensor data collector, which can collect RGB, infrared, depth, bodypoints and other forms of data. In terms of specific content, the THU-HRIA dataset includes 8 common actions in both daily restaurant scene and robot interactive scene, totally 576 action samples. The eight action classes are: 1- waving ; 2- calling gesture; 3- beckoning; 4- stepping back; 5-eating; 6- pass by; 7-fall; 8:using phone. For each action, we set different specifications like distance, situation and repetition. Please see the description for more details.

现存的大多数人类行为数据集均为日常场景中的常见人类行为（例如，NTU RGB+D系列，Kinetics系列），并非专为人类-机器人交互（HRI）设计，且大多数并非基于服务机器人的视角进行收集，因此无法满足基于视觉的交互动作识别的需求。本数据集命名为“基于服务机器人视角的人类-机器人交互动作数据集（THU-HRIA数据集）”，旨在满足室内服务机器人动作交互的需求，由清华大学收集而成。THU-HRIA数据集采用kinectV2作为多模态传感器数据采集器，能够收集RGB、红外、深度、身体点等类型的数据。就具体内容而言，THU-HRIA数据集包含了日常餐厅场景和机器人交互场景中的8种常见动作，共计576个动作样本。这8种动作类别分别为：1-挥手；2-召唤手势；3-招手；4-后退；5-进食；6-路过；7-跌倒；8-使用电话。对于每一种动作，我们设定了不同的规格，如距离、情境和重复次数。更详细的描述请参阅相关说明。