Airline Pilot Action (APA)

With multiple large open source datasets, the development of action recognition is rapid. However, we noticed the lack of annotated data of cilvil aircraft pilots, while distribution of whose action can be very different from daily casual activities. After discussion with experienced pilots and experts and close look into standard operation procedure, we present Airline-Pilot-Action (APA) benchmark, containing 5090 RGB and depth images together with corresponding flight computer data. We present our real-world data collection on a Level D Simulator of 737MAX, mounted with RGBD camera, Intel RealSense D435i, and voice recorder, with assistance of a licensed pilot. 9 key points are labelled for each RGB and depth image in the dataset.

伴随着众多大型开源数据集的涌现，动作识别领域的发展势头迅猛。然而，我们注意到民用飞机飞行员动作标注数据的缺乏，而此类动作的分布与日常休闲活动存在显著差异。经与经验丰富的飞行员及专家深入探讨，并细致研究标准操作程序，我们推出了Airline-Pilot-Action（APA）基准数据集，该数据集包含5090张RGB和深度图像，以及相应的飞行计算机数据。我们的真实世界数据采集是在737MAX的D级模拟器上进行的，该模拟器配备了RGBD相机、Intel RealSense D435i相机和录音设备，并在一名持证飞行员的协助下完成。数据集中的每张RGB和深度图像均标注了9个关键点。