Airline Pilot Action (APA)

With multiple large open source datasets, the development of action recognition is rapid. However, we noticed the lack of annotated data of cilvil aircraft pilots, while distribution of whose action can be very different from daily casual activities. After discussion with experienced pilots and experts and close look into standard operation procedure, we present Airline-Pilot-Action (APA) benchmark, containing 5090 RGB and depth images together with corresponding flight computer data. We present our real-world data collection on a Level D Simulator of 737MAX, mounted with RGBD camera, Intel RealSense D435i, and voice recorder, with assistance of a licensed pilot. 9 key points are labelled for each RGB and depth image in the dataset.