MIUN dataset for semi-autonomous powered wheelchair control

A powered wheelchair detects and follows a caregiver walking beside it. Caregiver recognition is performed by detecting the caregiver feet above the floor. The dataset contains a set of images and annotated labels for a feet recognition application. The camera is placed in the right armrest of the powered wheelchair, tilted down 45 degrees. The camera measures the caregiver's feet walking beside the powered wheelchair. The dataset also includes the training, validation and test files definition for different camera image outputs (Depth, RGB, RGB-D), scenarios and light conditions.

Images are captured by an Intel Realsense D455 depth camera. The dataset includes separate image files for each camera output (Depth, RGB, RGBD) and annotated labels for each frame. Each camera measurement contains 30 seconds of images, recorded at 6 frames/second (180 frames). The total number of images is 6000 (3000 including feet labels and 3000 without). The labelling process has been performed using the software labelImg. Sample scenarios and related frame numbers are defined in the readme.txt file.