A VibV Dataset Integrating Vibration and Vision for Enhanced Safety in Self-Driving Tasks

Due to the complexity of real-world traffic scenarios, autonomous driving systems still face safety challenges and uncontrolled threats in blind spots. Currently, these systems primarily rely on cameras, LiDAR, radar, and their fusion to perceive the environment. However, under special road conditions or extreme weather, they may exhibit defects, resulting in false detections or missed detections, which can lead to safety accidents. This paper proposes the VibV dataset, which introduces vehicle vibration signals into the autonomous driving perception system. By increasing the modalities of information, it enhances the system's sensing capabilities, thereby improving safety. This dataset recorded vibration signals and vision data simultaneously in scenes such as rumble strips and speed bumps. It performed a total of 39 experiments over the course of two months, resulting in 39 segments of vibration data and 22,677 original video frames. The vibration signals underwent preliminary processing, and the images were manually annotated and classified. Technical evaluations have proven the dataset's usability and reliability. It can be applied to a wider range of autonomous driving tasks to enhance safety and robustness.<br>