BeyondDeskVR: an extended virtual hand interaction system in virtual reality

As virtual reality (VR) technology advances, the use of VR scenarios and applications is becoming increasingly prevalent, and the fatigue issues associated with existing mid-air hand interactions are becoming more pronounced. To alleviate fatigue in VR interactions, we developed a desktop interaction system, BeyondDeskVR. Designed for seamless integration with mid-air hand interaction in seated VR work environments, the system enables portable interaction input and mode switching. By extending virtual hand interactions to the desktop space, the system could be used on any desktop. We utilised infrared laser projection for desktop gesture recognition and achieved seamless transitions between desktop gesture interactions and mid-air hand interactions in typical three-dimensional scenarios, including pointing and selection, user interface interaction, and object manipulation. We conducted a comprehensive evaluation of the BeyondDeskVR gesture interaction system and mid-air hand interaction using a pointing selection task, assessing their performance in terms of subjectivity, performance, and fatigue. The results indicate that the BeyondDeskVR system has high user acceptance, significantly lower fatigue than does mid-air hand interaction, and comparable interaction efficiency and accuracy. Integrating this system with mid-air hand interaction can effectively reduce fatigue in VR interactions and enhance the overall VR experience.