Beyond the Hands: Evaluating the Usability of Hands-Free Methods and Controllers for Menu Selection During an Immersive VR Experience

Handheld controllers are standard in immersive virtual reality (iVR), but the rise of natural hand-based interactions exposes the limitations of hand gestures, especially for point-and-click tasks with graphical user interfaces (GUI). This shows the need to explore alternative hands-free selection methods. Unlike most studies focusing on the selection task itself, this work evaluates the impact of such methods on multiple dimensions when selections occur alongside another primary task. The tested methods were: head gaze + dwell, leaning, and voice; eye gaze + dwell, leaning, blinking, and voice; and voice-only. Controllers served as the baseline. Methods were further analyzed by pointing and confirming mechanisms. Four dimensions were analyzed: (1) iVR experience, (2) user satisfaction, (3) usability, and (4) efficiency and effectiveness. With 72 participants, results show hands-free methods provide comparable experiences to controllers, suggesting selection methods have a lower impact on the user experience when users focus on a primary task.