3D Object Manipulation: Mouse vs. hand gesture, their objective and subjective performance

Abstract

Traditional computer mouse-based interaction is compared with the Natural User Interfaces hand gesture-based interaction for 3D object manipulation. So far, no direct comparison between both interaction paradigms has been made in a structured manner, including both objective and subjective aspects. With both computer mouse and hand gestures, 39 participants conducted translations, rotations, scaling, and their compound with the same 7 objects for each manipulation. Speed and accuracy were measured as well as experienced speed, accuracy, learnability, usability, use in daily life, and fatigue and strain. The Speed Accuracy Tradeoff of hand gesture showed superior to mouse-based control, which was also confirmed by the participants’ experience. Also learnability, usability, and use in daily life of hand gestures were judged favorably, despite the reported accompanying fatigue and strain. So, hand gestures are strongly advised as the preferred Natural User Interfaces for 3D object manipulation applications.