Achieving the Visual Turing Test: Integrated Display and Eye Tracking Technologies
Mantas Žurauskas, Mohamed El-Haddad, Barry Silverstein, Douglas Lanman, Rob Cavin
ACM Conference on Human Factors in Computing Systems (CHI)
Scrolling in extended reality (XR) is currently performed using handheld controllers or vision-based arm-in-front gestures, which have the limitations of encumbering the user’s hands or requiring a specifc arm posture, respectively. To address these limitations, we investigate freehand, posture-independent scrolling driven by wrist defection. We propose two novel techniques: Wrist Joystick, which uses rate control, and Wrist Drag, which uses position control. In an empirical study of a rapid item acquisition task and a casual browsing task, both Wrist Drag and Wrist Joystick performed on par with a comparable state-of-the-art technique on one of the two tasks. Further, using a relaxed arm-at-side posture, participants retained their arm-in-front performance for both wrist techniques. Finally, we analyze behavioral and ergonomic data to provide design insights for wrist defection scrolling. Our results demonstrate that wrist defection provides a promising method for performant scrolling controls while offering additional benefts over existing XR interaction techniques.
Mantas Žurauskas, Mohamed El-Haddad, Barry Silverstein, Douglas Lanman, Rob Cavin
Brennan Jones, Yan Xu, Mary Anne Hood, Mohammad Shahidul Kader, Hamid Eghbalzadeh