Gaze interaction presents a promising avenue in Virtual Reality (VR) due to its intuitive and efficient user experience. Yet, the depth control inherent in our visual system remains underutilized in current methods. In this study, we introduce FocusFlow, a hands-free interaction method that capitalizes on human visual depth perception within the 3D scenes of Virtual Reality. We first develop a binocular visual depth detection algorithm to understand eye input characteristics. We then propose a layer-based user interface and introduce the concept of 'Virtual Window' that offers an intuitive and robust gaze-depth VR interaction, despite the constraints of visual depth accuracy and precision spatially at further distances. Finally, to help novice users actively manipulate their visual depth, we propose two learning strategies that use different visual cues to help users master visual depth control. Our user studies on 24 participants demonstrate the usability of our proposed virtual window concept as a gaze-depth interaction method. In addition, our findings reveal that the user experience can be enhanced through an effective learning process with adaptive visual cues, helping users to develop muscle memory for this brand-new input mechanism. We conclude the paper by discussing strategies to optimize learning and potential research topics of gaze-depth interaction.
翻译:凝视交互因其直观高效的用户体验,在虚拟现实领域展现出广阔前景。然而,当前方法尚未充分利用人类视觉系统中固有的深度控制能力。本研究提出FocusFlow——一种利用虚拟现实三维场景中人类视觉深度感知的无手交互方法。我们首先开发了双目视觉深度检测算法以理解眼部输入特征,继而提出基于分层的用户界面并引入"虚拟窗口"概念——该概念能够突破视觉深度在远距离空间上的精度与准确性限制,实现直观且鲁棒的凝视深度虚拟现实交互。为帮助新手用户主动操纵其视觉深度,我们进一步提出两种运用不同视觉线索的学习策略,助力用户掌握视觉深度控制技能。基于24名参与者的用户研究表明,我们所提出的虚拟窗口概念作为凝视深度交互方法具备可用性。此外,研究结果揭示:通过有效学习过程与自适应视觉线索,可提升用户体验,帮助用户为这一全新输入机制建立肌肉记忆。本文最后探讨了优化学习策略与凝视深度交互的潜在研究方向。