This paper investigates multi-selection in XR interfaces based on eye and hand interaction. We propose enabling multi-selection using different variations of techniques that combine gaze with a semi-pinch gesture, allowing users to select multiple objects, while on the way to a full-pinch. While our exploration is based on the semi-pinch mode for activating a quasi-mode, we explore four methods for confirming subselections in multi-selection mode, varying in effort and complexity: dwell-time (SemiDwell), swipe (SemiSwipe), tilt (SemiTilt), and non-dominant hand input (SemiNDH), and compare them to a baseline technique. In the user study, we evaluate their effectiveness in reducing task completion time, errors, and effort. The results indicate the strengths and weaknesses of each technique, with SemiSwipe and SemiDwell as the most preferred methods by participants. We also demonstrate their utility in file managing and RTS gaming application scenarios. This study provides valuable insights to advance 3D input systems in XR.
翻译:本文研究了基于眼动与手部交互的扩展现实(XR)界面中的多目标选择技术。我们提出通过结合注视与半捏合手势的不同技术变体来实现多目标选择,使用户在完成完全捏合动作的过程中即可选择多个对象。本研究以半捏合作为准模式激活方式,在此基础上探索了四种在多重选择模式下确认子选择的方法,这些方法在操作负荷与复杂度上各有不同:驻留时间法(SemiDwell)、滑动法(SemiSwipe)、倾斜法(SemiTilt)以及非优势手输入法(SemiNDH),并与基线技术进行了对比。通过用户研究,我们评估了这些方法在减少任务完成时间、错误率和操作负荷方面的有效性。结果表明每种技术各有优劣,其中SemiSwipe和SemiDwell是参与者最为青睐的方法。我们还在文件管理和即时战略游戏应用场景中验证了其实用性。本研究为推进XR领域的3D输入系统发展提供了有价值的见解。