How can we design the user interfaces for augmented reality (AR) so that we can interact as simple, flexible and expressive as we can with smartphones in one hand? To explore this question, we propose PalmGazer as an interaction concept integrating eye-hand interaction to establish a singlehandedly operable menu system. In particular, PalmGazer is designed to support quick and spontaneous digital commands -- such as to play a music track, check notifications or browse visual media -- through our devised three-way interaction model: hand opening to summon the menu UI, eye-hand input for selection of items, and dragging gesture for navigation. A key aspect is that it remains always-accessible and movable to the user, as the menu supports meaningful hand and head based reference frames. We demonstrate the concept in practice through a prototypical personal UI with application probes, and describe technique designs specifically-tailored to the application UI. A qualitative evaluation highlights the system's design benefits and drawbacks, e.g., that common 2D scroll and selection tasks are simple to operate, but higher degrees of freedom may be reserved for two hands. Our work contributes interaction techniques and design insights to expand AR's uni-manual capabilities.
翻译:如何设计增强现实(AR)的用户界面,使其能够像单手操作智能手机一样简单、灵活且富有表现力?为探索此问题,我们提出PalmGazer交互概念,通过整合眼-手交互构建可单手操作的菜单系统。具体而言,PalmGazer通过我们设计的三维交互模型支持快速自发性的数字指令(如播放音乐、查看通知或浏览视觉媒体):手掌张开召唤菜单UI,眼-手输入进行项目选择,拖拽手势实现导航。其关键特性在于始终可访问且可移动——菜单支持基于手部和头部的参考框架。我们通过原型个人UI及应用程序探针展示了该概念的实际应用,并描述了针对应用UI特别设计的技术方案。定性评估揭示了该系统的设计优势与不足,例如常见二维滚动与选择任务操作简便,但更高自由度操作可能仍需双手配合。本研究贡献了拓展AR单手操作能力的交互技术与设计洞见。