Recent technological advances have made head-mounted displays (HMDs) smaller and untethered, fostering the vision of ubiquitous interaction with information in a digitally augmented physical world. For interacting with such devices, three main types of input - besides not very intuitive finger gestures - have emerged so far: 1) Touch input on the frame of the devices or 2) on accessories (controller) as well as 3) voice input. While these techniques have both advantages and disadvantages depending on the current situation of the user, they largely ignore the skills and dexterity that we show when interacting with the real world: Throughout our lives, we have trained extensively to use our limbs to interact with and manipulate the physical world around us. This thesis explores how the skills and dexterity of our upper and lower limbs, acquired and trained in interacting with the real world, can be transferred to the interaction with HMDs. Thus, this thesis develops the vision of around-body interaction, in which we use the space around our body, defined by the reach of our limbs, for fast, accurate, and enjoyable interaction with such devices. This work contributes four interaction techniques, two for the upper limbs and two for the lower limbs: The first contribution shows how the proximity between our head and hand can be used to interact with HMDs. The second contribution extends the interaction with the upper limbs to multiple users and illustrates how the registration of augmented information in the real world can support cooperative use cases. The third contribution shifts the focus to the lower limbs and discusses how foot taps can be leveraged as an input modality for HMDs. The fourth contribution presents how lateral shifts of the walking path can be exploited for mobile and hands-free interaction with HMDs while walking.
翻译:近年来,技术进步使得头戴式显示器(HMD)体积更小、无需线缆,推动了在数字增强物理世界中与信息进行普适交互的愿景。目前,除了不太直观的手指手势外,与这类设备交互已涌现出三种主要输入方式:1)设备框架上的触摸输入,2)配件(控制器)上的触摸输入,以及3)语音输入。这些技术虽根据用户当前情境各有优劣,但很大程度上忽略了我们与现实世界交互时所展现的技巧与灵巧性:在生命历程中,我们经过广泛训练,善于利用肢体与周围物理世界互动并加以操控。本论文探究如何将通过现实世界交互习得与训练出的上下肢技巧与灵巧性,迁移至与头戴式显示器的交互中。由此,论文提出了“周围身体交互”的愿景,即利用肢体可及范围所定义的身体周围空间,实现快速、准确且愉悦的设备交互。本研究贡献了四种交互技术,两种针对上肢,两种针对下肢:第一项贡献展示了如何利用头与手之间的接近度与HMD进行交互;第二项贡献将上肢交互扩展至多用户场景,并阐释了真实世界中增强信息的配准如何支持协作型应用;第三项贡献将焦点转向下肢,探讨了如何将脚部敲击作为HMD的一种输入模态;第四项贡献提出了步行路径的横向偏移可被利用于行走中与HMD的移动式免手持交互。