Everyday object-based interactions (EOIs) and mid-air gesture interactions (MAIs) have been widely explored, yet prior work on their integration often targets narrow use cases or specific technologies, leaving designers and developers with limited guidance that generalizes across diverse EOIs and MAIs. We introduce Objestures ("Obj" + "Gestures") -- five interaction types spanning EOIs and MAIs, forming a design space for expressive uni- and bimanual interaction. To evaluate the usefulness of Objestures, we conducted an exploratory user study (N=12) on basic 3D tasks (rotation and scaling), which showed performance comparable to the headset's native freehand manipulation. To understand the user experience, we conducted case studies with the same participants across three applications (Sound, Draw, and Shadow), where participants found the interactions intuitive, engaging, and expressive, and indicated interest in everyday use. We further demonstrate the potential of Objestures across diverse contexts through 30 examples, and discuss limitations and implications. https://www.zhuoyuelyu.com/objestures
翻译:基于日常物体的交互(EOI)与空中手势交互(MAI)已被广泛探索,然而,先前关于二者整合的研究往往局限于特定应用场景或技术手段,未能为设计者与开发者提供跨不同EOI与MAI的普适性指导。我们提出Objestures("Obj"+"Gestures")——涵盖EOI与MAI的五种交互类型,构建了面向表达性单手及双手交互的设计空间。为评估Objestures的实用性,我们开展了针对基本三维任务(旋转与缩放)的探索性用户研究(N=12),结果表明其性能与头戴设备原生空手操控相当。为理解用户体验,我们针对同一批参与者在三类应用(声音、绘图与阴影)中进行案例研究,参与者认为该交互方式直观、富有沉浸感与表现力,并表达了日常使用意愿。我们进一步通过30个案例展示了Objestures在多元场景中的潜力,并讨论了其局限性与启示。https://www.zhuoyuelyu.com/objestures