TouchFusion is a wristband that enables touch interactions on nearby surfaces without any additional instrumentation or computer vision. TouchFusion combines surface electromyography (sEMG), bioimpedance, inertial, and optical sensing to capture multiple facets of hand activity during touch interactions. Through a combination of early and late fusion, TouchFusion enables stateful touch detection on both environmental and body surfaces, simple surface gestures, and tracking functionality for contextually adaptive interfaces as well as basic trackpad-like interactions. We validate our approach on a dataset of 100 participants, significantly exceeding the population size of typical wearable sensing studies to capture a wider variance of wrist anatomies, skin conductivities, and behavioral patterns. We show that TouchFusion can enable several common touch interaction tasks. Using TouchFusion, a wearer can summon a trackpad on any surface, control contextually adaptive interfaces based on where they tap, or use their palm as an always-available touch surface. When paired with smart glasses or augmented reality devices, TouchFusion enables a ubiquitous, contextually adaptive interaction model.
翻译:TouchFusion是一种无需额外仪器或计算机视觉即可在邻近表面实现触控交互的腕带设备。它融合表面肌电信号、生物阻抗、惯性及光学传感技术,以捕捉触控交互过程中手部活动的多维度特征。通过早期与晚期融合相结合的策略,TouchFusion能够在环境表面与人体表面实现带状态检测的触控功能,支持简单表面手势操作,并为情境自适应界面提供追踪功能以及基础的触控板式交互。我们在包含100名参与者的数据集上验证了该方法,其样本规模显著超越典型可穿戴传感研究,从而能涵盖更广泛的手腕解剖结构、皮肤电导率及行为模式差异。实验表明TouchFusion可支持多种常见触控交互任务。使用者可通过该设备在任何表面召唤虚拟触控板,根据点击位置控制情境自适应界面,或将手掌作为常备触控表面。当与智能眼镜或增强现实设备配合使用时,TouchFusion能够实现一种普适的、情境自适应的交互范式。