The internet-of-things (IoT) refers to the growing field of interconnected pervasive computing devices and the networking that supports smart, embedded applications. The IoT has multiple human-computer interaction challenges due to its many formats and interlinked components, and central to these is the need to provide sensory information and situational context pertaining to users in a more human-friendly, easily understandable format. This work addresses this by applying mixed reality toward expressing the underlying behaviors and states internal to IoT devices and IoT-enabled objects. It extends the authors' previous research on IoT Avatars (mixed reality character representations of physical IoT devices), presenting a new head-mounted display framework and interconnection architecture. This contributes i) an exploration of mixed reality for smart spaces, ii) an approach toward expressive avatar behaviors using fuzzy inference, and iii) an early functional prototype of a hybrid physical and mixed reality IoT-enabled object. This approach is a step toward new information presentation, interaction, and engagement capabilities for smart devices and environments.
翻译:物联网(Internet of Things,IoT)指的是互连的普适计算设备及其支持智能嵌入式应用的网络这一日益发展的领域。由于物联网具有多种形态和相互关联的组件,它在人机交互方面面临诸多挑战,其中核心问题在于需要以更人性化、更易理解的形式向用户提供与情境相关的感知信息和环境上下文。本文通过应用混合现实来表达物联网设备及支持物联网的物体内部的行为和状态,从而解决这一问题。本文在作者先前关于物联网化身(IoT Avatars,即物理物联网设备的混合现实角色表征)的研究基础上,提出了一种新的头戴式显示框架和互联架构。本文贡献包括:i) 探索了混合现实在智能空间中的应用,ii) 提出了一种基于模糊推理的表达性化身行为方法,以及iii) 开发了一个早期的功能原型,该原型结合了物理与混合现实的支持物联网的物体。该方法为智能设备和环境提供了新的信息呈现、交互和参与能力,迈出了重要一步。