Next-generation augmented reality (AR) promises a high degree of context-awareness - a detailed knowledge of the environmental, user, social and system conditions in which an AR experience takes place. This will facilitate both the closer integration of the real and virtual worlds, and the provision of context-specific content or adaptations. However, environmental awareness in particular is challenging to achieve using AR devices alone; not only are these mobile devices' view of an environment spatially and temporally limited, but the data obtained by onboard sensors is frequently inaccurate and incomplete. This, combined with the fact that many aspects of core AR functionality and user experiences are impacted by properties of the real environment, motivates the use of ambient IoT devices, wireless sensors and actuators placed in the surrounding environment, for the measurement and optimization of environment properties. In this book chapter we categorize and examine the wide variety of ways in which these IoT sensors and actuators can support or enhance AR experiences, including quantitative insights and proof-of-concept systems that will inform the development of future solutions. We outline the challenges and opportunities associated with several important research directions which must be addressed to realize the full potential of next-generation AR.
翻译:下一代增强现实(AR)有望实现高度的情境感知能力,即详细理解AR体验所涉及的环境、用户、社会及系统条件。这将促进真实世界与虚拟世界的深度融合,并提供情境特定的内容或自适应调整。然而,仅依靠AR设备本身实现环境感知尤其具有挑战性:这些移动设备对环境视角的时空覆盖有限,其内置传感器获取的数据也常存在不准确和不完整的问题。加之核心AR功能与用户体验的诸多方面均受真实环境属性的影响,促使我们利用部署于周边环境中的泛在物联网设备(无线传感器与执行器)对环境属性进行测量与优化。本章节系统分类并考察了这些物联网传感器与执行器支持或增强AR体验的多种方式,包括定量分析见解与概念验证系统,为未来解决方案的研发提供参考。我们概述了若干重要研究方向中需应对的挑战与机遇,这些方向对于实现下一代AR的全部潜力至关重要。