In-person human interaction relies on our spatial perception of each other and our surroundings. Current remote communication tools partially address each of these aspects. Video calls convey real user representations but without spatial interactions. Augmented and Virtual Reality (AR/VR) experiences are immersive and spatial but often use virtual environments and characters instead of real-life representations. Bridging these gaps, we introduce DualStream, a system for synchronous mobile AR remote communication that captures, streams, and displays spatial representations of users and their surroundings. DualStream supports transitions between user and environment representations with different levels of visuospatial fidelity, as well as the creation of persistent shared spaces using environment snapshots. We demonstrate how DualStream can enable spatial communication in real-world contexts, and support the creation of blended spaces for collaboration. A formative evaluation of DualStream revealed that users valued the ability to interact spatially and move between representations, and could see DualStream fitting into their own remote communication practices in the near future. Drawing from these findings, we discuss new opportunities for designing more widely accessible spatial communication tools, centered around the mobile phone.
翻译:摘要:面对面人际交互依赖于我们对彼此及环境的空间感知。当前的远程通信工具仅部分实现了这些维度:视频通话能传递真实的用户表征,但缺乏空间交互;增强现实与虚拟现实(AR/VR)体验虽具沉浸式空间特性,却常使用虚拟环境与虚拟角色替代现实表征。为弥合这一鸿沟,我们提出双流系统——一种同步移动AR远程通信系统,可捕获、传输并呈现用户及其环境的空间表征。该系统支持在不同视觉空间保真度层级间切换用户与环境表征,并可通过环境快照创建持久化的共享空间。我们展示了双流系统如何在真实世界场景中实现空间通信,并支持创建用于协作的混合空间。形成性评估表明,用户重视空间交互能力与表征切换功能,并认为双流系统在不久的将来可融入其远程通信实践。基于这些发现,我们探讨了以移动手机为核心、设计更广泛可及的空间通信工具的新机遇。