Rapid advances in technology gradually realize immersive mixed-reality (MR) telepresence between distant spaces. This paper presents a novel visual guidance system for avatar-mediated telepresence, directing users to optimal placements that facilitate the clear transfer of gaze and pointing contexts through remote avatars in dissimilar spaces, where the spatial relationship between the remote avatar and the interaction targets may differ from that of the local user. Representing the spatial relationship between the user/avatar and interaction targets with angle-based interaction features, we assign recommendation scores of sampled local placements as their maximum feature similarity with remote placements. These scores are visualized as color-coded 2D sectors to inform the users of better placements for interaction with selected targets. In addition, virtual objects of the remote space are overlapped with the local space for the user to better understand the recommendations. We examine whether the proposed score measure agrees with the actual user perception of the partner's interaction context and find a score threshold for recommendation through user experiments in virtual reality (VR). A subsequent user study in VR investigates the effectiveness and perceptual overload of different combinations of visualizations. Finally, we conduct a user study in an MR telepresence scenario to evaluate the effectiveness of our method in real-world applications.
翻译:技术快速进步逐步实现了沉浸式混合现实远程呈现技术在不同空间之间的应用。本文提出了一种新颖的视觉引导系统,用于虚拟形象中介的远程呈现,指导用户在非对称空间中选取最优位置,以便通过远程虚拟形象清晰传递凝视和指向等交互语境。在非对称空间中,远程虚拟形象与交互目标之间的空间关系可能不同于本地用户。通过基于角度的交互特征表示用户/虚拟形象与交互目标之间的空间关系,我们将采样得到的本地位置推荐得分定义为这些位置与远程位置的最大特征相似度。这些得分以颜色编码的二维扇形区域可视化,告知用户与选定目标交互的优化位置。此外,远程空间中的虚拟对象与本地空间重叠显示,便于用户更好理解推荐结果。我们通过虚拟现实用户实验验证了所提得分度量与用户对伙伴交互语境实际感知的一致性,并确定了推荐得分阈值。后续虚拟现实用户研究探讨了不同可视化组合的有效性与感知过载。最后,我们在混合现实远程呈现场景中开展用户实验,评估了该方法在真实应用中的有效性。