Rapid advances in technology gradually realize immersive mixed-reality (MR) telepresence between distant spaces. This paper presents a novel visual guidance system for avatar-mediated telepresence, directing users to optimal placements that facilitate the clear transfer of gaze and pointing contexts through remote avatars in dissimilar spaces, where the spatial relationship between the remote avatar and the interaction targets may differ from that of the local user. Representing the spatial relationship between the user/avatar and interaction targets with angle-based interaction features, we assign recommendation scores of sampled local placements as their maximum feature similarity with remote placements. These scores are visualized as color-coded 2D sectors to inform the users of better placements for interaction with selected targets. In addition, virtual objects of the remote space are overlapped with the local space for the user to better understand the recommendations. We examine whether the proposed score measure agrees with the actual user perception of the partner's interaction context and find a score threshold for recommendation through user experiments in virtual reality (VR). A subsequent user study in VR investigates the effectiveness and perceptual overload of different combinations of visualizations. Finally, we conduct a user study in an MR telepresence scenario to evaluate the effectiveness of our method in real-world applications.
翻译:技术的飞速发展逐步实现了异地空间间沉浸式混合现实(MR)远程呈现。本文提出一种新颖的视觉引导系统,用于化身介导的远程呈现,指导用户在异质空间中选取最佳站位,从而通过远程化身清晰传递目光与指向语境——此类空间中,远程化身与交互目标间的空间关系可能与本地用户有所不同。通过以角度交互特征表征用户/化身与交互目标间的空间关系,我们为采样本地位置赋予推荐分数,该分数等于其与远程位置在特征空间中的最高相似度。这些分数以颜色编码的二维扇形区域可视化,提示用户针对选定目标的更优站位。此外,远程空间的虚拟对象与本地空间重叠显示,以帮助用户更好理解推荐依据。我们通过虚拟现实(VR)用户实验验证了所提分数度量与用户对同伴交互语境实际感知的一致性,并确定了推荐分数阈值。后续VR用户研究进一步探索了不同可视化组合的有效性与感知负荷。最后,在混合现实远程呈现场景中开展用户研究,评估了本方法在实际应用中的有效性。