In this paper, we present a novel multi-modal attention guidance method designed to address the challenges of turn-taking dynamics in meetings and enhance group conversations within virtual reality (VR) environments. Recognizing the difficulties posed by a confined field of view and the absence of detailed gesture tracking in VR, our proposed method aims to mitigate the challenges of noticing new speakers attempting to join the conversation. This approach tailors attention guidance, providing a nuanced experience for highly engaged participants while offering subtler cues for those less engaged, thereby enriching the overall meeting dynamics. Through group interview studies, we gathered insights to guide our design, resulting in a prototype that employs "light" as a diegetic guidance mechanism, complemented by spatial audio. The combination creates an intuitive and immersive meeting environment, effectively directing users' attention to new speakers. An evaluation study, comparing our method to state-of-the-art attention guidance approaches, demonstrated significantly faster response times (p < 0.001), heightened perceived conversation satisfaction (p < 0.001), and preference (p < 0.001) for our method. Our findings contribute to the understanding of design implications for VR social attention guidance, opening avenues for future research and development.
翻译:本文提出了一种新颖的多模态注意力引导方法,旨在解决会议中轮流发言动态的挑战,并增强虚拟现实(VR)环境中的群组对话。鉴于VR中视野受限及缺乏精细手势追踪的困难,我们提出的方法旨在缓解察觉尝试加入对话的新发言者的难题。该方法定制化注意力引导,为高度投入的参与者提供细微体验,同时为参与度较低的参与者提供更柔和的提示,从而丰富整体会议动态。通过小组访谈研究,我们收集了指导设计的见解,最终构建了一个原型,该原型采用“灯光”作为叙事内引导机制,并辅以空间音频。这种组合营造出直观且沉浸的会议环境,有效将用户注意力导向新发言者。一项将我们的方法与先进注意力引导方法进行对比的评估研究表明,我们的方法显著缩短了响应时间(p < 0.001),提升了感知对话满意度(p < 0.001),并获得偏好(p < 0.001)。我们的研究结果有助于理解VR社交注意力引导的设计启示,为未来研究与发展开辟了新途径。