Computer-mediated concerts can be enjoyed on various devices, from desktop and mobile to VR devices, often supporting multiple devices simultaneously. However, due to the limited accessibility of VR devices, relatively small audience members tend to congregate in VR venues, resulting in diminished unique social experiences. To address this gap and enrich VR concert experiences, we present a novel approach that leverages non-VR user interaction data, specifically chat from audiences watching the same content on a live-streaming platform. Based on an analysis of audience reactions in offline concerts, we designed and prototyped a concert interaction translation system that extracts the level of engagement and emotions from chats and translates them to collective movements, cheers, and singalongs of virtual audience avatars in a VR venue. Our user study (n=48) demonstrates that our system, which combines both movement and audio reactions, significantly enhances the sense of immersion and co-presence than the previous method.

翻译：计算机媒介演唱会可通过多种设备欣赏，从台式机、移动设备到VR设备，且常支持多设备同时接入。然而，由于VR设备的可及性有限，相对较少的观众倾向于聚集在VR场馆中，导致独特的社交体验减弱。为弥补这一不足并丰富VR演唱会体验，我们提出一种创新方法，该方法利用非VR用户的交互数据——具体而言，即通过直播平台观看同一内容的观众聊天记录。基于对线下演唱会观众反应的分析，我们设计并原型实现了一套演唱会互动转译系统，该系统从聊天记录中提取参与度与情感信息，并将其转化为VR场馆中虚拟观众化身的集体动作、欢呼与合唱。我们的用户研究（样本量n=48）表明，与先前方法相比，本系统结合动作与音频反应的设计，显著提升了沉浸感与共在体验。