Telepresence aims to create an immersive but virtual experience of the audio and visual scene at the far end for users at the near end. In this contribution, we propose an array-based binaural rendering system that converts the array microphone signals into the head-related transfer function (HRTF) filtered output signals for headphone-rendering. The proposed approach is formulated in light of a model-matching principle (MMP) and is capable of delivering more immersive experience than the conventional localization-beamforming-HRTF filtering (LBH) approach. The MMP-based rendering system can be realized via multichannel inverse filtering (MIF) and multichannel deep filtering (MDF). In this study, we adopted the MDF approach and used the LBH as well as MIF as the baselines. The all-neural system jointly captures the spatial information (spatial rendering), preserves ambient sound (enhancement), and reduces noise (enhancement) before generating binaural outputs. Objective and subjective tests are employed to compare the proposed telepresence system with two baselines.

翻译：远程呈现旨在为近端用户营造远端音视频场景的沉浸式虚拟体验。本文提出一种基于阵列的双耳渲染系统，可将阵列麦克风信号转换为经头相关传输函数(HRTF)滤波后的输出信号，用于耳机渲染。该方案依据模型匹配原理(MMP)进行设计，相较于传统的定位-波束形成-HRTF滤波(LBH)方法，能够提供更沉浸的体验。基于MMP的渲染系统可通过多通道逆滤波(MIF)与多通道深度滤波(MDF)实现。本研究采用MDF方法，并以LBH和MIF作为基线。该全神经网络系统在生成双耳输出前，可联合捕获空间信息(空间渲染)、保留环境声音(增强)并降低噪声(增强)。通过客观测试与主观测试，将所提出的远程呈现系统与两种基线方案进行对比。