Packet loss is a common and unavoidable problem in voice over internet phone (VoIP) systems. To deal with the problem, we propose a band-split packet loss concealment network (BS-PLCNet). Specifically, we split the full-band signal into wide-band (0-8kHz) and high-band (8-24kHz). The wide-band signals are processed by a gated convolutional recurrent network (GCRN), while the high-band counterpart is processed by a simple GRU network. To ensure high speech quality and automatic speech recognition (ASR) compatibility, multi-task learning (MTL) framework including fundamental frequency (f0) prediction, linguistic awareness, and multi-discriminators are used. The proposed approach tied for 1st place in the ICASSP 2024 PLC Challenge.
翻译:丢包是互联网语音电话(VoIP)系统中常见且不可避免的问题。针对该问题,本文提出了一种分频带丢包隐藏网络(BS-PLCNet)。具体而言,我们将全频带信号划分为宽带(0-8kHz)和高频(8-24kHz)两部分。宽带信号由门控卷积循环网络(GCRN)处理,而高频信号则由简单的GRU网络处理。为确保高语音质量及自动语音识别(ASR)兼容性,本文采用了包含基频(f0)预测、语言感知机制及多判别器的多任务学习(MTL)框架。所提方法在ICASSP 2024 PLC挑战赛中并列第一名。