In this paper, we present a scheme for extending deep neural network-based multiplicative maskers to deep subband filters for speech restoration in the time-frequency domain. The resulting method can be generically applied to any deep neural network providing masks in the time-frequency domain, while requiring only few more trainable parameters and a computational overhead that is negligible for state-of-the-art neural networks. We demonstrate that the resulting deep subband filtering scheme outperforms multiplicative masking for dereverberation, while leaving the denoising performance virtually the same. We argue that this is because deep subband filtering in the time-frequency domain fits the subband approximation often assumed in the dereverberation literature, whereas multiplicative masking corresponds to the narrowband approximation generally employed in denoising.
翻译:本文提出了一种将基于深度神经网络的乘法掩码扩展至深度子带滤波的方案,用于时频域中的语音恢复。该方案可通用地应用于任何在时频域中提供掩码的深度神经网络,且仅需增加少量可训练参数,对于最先进的神经网络而言,其计算开销可忽略不计。我们证明,基于深度子带滤波的方案在去混响方面优于乘法掩码,同时去噪性能几乎保持不变。我们认为,这是由于时频域中的深度子带滤波符合去混响文献中通常假设的子带近似,而乘法掩码则对应于去噪中普遍采用的窄带近似。