Automatic Speech Recognition (ASR) has witnessed a profound research interest. Recent breakthroughs have given ASR systems different prospects such as faithfully transcribing spoken language, which is a pivotal advancement in building conversational agents. However, there is still an imminent challenge of accurately discerning context-dependent words and phrases. In this work, we propose a novel approach for enhancing contextual recognition within ASR systems via semantic lattice processing leveraging the power of deep learning models in accurately delivering spot-on transcriptions across a wide variety of vocabularies and speaking styles. Our solution consists of using Hidden Markov Models and Gaussian Mixture Models (HMM-GMM) along with Deep Neural Networks (DNN) models integrating both language and acoustic modeling for better accuracy. We infused our network with the use of a transformer-based model to properly rescore the word lattice achieving remarkable capabilities with a palpable reduction in Word Error Rate (WER). We demonstrate the effectiveness of our proposed framework on the LibriSpeech dataset with empirical analyses.
翻译:自动语音识别(ASR)领域已引起广泛研究兴趣。最新突破为ASR系统带来了不同前景,例如忠实转录口语,这是构建对话智能体的关键进展。然而,准确识别上下文相关词语与短语仍是一项紧迫挑战。本研究提出一种新颖方法,通过语义格栅处理增强ASR系统的上下文识别能力,利用深度学习模型在跨词汇与说话风格的广泛场景中实现精准转录。我们的解决方案采用隐马尔可夫模型与高斯混合模型(HMM-GMM),结合深度融合语言建模与声学建模的深度神经网络(DNN),以提高准确性。我们在网络中引入基于Transformer的模型对词格栅进行重评分,显著降低了词错误率(WER)。通过在LibriSpeech数据集上的实证分析,我们证明了所提出框架的有效性。