Attention is a very popular and effective mechanism in artificial neural network-based sequence-to-sequence models. In this survey paper, a comprehensive review of the different attention models used in developing automatic speech recognition systems is provided. The paper focuses on the development and evolution of attention models for offline and streaming speech recognition within recurrent neural network- and Transformer- based architectures.

翻译：这份调查文件对开发自动语音识别系统时所使用的不同关注模式进行了全面审查,重点阐述在经常性神经网络和变异器结构中开发并演化离线和流言识别的注意模式。