This paper presents FOOCTTS, an automatic pipeline for a football commentator that generates speech with background crowd noise. The application gets the text from the user, applies text pre-processing such as vowelization, followed by the commentator's speech synthesizer. Our pipeline included Arabic automatic speech recognition for data labeling, CTC segmentation, transcription vowelization to match speech, and fine-tuning the TTS. Our system is capable of generating speech with its acoustic environment within limited 15 minutes of football commentator recording. Our prototype is generalizable and can be easily applied to different domains and languages.
翻译:本文介绍FOOCTTS,一种为足球解说员自动生成带有背景观众噪声语音的流水线方法。该系统接收用户输入的文本,执行文本预处理(如标音处理),随后通过解说员语音合成器生成语音。我们的流水线包含:用于数据标注的阿拉伯语自动语音识别、联结主义时序分类(CTC)分割、匹配语音的转录本标音处理,以及TTS微调。该模型能够在仅15分钟足球解说员录音数据下,生成具有其声学环境的语音。本原型系统具备可泛化性,并能便捷地迁移至不同领域与语言。