Discrete speech tokens have been more and more popular in multiple speech processing fields, including automatic speech recognition (ASR), text-to-speech (TTS) and singing voice synthesis (SVS). In this paper, we describe the systems developed by the SJTU X-LANCE group for the TTS (acoustic + vocoder), SVS, and ASR tracks in the Interspeech 2024 Speech Processing Using Discrete Speech Unit Challenge. Notably, we achieved 1st rank on the leaderboard in the TTS track both with the whole training set and only 1h training data, with the highest UTMOS score and lowest bitrate among all submissions.

翻译：离散语音标记在自动语音识别（ASR）、文语转换（TTS）及歌唱语音合成（SVS）等多个语音处理领域日益普及。本文描述了上海交通大学X-LANCE团队为Interspeech 2024离散语音单元挑战赛中TTS（声码器+声学模型）、SVS及ASR赛道开发的系统。值得注意的是，在TTS赛道中，我们凭借全部训练集和仅1小时训练数据均取得了排行榜第一名，在所有提交结果中实现了最高UTMOS评分与最低比特率。