Recent breakthroughs in zero-shot voice synthesis have enabled imitating a speaker's voice using just a few seconds of recording while maintaining a high level of realism. Alongside its potential benefits, this powerful technology introduces notable risks, including voice fraud and speaker impersonation. Unlike the conventional approach of solely relying on passive methods for detecting synthetic data, watermarking presents a proactive and robust defence mechanism against these looming risks. This paper introduces an innovative audio watermarking framework that encodes up to 32 bits of watermark within a mere 1-second audio snippet. The watermark is imperceptible to human senses and exhibits strong resilience against various attacks. It can serve as an effective identifier for synthesized voices and holds potential for broader applications in audio copyright protection. Moreover, this framework boasts high flexibility, allowing for the combination of multiple watermark segments to achieve heightened robustness and expanded capacity. Utilizing 10 to 20-second audio as the host, our approach demonstrates an average Bit Error Rate (BER) of 0.48\% across ten common attacks, a remarkable reduction of over 2800\% in BER compared to the state-of-the-art watermarking tool. See https://aka.ms/wavmark for demos of our work.

翻译：最近在零样本语音合成方面的突破使得仅用几秒录音就能模仿说话者声音并保持高度逼真。尽管这项强大技术具有潜在益处，但也引入了显著风险，包括语音欺诈和说话者冒充。与传统仅依赖被动方法检测合成数据不同，水印技术为应对这些潜在风险提供了一种主动且稳健的防御机制。本文提出了一种创新音频水印框架，能在短短1秒音频片段内编码多达32比特水印信息。该水印对人类听觉不可察觉，并对多种攻击表现出强鲁棒性。它可作为合成语音的有效标识符，并在音频版权保护方面具有更广泛的应用潜力。此外，该框架具备高度灵活性，允许多个水印片段组合以实现更强的鲁棒性和更大的容量。以10至20秒音频为载体，我们的方法在十种常见攻击下平均比特错误率为0.48%，相比最先进的水印工具，比特错误率显著降低超过2800%。详见https://aka.ms/wavmark观看我们的演示。