Recent breakthroughs in zero-shot voice synthesis have enabled imitating a speaker's voice using just a few seconds of recording while maintaining a high level of realism. Alongside its potential benefits, this powerful technology introduces notable risks, including voice fraud and speaker impersonation. Unlike the conventional approach of solely relying on passive methods for detecting synthetic data, watermarking presents a proactive and robust defence mechanism against these looming risks. This paper introduces an innovative audio watermarking framework that encodes up to 32 bits of watermark within a mere 1-second audio snippet. The watermark is imperceptible to human senses and exhibits strong resilience against various attacks. It can serve as an effective identifier for synthesized voices and holds potential for broader applications in audio copyright protection. Moreover, this framework boasts high flexibility, allowing for the combination of multiple watermark segments to achieve heightened robustness and expanded capacity. Utilizing 10 to 20-second audio as the host, our approach demonstrates an average Bit Error Rate (BER) of 0.48\% across ten common attacks, a remarkable reduction of over 2800\% in BER compared to the state-of-the-art watermarking tool. See https://aka.ms/wavmark for demos of our work.

翻译：近期零样本语音合成的突破性进展，使得仅需几秒录音即可高保真模仿说话人声音。这项强大技术在带来潜在益处的同时，也引入了显著风险，包括语音欺诈和说话人冒充。不同于传统依赖被动方法检测合成数据的方式，水印技术为应对这些迫在眉睫的风险提供了主动且稳健的防御机制。本文提出了一种创新的音频水印框架，可在短短1秒音频片段中编码多达32比特水印。该水印对人耳不可感知，并对多种攻击展现出强鲁棒性。它可作为合成语音的有效标识符，并具有音频版权保护等更广泛应用前景。此外，该框架兼具高灵活性，支持多水印段组合以实现更强的鲁棒性与更大的容量。以10-20秒音频为载体时，本方法在十种常见攻击下的平均比特错误率（BER）仅为0.48%，较现有最先进水印工具的BER降低了超过2800%。详见 https://aka.ms/wavmark 查看演示。