Invisible watermarking of AI-generated images can help with copyright protection, enabling detection and identification of AI-generated media. In this work, we present a novel approach to watermark images of T2I Latent Diffusion Models (LDMs). By only fine-tuning text token embeddings $W_*$, we enable watermarking in selected objects or parts of the image, offering greater flexibility compared to traditional full-image watermarking. Our method leverages the text encoder's compatibility across various LDMs, allowing plug-and-play integration for different LDMs. Moreover, introducing the watermark early in the encoding stage improves robustness to adversarial perturbations in later stages of the pipeline. Our approach achieves $99\%$ bit accuracy ($48$ bits) with a $10^5 \times$ reduction in model parameters, enabling efficient watermarking.
翻译:AI生成图像的隐形水印技术有助于版权保护,实现对AI生成媒体的检测与溯源。本研究提出了一种针对文本到图像潜在扩散模型生成图像的新型水印方法。通过仅微调文本标记嵌入$W_*$,我们实现了对选定对象或图像局部区域的水印嵌入,相比传统的全图像水印方案具有更高的灵活性。该方法利用文本编码器在不同潜在扩散模型间的兼容性,可为各类潜在扩散模型提供即插即用的集成方案。此外,在编码阶段早期引入水印增强了水印对后续流程中对抗性扰动的鲁棒性。我们的方法以$10^5$倍的参数量缩减实现了$99\%$的比特准确率($48$比特),实现了高效的水印嵌入。