Low-Rank Adaptation (LoRA) has become a widely used mechanism for customizing text-to-image diffusion models, enabling lightweight modules that are shared, reused, and commercialized as independent assets. This LoRA-centric ecosystem shifts copyright protection from foundation models to distributed LoRA modules, which are easy to copy, redistribute, or reuse without authorization. Existing watermarking methods either protect the base diffusion model or require watermark-aware retraining for each target LoRA, limiting their practicality in open community settings. To address this limitation, we propose LoRA-Key, a user-centric LoRA watermarking framework that treats copyright protection as a reusable ownership key. LoRA-Key encapsulates a recoverable secret message into a standalone user-specific Watermark LoRA, which can be attached to different target LoRAs through training-free linear superposition without per-LoRA retraining or structural modification. To train such a reusable key, we first establish a latent watermark prior in the frozen VAE latent space for robust message embedding and recovery, and then optimize the Watermark LoRA with message-conditioned watermark supervision and semantic consistency constraints. We further introduce Gradient Orthogonal Projection (GOP) to suppress watermark updates that conflict with semantic-preserving directions, reducing interference with generation fidelity and downstream style adaptation. Extensive experiments show that LoRA-Key provides lightweight plug-and-play copyright protection while preserving generation quality and style fidelity, and maintains robust ownership verification under image-level distortions, downstream fine-tuning, and multi-LoRA composition.
翻译:低秩适应(LoRA)已成为定制文本到图像扩散模型的广泛使用的机制,能够生成可作为独立资产共享、复用和商业化的轻量级模块。这一以LoRA为核心的生态系统将版权保护从基础模型转移到分布式LoRA模块上,而这些模块极易被未经授权地复制、分发或复用。现有水印方法要么保护基础扩散模型,要么需要对每个目标LoRA进行水印感知的重训练,限制了它们在开放社区场景中的实用性。为解决这一局限,我们提出LoRA-Key——一种以用户为中心的LoRA水印框架,将版权保护视为可复用的所有权密钥。LoRA-Key将可恢复的秘密信息封装到独立的用户特定水印LoRA中,该模块可通过无需训练的线性叠加附加到不同目标LoRA上,无需对每个LoRA单独重训练或修改结构。为训练这种可复用密钥,我们首先在冻结的VAE潜在空间中建立潜在水印先验以实现鲁棒的消息嵌入与恢复,进而通过消息条件水印监督与语义一致性约束优化水印LoRA。我们进一步引入梯度正交投影(GOP)以抑制与语义保持方向冲突的水印更新,减少对生成保真度与下游风格适配的干扰。大量实验表明,LoRA-Key在保持生成质量与风格保真度的同时提供轻量级即插即用版权保护,并在图像级失真、下游微调及多LoRA组合场景下维持鲁棒的所有权验证。