Diffusion Models (DMs) are state-of-the-art generative models that learn a reversible corruption process from iterative noise addition and denoising. They are the backbone of many generative AI applications, such as text-to-image conditional generation. However, recent studies have shown that basic unconditional DMs (e.g., DDPM and DDIM) are vulnerable to backdoor injection, a type of output manipulation attack triggered by a maliciously embedded pattern at model input. This paper presents a unified backdoor attack framework (VillanDiffusion) to expand the current scope of backdoor analysis for DMs. Our framework covers mainstream unconditional and conditional DMs (denoising-based and score-based) and various training-free samplers for holistic evaluations. Experiments show that our unified framework facilitates the backdoor analysis of different DM configurations and provides new insights into caption-based backdoor attacks on DMs.

翻译：扩散模型（DMs）是当前最先进的生成模型，通过学习迭代噪声添加与去噪过程实现可逆的破坏与重建。它们是文本到图像条件生成等众多生成式AI应用的核心基础。然而，近期研究表明，基础的无条件扩散模型（如DDPM和DDIM）易受后门注入攻击——一种通过在模型输入中嵌入恶意模式以操纵输出的攻击方式。本文提出一种统一的攻击框架（VillanDiffusion），旨在拓展当前扩散模型后门分析的研究范围。该框架涵盖主流无条件与条件扩散模型（基于去噪和基于分数的），并集成多种免训练采样器以进行全方位评估。实验表明，该统一框架能够促进对不同配置下扩散模型的后门分析，并为基于标题的后门攻击提供新见解。