Denoising diffusion models (DDMs) have attracted attention for their exceptional generation quality and diversity. This success is largely attributed to the use of class- or text-conditional diffusion guidance methods, such as classifier and classifier-free guidance. In this paper, we present a more comprehensive perspective that goes beyond the traditional guidance methods. From this generalized perspective, we introduce novel condition- and training-free strategies to enhance the quality of generated images. As a simple solution, blur guidance improves the suitability of intermediate samples for their fine-scale information and structures, enabling diffusion models to generate higher quality samples with a moderate guidance scale. Improving upon this, Self-Attention Guidance (SAG) uses the intermediate self-attention maps of diffusion models to enhance their stability and efficacy. Specifically, SAG adversarially blurs only the regions that diffusion models attend to at each iteration and guides them accordingly. Our experimental results show that our SAG improves the performance of various diffusion models, including ADM, IDDPM, Stable Diffusion, and DiT. Moreover, combining SAG with conventional guidance methods leads to further improvement.

翻译：去噪扩散模型因其卓越的生成质量和多样性而备受关注。这一成功主要归功于使用基于类别或文本条件的扩散引导方法，例如分类器引导和无分类器引导。本文提出了一种超越传统引导方法的更全面视角。从这个广义视角出发，我们引入了新颖的无条件且免训练策略以提升生成图像质量。作为一种简单方案，模糊引导提高了中间样本在其精细尺度和结构信息方面的适用性，使扩散模型能够以适度的引导尺度生成更高质量的样本。在此基础上，自注意力引导利用扩散模型的中间自注意力图来增强其稳定性和有效性。具体而言，自注意力引导在每次迭代中仅对扩散模型关注的区域进行对抗性模糊处理，并据此进行引导。实验结果表明，我们的自注意力引导提升了多种扩散模型的性能，包括ADM、IDDPM、Stable Diffusion及DiT。此外，将自注意力引导与传统引导方法相结合可带来进一步的性能提升。