Diffusion-based generative models' impressive ability to create convincing images has captured global attention. However, their complex internal structures and operations often make them difficult for non-experts to understand. We present Diffusion Explainer, the first interactive visualization tool that explains how Stable Diffusion transforms text prompts into images. Diffusion Explainer tightly integrates a visual overview of Stable Diffusion's complex components with detailed explanations of their underlying operations, enabling users to fluidly transition between multiple levels of abstraction through animations and interactive elements. By comparing the evolutions of image representations guided by two related text prompts over refinement timesteps, users can discover the impact of prompts on image generation. Diffusion Explainer runs locally in users' web browsers without the need for installation or specialized hardware, broadening the public's education access to modern AI techniques. Our open-sourced tool is available at: https://poloclub.github.io/diffusion-explainer/. A video demo is available at https://youtu.be/Zg4gxdIWDds.
翻译:基于扩散的生成模型在生成逼真图像方面展现出的惊人能力引起了全球关注。然而,其复杂的内部结构和操作常使非专业人士难以理解。我们提出了扩散解释器(Diffusion Explainer),这是首个交互式可视化工具,用于解释稳定扩散(Stable Diffusion)如何将文本提示转化为图像。该工具将稳定扩散复杂组件的视觉概览与其底层操作的详细解释紧密集成,使用户能够通过动画和交互元素在多个抽象层次间流畅切换。通过比较两个相关文本提示引导下图像表示在细化时间步长中的演变,用户可以发现提示对图像生成的影响。扩散解释器可在用户网页浏览器中本地运行,无需安装或专用硬件,从而拓展公众对现代人工智能技术的教育可及性。我们的开源工具可通过以下链接获取:https://poloclub.github.io/diffusion-explainer/。视频演示见:https://youtu.be/Zg4gxdIWDds。