We introduce ObjectAdd, a training-free diffusion modification method to add user-expected objects into user-specified area. The motive of ObjectAdd stems from: first, describing everything in one prompt can be difficult, and second, users often need to add objects into the generated image. To accommodate with real world, our ObjectAdd maintains accurate image consistency after adding objects with technical innovations in: (1) embedding-level concatenation to ensure correct text embedding coalesce; (2) object-driven layout control with latent and attention injection to ensure objects accessing user-specified area; (3) prompted image inpainting in an attention refocusing & object expansion fashion to ensure rest of the image stays the same. With a text-prompted image, our ObjectAdd allows users to specify a box and an object, and achieves: (1) adding object inside the box area; (2) exact content outside the box area; (3) flawless fusion between the two areas
翻译:我们提出ObjectAdd,一种免训练的扩散修改方法,用于在用户指定区域添加用户期望的对象。ObjectAdd的动机源于:首先,在单次提示中描述所有内容可能较为困难;其次,用户通常需要在已生成的图像中添加对象。为适应现实场景,ObjectAdd在添加对象后保持图像一致性,其技术创新包括:(1)嵌入级拼接,确保文本嵌入正确融合;(2)基于对象的布局控制,通过潜在空间与注意力注入确保对象进入用户指定区域;(3)基于提示的图像修补,采用注意力重聚焦与对象扩展方式,确保图像其余部分保持不变。基于文本提示图像,ObjectAdd允许用户指定边界框与对象,实现:(1)在边界框内添加对象;(2)边界框外内容完全保留;(3)两个区域间的无缝融合。