Online ads showing e-commerce products typically rely on the product images in a catalog sent to the advertising platform by an e-commerce platform. In the broader ads industry such ads are called dynamic product ads (DPA). It is common for DPA catalogs to be in the scale of millions (corresponding to the scale of products which can be bought from the e-commerce platform). However, not all product images in the catalog may be appealing when directly re-purposed as an ad image, and this may lead to lower click-through rates (CTRs). In particular, products just placed against a solid background may not be as enticing and realistic as a product staged in a natural environment. To address such shortcomings of DPA images at scale, we propose a generative adversarial network (GAN) based approach to generate staged backgrounds for un-staged product images. Generating the entire staged background is a challenging task susceptible to hallucinations. To get around this, we introduce a simpler approach called copy-paste staging using retrieval assisted GANs. In copy paste staging, we first retrieve (from the catalog) staged products similar to the un-staged input product, and then copy-paste the background of the retrieved product in the input image. A GAN based in-painting model is used to fill the holes left after this copy-paste operation. We show the efficacy of our copy-paste staging method via offline metrics, and human evaluation. In addition, we show how our staging approach can enable animations of moving products leading to a video ad from a product image.

翻译：在线广告中展示电子商务产品时，通常依赖电子商务平台向广告平台提供的产品目录图像。在整个广告行业中，此类广告被称为动态产品广告（DPA）。DPA目录的规模通常可达数百万级（对应电子商务平台可购买产品的数量）。然而，并非所有目录中的产品图像在直接用于广告图像时都具有吸引力，这可能导致点击率（CTR）降低。具体而言，仅置于纯色背景前的产品可能不如放置在自然场景中的产品具有吸引力和真实感。为解决DPA图像规模化存在的此类缺陷，我们提出一种基于生成对抗网络（GAN）的方法，为未场景化的产品图像生成场景化背景。完整生成场景化背景是一项容易产生幻觉的艰巨任务。为规避此问题，我们引入了一种更简单的称为"复制-粘贴场景化"的方法，该方法基于检索辅助GAN。在复制-粘贴场景化中，我们首先从目录中检索与未场景化输入产品相似的已场景化产品，然后将检索到的产品背景复制粘贴到输入图像中。利用基于GAN的修补模型填补此复制-粘贴操作留下的空洞。我们通过离线指标和人工评估证明了复制-粘贴场景化方法的有效性。此外，我们还展示了场景化方法如何实现产品移动的动画效果，从而将产品图像转化为视频广告。