In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes. We build upon MyStyle, a recently introduced method, that tunes the weights of a pre-trained StyleGAN face generator on a few images of an individual. This system allows synthesizing, editing, and enhancing images of the target individual with high fidelity to their facial features. However, MyStyle does not demonstrate precise control over the attributes of the generated images. We propose to address this problem through a novel optimization system that organizes the latent space in addition to tuning the generator. Our key contribution is to formulate a loss that arranges the latent codes, corresponding to the input images, along a set of specific directions according to their attributes. We demonstrate that our approach, dubbed MyStyle++, is able to synthesize, edit, and enhance images of an individual with great control over the attributes, while preserving the unique facial characteristics of that individual.
翻译:本文提出一种方法,用于获得具有对一组属性的显式控制能力的个性化生成先验。我们基于近期提出的MyStyle方法进行改进,该方法通过微调预训练StyleGAN人脸生成器在目标个体的少量图像上的权重,实现对目标个体的图像合成、编辑与增强,并保持对其面部特征的高保真度。然而,MyStyle未能展现对生成图像属性的精确控制。我们通过一种新型优化系统来解决这一问题,该系统在微调生成器的同时组织潜在空间。我们的核心贡献在于提出一种损失函数,能够根据属性将输入图像对应的潜在编码沿特定方向排列。实验证明,我们的方法(称为MyStyle++)能够在保持个体独特面部特征的同时,以高度可控性实现目标个体的图像合成、编辑与增强。