Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the natural artistic style and human sentiment. In this paper, we propose a novel StyleIdentityGAN model, which can ensure the identity and artistry of the generated portrait at the same time. Specifically, the style-enhanced module focuses on artistic style features decoupling and transferring to improve the artistry of generated virtual face images. Meanwhile, the identity-enhanced module preserves the significant features extracted from the input photo. Furthermore, the proposed method requires a small number of reference style data. Experiments demonstrate the superiority of StyleIdentityGAN over state-of-art methods in artistry and identity effects, with comparisons done qualitatively, quantitatively and through a perceptual user study. Code has been released on Github3.

翻译：如今，虚拟数字人的广泛应用促进了数字经济支撑下的数字文化的全面繁荣与发展。由AI技术自动生成的个性化肖像需要兼具自然的艺术风格与人文情感。本文提出一种新颖的StyleIdentityGAN模型，该模型能够同时确保生成肖像的身份特征与艺术性。具体而言，风格增强模块专注于艺术风格特征的解耦与迁移，以提升生成虚拟人脸图像的艺术表现力；同时，身份保持模块保留从输入照片中提取的关键特征。此外，本方法仅需少量参考风格数据。实验通过定性、定量对比及感知用户研究，展示了StyleIdentityGAN在艺术性与身份保持效果上相比现有最优方法的优越性。相关代码已在Github3上开源。