While impressive progress has recently been made in image-oriented facial attribute translation, shape-oriented 3D facial attribute translation remains an unsolved issue. This is primarily limited by the lack of 3D generative models and ineffective usage of 3D facial data. We propose a learning framework for 3D facial attribute translation to relieve these limitations. Firstly, we customize a novel geometric map for 3D shape representation and embed it in an end-to-end generative adversarial network. The geometric map represents 3D shapes symmetrically on a square image grid, while preserving the neighboring relationship of 3D vertices in a local least-square sense. This enables effective learning for the latent representation of data with different attributes. Secondly, we employ a unified and unpaired learning framework for multi-domain attribute translation. It not only makes effective usage of data correlation from multiple domains, but also mitigates the constraint for hardly accessible paired data. Finally, we propose a hierarchical architecture for the discriminator to guarantee robust results against both global and local artifacts. We conduct extensive experiments to demonstrate the advantage of the proposed framework over the state-of-the-art in generating high-fidelity facial shapes. Given an input 3D facial shape, the proposed framework is able to synthesize novel shapes of different attributes, which covers some downstream applications, such as expression transfer, gender translation, and aging. Code at https://github.com/NaughtyZZ/3D_facial_shape_attribute_translation_ssgmap.
翻译:尽管面向图像的人脸属性翻译近年来取得了显著进展,但针对形状的3D人脸属性翻译仍是一个未解决的问题。这主要受限于3D生成模型的缺乏以及3D人脸数据利用效率低下。为此,我们提出一种3D人脸属性翻译的学习框架以缓解这些局限。首先,我们定制了一种新型几何映射用于3D形状表示,并将其嵌入端到端生成对抗网络。该几何映射在方形图像网格上对称地表示3D形状,同时在局部最小二乘意义上保持3D顶点的邻接关系,从而有效学习不同属性数据的潜在表示。其次,我们采用统一且无需配准的多领域属性翻译学习框架,不仅有效利用了多领域间的数据相关性,还缓解了难以获取配对数据的约束。最后,我们提出分层判别器架构,确保对全局与局部伪影均具有鲁棒性的生成结果。通过大量实验证明,所提框架在生成高保真人脸形状方面优于现有最优方法。给定输入3D人脸形状,本框架能合成具有不同属性的新形状,涵盖表情迁移、性别转换和老龄化等下游应用。代码详见 https://github.com/NaughtyZZ/3D_facial_shape_attribute_translation_ssgmap。