We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads, employing 3D Gaussians anchored on a parametric face model. To enhance representational capabilities and encode spatial information, we embed a lightweight tri-plane payload within each Gaussian rather than directly storing color and opacity. Additionally, we parameterize the Gaussians in a 2D UV space via a 3DMM, enabling effective utilization of the diffusion model for 3D head avatar generation. Our method facilitates the creation of diverse and realistic 3D human heads with fine-grained editing over facial features and expressions. Extensive experiments demonstrate the effectiveness of our method.
翻译:摘要:本文提出了一种新颖框架,用于生成逼真的三维人头模型,并随后以卓越的灵活性对其进行操控与姿态重定向。该方法利用三维人头的隐式函数表示,将三维高斯分布锚定于参数化人脸模型之上。为增强表征能力并编码空间信息,我们在每个高斯体中嵌入轻量级三平面载荷,而非直接存储颜色与不透明度。此外,通过三维形变模型(3DMM)将高斯体参数化至二维UV空间,从而有效利用扩散模型进行三维头部虚拟形象生成。本方法能够生成多样化且逼真的三维人头,并对面部特征与表情实现细粒度编辑。大量实验验证了该方法的有效性。