We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads, employing 3D Gaussians anchored on a parametric face model. To enhance representational capabilities and encode spatial information, we embed a lightweight tri-plane payload within each Gaussian rather than directly storing color and opacity. Additionally, we parameterize the Gaussians in a 2D UV space via a 3DMM, enabling effective utilization of the diffusion model for 3D head avatar generation. Our method facilitates the creation of diverse and realistic 3D human heads with fine-grained editing over facial features and expressions. Extensive experiments demonstrate the effectiveness of our method.
翻译:摘要:我们提出了一种新颖的框架,用于生成逼真的三维人头模型,并随后以显著的灵活性对其进行操纵和姿态调整。该方法利用三维人头的隐式函数表示,采用锚定在参数化人脸模型上的三维高斯体。为了增强表示能力并编码空间信息,我们在每个高斯体中嵌入一个轻量级的三平面载荷,而非直接存储颜色和不透明度。此外,我们通过三维形变模型将高斯体参数化到二维UV空间中,从而能够有效利用扩散模型进行三维头部虚拟形象生成。我们的方法有助于生成多样化且逼真的三维人头,并支持对面部特征和表情进行精细编辑。大量实验证明了我们方法的有效性。