Recent advancements in Gaussian Splatting have enabled increasingly accurate reconstruction of photorealistic head avatars, opening the door to numerous applications in visual effects, videoconferencing, and virtual reality. This, however, comes with the lack of intuitive editability offered by traditional triangle mesh-based methods. In contrast, we propose a method that combines the accuracy and fidelity of 2D Gaussian Splatting with the intuitiveness of UV texture mapping. By embedding each canonical Gaussian primitive's local frame into a patch in the UV space of a template mesh in a computationally efficient manner, we reconstruct continuous editable material head textures from a single monocular video on a conventional UV domain. Furthermore, we leverage an efficient physically based reflectance model to enable relighting and editing of these intrinsic material maps. Through extensive comparisons with state-of-the-art methods, we demonstrate the accuracy of our reconstructions, the quality of our relighting results, and the ability to provide intuitive controls for modifying an avatar's appearance and geometry via texture mapping without additional optimization.
翻译:近期高斯泼溅技术的进展使得照片级真实感头部虚拟化身的重建愈发精确,为视觉效果、视频会议和虚拟现实等众多应用开辟了道路。然而,这却牺牲了传统三角网格方法所提供的直观可编辑性。与此不同,我们提出了一种方法,将二维高斯泼溅的精确性与保真度与UV纹理映射的直观性相结合。通过以计算高效的方式将每个规范高斯基元的局部帧嵌入到模板网格UV空间中的图块内,我们能够从单目视频在常规UV域上重建连续且可编辑的材质头部纹理。此外,我们利用高效的基于物理的反射模型,实现了对这些本征材质贴图的重光照与编辑。通过与现有最先进方法的广泛比较,我们证明了重建的精确性、重光照结果的质量,以及通过纹理映射无需额外优化即可直观修改虚拟化身外观与几何形状的能力。