Creating high-quality 3D avatars using 3D Gaussian Splatting (3DGS) from a monocular video benefits virtual reality and telecommunication applications. However, existing automatic methods exhibit artifacts under novel poses due to limited information in the input video. We propose AvatarPerfect, a novel system that allows users to iteratively refine 3DGS avatars by manually editing the rendered avatar images. In each iteration, our system suggests a new body and camera pose to help users identify and correct artifacts. The edited images are then used to update the current avatar, and our system suggests the next body and camera pose for further refinement. To investigate the effectiveness of AvatarPerfect, we conducted a user study comparing our method to an existing 3DGS editor SuperSplat, which allows direct manipulation of Gaussians without automatic pose suggestions. The results indicate that our system enables users to obtain higher quality refined 3DGS avatars than the existing 3DGS editor.
翻译:利用单目视频通过三维高斯溅射(3DGS)创建高质量三维化身,对虚拟现实和远程通信应用具有重要价值。然而,由于输入视频信息有限,现有自动方法在新姿态下常出现伪影。本文提出AvatarPerfect,一种允许用户通过手动编辑渲染化身图像来迭代精炼3DGS化身的创新系统。在每次迭代中,系统会建议新的身体姿态与相机位姿,以协助用户识别并修正伪影。编辑后的图像将用于更新当前化身,系统继而推荐下一组身体与相机姿态以进行持续优化。为验证AvatarPerfect的有效性,我们开展了用户研究,将本方法与现有3DGS编辑器SuperSplat(支持直接操作高斯函数但无自动姿态建议功能)进行对比。结果表明,相较于现有3DGS编辑器,本系统能帮助用户获得更高质量的精炼三维高斯溅射化身。