3D editing plays a crucial role in many areas such as gaming and virtual reality. Traditional 3D editing methods, which rely on representations like meshes and point clouds, often fall short in realistically depicting complex scenes. On the other hand, methods based on implicit 3D representations, like Neural Radiance Field (NeRF), render complex scenes effectively but suffer from slow processing speeds and limited control over specific scene areas. In response to these challenges, our paper presents GaussianEditor, an innovative and efficient 3D editing algorithm based on Gaussian Splatting (GS), a novel 3D representation. GaussianEditor enhances precision and control in editing through our proposed Gaussian semantic tracing, which traces the editing target throughout the training process. Additionally, we propose Hierarchical Gaussian splatting (HGS) to achieve stabilized and fine results under stochastic generative guidance from 2D diffusion models. We also develop editing strategies for efficient object removal and integration, a challenging task for existing methods. Our comprehensive experiments demonstrate GaussianEditor's superior control, efficacy, and rapid performance, marking a significant advancement in 3D editing. Project Page: https://buaacyw.github.io/gaussian-editor/

翻译：3D编辑在游戏和虚拟现实等多个领域扮演着关键角色。传统基于网格和点云等表示的3D编辑方法，通常在真实感地描绘复杂场景方面表现不足。另一方面，基于隐式3D表示（如神经辐射场NeRF）的方法虽能有效渲染复杂场景，但存在处理速度慢、对特定场景区域控制能力有限等问题。针对这些挑战，本文提出高斯编辑器（GaussianEditor），一种基于新型3D表示——高斯泼溅（GS）的创新高效3D编辑算法。通过我们提出的高斯语义追踪（Gaussian semantic tracing）技术，高斯编辑器能在整个训练过程中追踪编辑目标，从而提升编辑的精度和可控性。此外，我们提出了分层高斯泼溅（HGS）方法，以在二维扩散模型的随机生成引导下实现稳定且精细的编辑效果。我们还开发了针对高效物体移除与整合的编辑策略，这是现有方法难以应对的任务。综合实验表明，高斯编辑器在控制性、效果和速度上均表现卓越，标志着3D编辑领域的重要进展。项目页面：https://buaacyw.github.io/gaussian-editor/