3D Gaussian Splatting showcases notable advancements in photo-realistic and real-time novel view synthesis. However, it faces challenges in modeling mirror reflections, which exhibit substantial appearance variations from different viewpoints. To tackle this problem, we present MirrorGaussian, the first method for mirror scene reconstruction with real-time rendering based on 3D Gaussian Splatting. The key insight is grounded on the mirror symmetry between the real-world space and the virtual mirror space. We introduce an intuitive dual-rendering strategy that enables differentiable rasterization of both the real-world 3D Gaussians and the mirrored counterpart obtained by reflecting the former about the mirror plane. All 3D Gaussians are jointly optimized with the mirror plane in an end-to-end framework. MirrorGaussian achieves high-quality and real-time rendering in scenes with mirrors, empowering scene editing like adding new mirrors and objects. Comprehensive experiments on multiple datasets demonstrate that our approach significantly outperforms existing methods, achieving state-of-the-art results. Project page: https://mirror-gaussian.github.io/.

翻译：三维高斯泼溅技术在照片级真实感与实时新视角合成方面展现出显著进展。然而，其在建模镜面反射（不同视角下外观变化显著）时面临挑战。为解决此问题，我们提出MirrorGaussian，首个基于三维高斯泼溅实现镜面场景重建与实时渲染的方法。核心思路基于真实空间与虚拟镜像空间之间的镜面对称性。我们引入直观的双渲染策略，能够对真实世界三维高斯函数及其绕镜面反射后得到的镜像对应体进行可微分光栅化。所有三维高斯函数与镜面平面在端到端框架中联合优化。MirrorGaussian在包含镜面的场景中实现高质量实时渲染，支持添加新镜面与物体等场景编辑操作。在多个数据集上的综合实验表明，我们的方法显著优于现有方法，达到最先进水平。项目页面：https://mirror-gaussian.github.io/。