3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particularly in mirrors, leading to incorrect reconstructions and inconsistent reflective properties. To address this challenge, we introduce Mirror-3DGS, a novel framework designed to accurately handle mirror geometries and reflections, thereby generating realistic mirror reflections. By incorporating mirror attributes into 3DGS and leveraging plane mirror imaging principles, Mirror-3DGS simulates a mirrored viewpoint from behind the mirror, enhancing the realism of scene renderings. Extensive evaluations on both synthetic and real-world scenes demonstrate that our method can render novel views with improved fidelity in real-time, surpassing the state-of-the-art Mirror-NeRF, especially in mirror regions.
翻译:3D高斯溅射(3DGS)显著推动了三维场景重建与新视角合成的发展。然而,与神经辐射场(NeRF)类似,3DGS在精确建模物理反射(尤其是镜面反射)方面存在困难,导致重建结果失真与反射属性不一致。为应对这一挑战,我们提出了Mirror-3DGS——一个旨在精确处理镜面几何与反射的新型框架,从而生成逼真的镜面反射效果。通过将镜面属性融入3DGS并利用平面镜成像原理,Mirror-3DGS能够模拟镜后虚拟视点,显著提升场景渲染的真实感。在合成场景与真实场景上的大量实验表明,本方法能够以实时速率渲染出具有更高保真度的新视角,尤其在镜面区域的表现超越了当前最先进的Mirror-NeRF方法。