Recently, 3D Gaussian Splatting has dominated novel-view synthesis with its real-time rendering speed and state-of-the-art rendering quality. However, during the rendering process, the use of the Jacobian of the affine approximation of the projection transformation leads to inevitable errors, resulting in blurriness, artifacts and a lack of scene consistency in the final rendered images. To address this issue, we introduce an ellipsoid-based projection method to calculate the projection of Gaussian ellipsoid on the image plane, witch is the primitive of 3D Gaussian Splatting. As our proposed ellipsoid-based projection method cannot handle Gaussian ellipsoids with camera origins inside them or parts lying below $z=0$ plane in the camera space, we designed a pre-filtering strategy. Experiments over multiple widely adopted benchmark datasets show that using our ellipsoid-based projection method can enhance the rendering quality of 3D Gaussian Splatting and its extensions.
翻译:近年来,三维高斯溅射凭借其实时渲染速度和最先进的渲染质量,在新视角合成领域占据主导地位。然而,在渲染过程中,使用投影变换仿射近似的雅可比矩阵会引入不可避免的误差,导致最终渲染图像出现模糊、伪影以及场景一致性的缺失。为解决此问题,我们提出了一种基于椭圆体的投影方法,用于计算三维高斯溅射的基本单元——高斯椭圆体在成像平面上的投影。由于我们提出的基于椭圆体的投影方法无法处理相机空间内相机原点位于其内部或部分位于 $z=0$ 平面以下的高斯椭圆体,我们设计了一种预过滤策略。在多个广泛采用的基准数据集上的实验表明,使用我们的基于椭圆体的投影方法能够提升三维高斯溅射及其扩展模型的渲染质量。