3D Gaussian Splats (3DGS) have proven a versatile rendering primitive, both for inverse rendering as well as real-time exploration of scenes. In these applications, coherence across camera frames and multiple views is crucial, be it for robust convergence of a scene reconstruction or for artifact-free fly-throughs. Recent work started mitigating artifacts that break multi-view coherence, including popping artifacts due to inconsistent transparency sorting and perspective-correct outlines of (2D) splats. At the same time, real-time requirements forced such implementations to accept compromises in how transparency of large assemblies of 3D Gaussians is resolved, in turn breaking coherence in other ways. In our work, we aim at achieving maximum coherence, by rendering fully perspective-correct 3D Gaussians while using a high-quality approximation of accurate blending, hybrid transparency, on a per-pixel level, in order to retain real-time frame rates. Our fast and perspectively accurate approach for evaluation of 3D Gaussians does not require matrix inversions, thereby ensuring numerical stability and eliminating the need for special handling of degenerate splats, and the hybrid transparency formulation for blending maintains similar quality as fully resolved per-pixel transparencies at a fraction of the rendering costs. We further show that each of these two components can be independently integrated into Gaussian splatting systems. In combination, they achieve up to 2$\times$ higher frame rates, 2$\times$ faster optimization, and equal or better image quality with fewer rendering artifacts compared to traditional 3DGS on common benchmarks.

翻译：三维高斯溅射（3DGS）已被证明是一种通用的渲染基元，既适用于逆向渲染，也适用于场景的实时探索。在这些应用中，相机帧间和多视图间的连贯性至关重要，无论是为了场景重建的稳健收敛，还是为了实现无伪影的穿行浏览。近期研究开始缓解破坏多视图连贯性的伪影，包括由透明排序不一致引起的突变伪影以及（二维）溅射的透视校正轮廓问题。与此同时，实时性要求迫使此类实现在处理大规模三维高斯集合的透明度合成时不得不做出妥协，从而在其他方面破坏了连贯性。在本工作中，我们旨在实现最大程度的连贯性，通过渲染完全透视校正的三维高斯，同时在像素级别采用高质量近似精确混合的混合透明度方法，以保持实时帧率。我们提出的快速且透视精确的三维高斯求值方法无需矩阵求逆，从而确保了数值稳定性，并消除了对退化溅射进行特殊处理的需求；而用于混合的混合透明度公式能以极低的渲染成本保持与完全解析的逐像素透明度相近的质量。我们进一步证明，这两个组件均可独立集成到高斯溅射系统中。结合使用时，在常见基准测试中，相较于传统3DGS，它们实现了高达2倍的帧率提升、2倍的优化加速，并以更少的渲染伪影获得了同等或更优的图像质量。