Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality.

翻译：近年来，三维高斯溅射（3DGS）因其高保真度与实时渲染能力而备受关注。然而，由于独特的3D到2D投影计算，将3DGS适配至不同相机模型（尤其是鱼眼镜头）仍面临挑战。此外，基于图块的高斯溅射方法存在效率瓶颈，这在鱼眼镜头特有的极端曲率与宽视场角场景中尤为突出，而此类特性对其在更广泛现实场景中的应用至关重要。为应对这些挑战，本文提出Fisheye-GS。这一创新方法为鱼眼相机重新计算了投影变换及其梯度。我们的方案可作为模块无缝集成到其他高效三维渲染方法中，突显了其可扩展性、轻量化特性与模块化设计。由于仅修改了投影组件，该方法也能轻松适配不同相机模型。与先进行畸变校正再训练的方法相比，本方法在视觉质量上展现出显著提升。