Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality.

翻译：近年来，三维高斯溅射（3DGS）因其高保真度和实时渲染能力而备受关注。然而，由于独特的3D到2D投影计算，将3DGS适配于不同相机模型（尤其是鱼眼镜头）面临挑战。此外，基于图块的溅射方法存在效率问题，特别是对于鱼眼镜头极端的曲率和宽广的视场而言，而这些特性对其更广泛的实际应用至关重要。为应对这些挑战，我们提出了Fisheye-GS。这一创新方法为鱼眼相机重新计算了投影变换及其梯度。我们的方法可作为一个模块无缝集成到其他高效的三维渲染方法中，突出了其可扩展性、轻量级特性与模块化设计。由于我们仅修改了投影组件，该方法也能轻松适配不同的相机模型。与先进行畸变校正再训练的方法相比，我们的方法在视觉质量上展现出显著提升。