We present a real-time global illumination approach along with a pipeline for dynamic 3D Gaussian models and meshes. Building on a formulated surface light transport model for 3D Gaussians, we address key performance challenges with a fast compound stochastic ray-tracing algorithm and an optimized 3D Gaussian rasterizer. Our pipeline integrates multiple real-time techniques to accelerate performance and achieve high-quality lighting effects. Our approach enables real-time rendering of dynamic scenes with interactively editable materials and dynamic lighting of diverse multi-lights settings, capturing mutual multi-bounce light transport (indirect illumination) between 3D Gaussians and mesh. Additionally, we present a real-time renderer with an interactive user interface, validating our approach and demonstrating its practicality and high efficiency with over 40 fps in scenes including both 3D Gaussians and mesh. Furthermore, our work highlights the potential of 3D Gaussians in real-time applications with dynamic lighting, offering insights into performance and optimization.

翻译：我们提出了一种针对动态三维高斯模型与网格的实时全局光照方法及其配套管线。基于为三维高斯体形式化建立的表面光传输模型，我们通过快速复合随机射线追踪算法与优化后的三维高斯光栅化器解决了关键性能挑战。该管线集成了多种实时技术以加速计算并实现高质量光照效果。我们的方法可对包含交互式可编辑材质与多光源动态照明的动态场景进行实时渲染，捕获三维高斯体与网格之间的多重互反射光传输（间接光照）。此外，我们开发了带交互式用户界面的实时渲染器，在包含三维高斯体与网格的场景中以超过40帧/秒的速率验证了方法的实用性与高能效。本研究进一步揭示了三维高斯体在动态光照实时应用中的潜力，为性能优化提供了重要见解。