We demonstrate the feasibility of integrating physics-based animations of solids and fluids with 3D Gaussian Splatting (3DGS) to create novel effects in virtual scenes reconstructed using 3DGS. Leveraging the coherence of the Gaussian Splatting and Position-Based Dynamics (PBD) in the underlying representation, we manage rendering, view synthesis, and the dynamics of solids and fluids in a cohesive manner. Similar to GaussianShader, we enhance each Gaussian kernel with an added normal, aligning the kernel's orientation with the surface normal to refine the PBD simulation. This approach effectively eliminates spiky noises that arise from rotational deformation in solids. It also allows us to integrate physically based rendering to augment the dynamic surface reflections on fluids. Consequently, our framework is capable of realistically reproducing surface highlights on dynamic fluids and facilitating interactions between scene objects and fluids from new views. For more information, please visit our project page at \url{https://gaussiansplashing.github.io/}.
翻译:我们证明了将基于物理的固体与流体动画与三维高斯溅射(3DGS)技术相结合,可在使用3DGS重建的虚拟场景中创造新颖视觉效果的可行性。通过利用高斯溅射与位置动力学(PBD)在底层表示中的一致性,我们以统一的方式实现了渲染、视图合成以及固体与流体的动力学模拟。类似于GaussianShader,我们通过为每个高斯核添加法向量来增强其表征能力,使核方向与表面法线对齐以优化PBD模拟。该方法有效消除了固体旋转变形产生的尖峰噪声,同时支持集成基于物理的渲染来增强流体动态表面反射效果。因此,我们的框架能够逼真再现动态流体表面高光,并支持从新视角观察场景物体与流体间的交互作用。更多信息请访问项目页面:\url{https://gaussiansplashing.github.io/}。