We demonstrate the feasibility of integrating physics-based animations of solids and fluids with 3D Gaussian Splatting (3DGS) to create novel effects in virtual scenes reconstructed using 3DGS. Leveraging the coherence of the Gaussian splatting and position-based dynamics (PBD) in the underlying representation, we manage rendering, view synthesis, and the dynamics of solids and fluids in a cohesive manner. Similar to Gaussian shader, we enhance each Gaussian kernel with an added normal, aligning the kernel's orientation with the surface normal to refine the PBD simulation. This approach effectively eliminates spiky noises that arise from rotational deformation in solids. It also allows us to integrate physically based rendering to augment the dynamic surface reflections on fluids. Consequently, our framework is capable of realistically reproducing surface highlights on dynamic fluids and facilitating interactions between scene objects and fluids from new views. For more information, please visit our project page at \url{https://amysteriouscat.github.io/GaussianSplashing/}.
翻译:我们证明了将基于物理的固流体动画与三维高斯泼溅(3DGS)技术相结合的可行性,从而在使用3DGS重建的虚拟场景中生成新颖效果。通过利用高斯泼溅表示与基于位置动力学(PBD)在底层表征上的内在一致性,我们以统一的方式管理渲染、视角合成以及固流体动力学过程。类似于高斯着色器,我们为每个高斯核添加一个法线约束,将核的取向与表面法线对齐,以优化PBD模拟。该方法有效消除了固体旋转形变产生的尖刺噪声,并允许我们集成基于物理的渲染来增强流体表面的动态反射。因此,我们的框架能够真实再现动态流体表面的高光效果,并支持从新视角实现的场景物体与流体交互。更多信息请访问项目页面:\url{https://amysteriouscat.github.io/GaussianSplashing/}。