Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to maintain. We introduce the 4D Gaussian Splatting (4D-GS) to achieve real-time dynamic scene rendering while also enjoying high training and storage efficiency. An efficient deformation field is constructed to model both Gaussian motions and shape deformations. Different adjacent Gaussians are connected via a HexPlane to produce more accurate position and shape deformations. Our 4D-GS method achieves real-time rendering under high resolutions, 70 FPS at a 800$\times$800 resolution on an RTX 3090 GPU, while maintaining comparable or higher quality than previous state-of-the-art methods. More demos and code are available at https://guanjunwu.github.io/4dgs/.
翻译:表示和渲染动态场景一直是一项重要但充满挑战的任务。特别是,为了精确建模复杂运动,通常难以维持高效率。我们提出了4D高斯溅射(4D-GS),以实现实时动态场景渲染,同时保持高训练和存储效率。构建了一个高效的形变场来建模高斯运动和形状变形。通过HexPlane连接不同的相邻高斯,以产生更精确的位置和形状变形。我们的4D-GS方法在高分辨率下实现实时渲染,在RTX 3090 GPU上以800×800分辨率达到70 FPS,同时保持与先前最先进方法相当或更高的质量。更多演示和代码可在https://guanjunwu.github.io/4dgs/获取。