In novel view synthesis of scenes from multiple input views, 3D Gaussian splatting emerges as a viable alternative to existing radiance field approaches, delivering great visual quality and real-time rendering. While successful in static scenes, the present advancement of 3D Gaussian representation, however, faces challenges in dynamic scenes in terms of memory consumption and the need for numerous observations per time step, due to the onus of storing 3D Gaussian parameters per time step. In this study, we present an efficient 3D Gaussian representation tailored for dynamic scenes in which we define positions and rotations as functions of time while leaving other time-invariant properties of the static 3D Gaussian unchanged. Notably, our representation reduces memory usage, which is consistent regardless of the input sequence length. Additionally, it mitigates the risk of overfitting observed frames by accounting for temporal changes. The optimization of our Gaussian representation based on image and flow reconstruction results in a powerful framework for dynamic scene view synthesis in both monocular and multi-view cases. We obtain the highest rendering speed of $118$ frames per second (FPS) at a resolution of $1352 \times 1014$ with a single GPU, showing the practical usability and effectiveness of our proposed method in dynamic scene rendering scenarios.

翻译：在新视角合成任务中，针对多输入视图的场景，三维高斯泼溅方法作为现有辐射场方法的可行替代方案出现，能够提供出色的视觉质量和实时渲染性能。尽管在静态场景中取得了成功，当前三维高斯表示在动态场景中却面临内存消耗和每个时间步需要大量观测数据的挑战——这源于每个时间步需存储三维高斯参数的负担。本研究提出了一种专为动态场景设计的高效三维高斯表示，其中将位置和旋转定义为时间函数，同时保持静态三维高斯其他时不变属性不变。值得注意的是，我们的表示方法能够减少内存使用量，且该用量与输入序列长度无关。此外，通过处理时序变化，该方法降低了观测帧过拟合的风险。基于图像与光流重建结果优化高斯表示，我们构建了一个用于单目及多视角动态场景视图合成的强大框架。在单GPU配置下，以$1352 \times 1014$分辨率实现每秒$118$帧的最高渲染速度，充分展示了所提方法在动态场景渲染中的实用性与有效性。