Remarkable progress has been made in 4D content generation recently. However, existing methods suffer from long optimization time, lack of motion controllability, and a low level of detail. In this paper, we introduce DreamGaussian4D, an efficient 4D generation framework that builds on 4D Gaussian Splatting representation. Our key insight is that the explicit modeling of spatial transformations in Gaussian Splatting makes it more suitable for the 4D generation setting compared with implicit representations. DreamGaussian4D reduces the optimization time from several hours to just a few minutes, allows flexible control of the generated 3D motion, and produces animated meshes that can be efficiently rendered in 3D engines.
翻译:近期,4D内容生成领域取得了显著进展。然而,现有方法存在优化时间长、运动可控性差以及细节水平低的问题。本文提出DreamGaussian4D,这是一个基于4D高斯点绘制表示的高效4D生成框架。我们的核心见解是:与隐式表示相比,高斯点绘制中对空间变换的显式建模使其更适用于4D生成场景。DreamGaussian4D将优化时间从数小时缩短至数分钟,支持对生成三维运动的灵活控制,并可生成能在3D引擎中高效渲染的动态网格。