Remarkable progress has been made in 4D content generation recently. However, existing methods suffer from long optimization time, lack of motion controllability, and a low level of detail. In this paper, we introduce DreamGaussian4D, an efficient 4D generation framework that builds on 4D Gaussian Splatting representation. Our key insight is that the explicit modeling of spatial transformations in Gaussian Splatting makes it more suitable for the 4D generation setting compared with implicit representations. DreamGaussian4D reduces the optimization time from several hours to just a few minutes, allows flexible control of the generated 3D motion, and produces animated meshes that can be efficiently rendered in 3D engines.
翻译:近期,4D内容生成领域取得了显著进展。然而,现有方法存在优化时间长、运动可控性不足以及细节层次较低等问题。本文提出DreamGaussian4D——一种基于4D高斯溅射表示的高效4D生成框架。我们的核心洞见在于:与隐式表示相比,高斯溅射中空间变换的显式建模使其更适用于4D生成场景。DreamGaussian4D将优化时间从数小时缩短至数分钟,支持对生成的三维运动进行灵活控制,并能输出可在三维引擎中高效渲染的动画网格。