This paper proposes a method for fast scene radiance field reconstruction with strong novel view synthesis performance and convenient scene editing functionality. The key idea is to fully utilize semantic parsing and primitive extraction for constraining and accelerating the radiance field reconstruction process. To fulfill this goal, a primitive-aware hybrid rendering strategy was proposed to enjoy the best of both volumetric and primitive rendering. We further contribute a reconstruction pipeline conducts primitive parsing and radiance field learning iteratively for each input frame which successfully fuses semantic, primitive, and radiance information into a single framework. Extensive evaluations demonstrate the fast reconstruction ability, high rendering quality, and convenient editing functionality of our method.
翻译:本文提出一种面向快速场景辐射场重建的方法,兼具优异的新视角合成性能与便捷的场景编辑功能。其核心思想在于充分利用语义解析与基元提取来约束并加速辐射场重建过程。为实现此目标,提出一种基元感知的混合渲染策略,兼顾体素渲染与基元渲染的优势。我们进一步构建了逐帧迭代执行基元解析与辐射场学习的重建流程,成功将语义、基元与辐射信息融合至统一框架中。大量实验表明,该方法具备快速重建能力、高渲染质量及便捷的编辑功能。