Radiance Fields (RFs) have shown great potential to represent scenes from casually captured discrete views. Compositing parts or whole of multiple captured scenes could greatly interest several XR applications. Prior works can generate new views of such scenes by tracing each scene in parallel. This increases the render times and memory requirements with the number of components. In this work, we provide a method to create a single, compact, fused RF representation for a scene composited using multiple RFs. The fused RF has the same render times and memory utilizations as a single RF. Our method distills information from multiple teacher RFs into a single student RF while also facilitating further manipulations like addition and deletion into the fused representation.
翻译:辐射场(RF)在从随意拍摄的离散视角表示场景方面展现出巨大潜力。将多个拍摄场景的部分或整体进行合成,可能对多种扩展现实(XR)应用具有重要意义。先前的工作通过并行追踪每个场景来生成此类场景的新视角,但这会导致渲染时间和内存需求随组件数量增加而增加。本文提出了一种方法,能够为使用多个RF合成的场景创建一个紧凑且融合的单一RF表示。融合后的RF具有与单个RF相同的渲染时间和内存占用。我们的方法将多个教师RF的信息蒸馏到单一学生RF中,同时支持对融合表示进行添加和删除等进一步操作。