Neural radiance field (NeRF) has shown remarkable performance in generating photo-realistic novel views. Since the emergence of NeRF, many studies have been conducted, among which managing features with explicit structures such as grids has achieved exceptionally fast training by reducing the complexity of multilayer perceptron (MLP) networks. However, storing features in dense grids requires significantly large memory space, which leads to memory bottleneck in computer systems and thus large training time. To address this issue, in this work, we propose MixNeRF, a memory-efficient NeRF framework that employs a mixed-up hash table to improve memory efficiency and reduce training time while maintaining reconstruction quality. We first design a \textit{mixed-up hash table} to adaptively mix part of multi-level feature grids into one and map it to a single hash table. Following that, in order to obtain the correct index of a grid point, we further design an \textit{index transformation} method that transforms indices of an arbitrary level grid to those of a canonical grid. Extensive experiments benchmarking with state-of-the-art Instant-NGP, TensoRF, and DVGO, indicate our MixNeRF could achieve the fastest training time on the same GPU hardware with similar or even higher reconstruction quality. Source code is available at \url{https://github.com/nfyfamr/MixNeRF}.
翻译:神经辐射场(NeRF)在生成逼真的新视角方面展现了卓越的性能。自NeRF问世以来,大量研究相继展开,其中通过网格等显式结构管理特征的方法,因降低了多层感知机(MLP)网络的复杂度而实现了异常快速的训练。然而,在密集网格中存储特征需要极大的内存空间,这导致计算机系统出现内存瓶颈,进而延长训练时间。为解决这一问题,本文提出MixNeRF——一种内存高效的NeRF框架,该框架采用混合哈希表来提升内存效率、缩短训练时间,同时保持重建质量。我们首先设计了一种**混合哈希表**,将多层级特征网格自适应性混合为一个,并将其映射至单一哈希表。随后,为获取网格点的正确索引,我们进一步设计了一种**索引变换**方法,可将任意层级网格的索引转换为规范网格的索引。与当前最先进的Instant-NGP、TensoRF和DVGO进行的大量基准实验表明,我们的MixNeRF在相同GPU硬件上可实现最快的训练速度,同时达到相似甚至更高的重建质量。源代码已发布于\url{https://github.com/nfyfamr/MixNeRF}。