We present Factor Fields, a novel framework for modeling and representing signals. Factor Fields decomposes a signal into a product of factors, each of which is represented by a neural or regular field representation operating on a coordinate transformed input signal. We show that this decomposition yields a unified framework that generalizes several recent signal representations including NeRF, PlenOxels, EG3D, Instant-NGP, and TensoRF. Moreover, the framework allows for the creation of powerful new signal representations, such as the Coefficient-Basis Factorization (CoBaFa) which we propose in this paper. As evidenced by our experiments, CoBaFa leads to improvements over previous fast reconstruction methods in terms of the three critical goals in neural signal representation: approximation quality, compactness and efficiency. Experimentally, we demonstrate that our representation achieves better image approximation quality on 2D image regression tasks, higher geometric quality when reconstructing 3D signed distance fields and higher compactness for radiance field reconstruction tasks compared to previous fast reconstruction methods. Besides, our CoBaFa representation enables generalization by sharing the basis across signals during training, enabling generalization tasks such as image regression with sparse observations and few-shot radiance field reconstruction. Project Page: https://apchenstu.github.io/FactorFields/

翻译：我们提出因子场（Factor Fields），一种用于建模和表示信号的新框架。因子场将信号分解为多个因子的乘积，每个因子由神经网络或常规场表示在坐标变换后的输入信号上运作。我们证明，这种分解形成了一个统一框架，能够泛化包括NeRF、PlenOxels、EG3D、Instant-NGP和TensoRF在内的多种最新信号表示方法。此外，该框架还允许创建强大的新信号表示，如本文提出的系数-基分解（CoBaFa）。实验结果表明，CoBaFa在神经信号表示的三个关键目标（近似质量、紧凑性和效率）上，相较于以往的快速重建方法均有改进。通过实验，我们证明该表示在二维图像回归任务中实现更优的图像近似质量，在三维符号距离场重建中达到更高的几何质量，并在辐射场重建任务中展现出更高的紧凑性。此外，CoBaFa表示通过训练期间跨信号共享基函数实现泛化能力，支持如稀疏观测图像回归和少样本辐射场重建等泛化任务。项目页面：https://apchenstu.github.io/FactorFields/