Multi-view 3D reconstruction methods remain highly sensitive to photometric inconsistencies arising from camera optical characteristics and variations in image signal processing (ISP). Existing mitigation strategies such as per-frame latent variables or affine color corrections lack physical grounding and generalize poorly to novel views. We propose the Physically-Plausible ISP (PPISP) correction module, which disentangles camera-intrinsic and capture-dependent effects through physically based and interpretable transformations. A dedicated PPISP controller, trained on the input views, predicts ISP parameters for novel viewpoints, analogous to auto exposure and auto white balance in real cameras. This design enables realistic and fair evaluation on novel views without access to ground-truth images. PPISP achieves SoTA performance on standard benchmarks, while providing intuitive control and supporting the integration of metadata when available. The source code is available at: https://github.com/nv-tlabs/ppisp
翻译:多视角三维重建方法对由相机光学特性及图像信号处理(ISP)差异引起的光度不一致性仍高度敏感。现有的缓解策略(如逐帧潜在变量或仿射颜色校正)缺乏物理依据,且对新视角的泛化能力较差。我们提出了物理合理的ISP(PPISP)校正模块,该模块通过基于物理且可解释的变换,解耦了相机固有特性与拍摄相关的效应。一个在输入视图上训练的专用PPISP控制器,可预测新视点的ISP参数,类似于真实相机中的自动曝光和自动白平衡功能。这一设计使得无需真实图像即可对新视角进行真实且公平的评估。PPISP在标准基准测试中实现了最先进的性能,同时提供了直观的控制,并在有元数据可用时支持其集成。源代码位于:https://github.com/nv-tlabs/ppisp