Most novel view synthesis methods such as NeRF are unable to capture the true high dynamic range (HDR) radiance of scenes since they are typically trained on photos captured with standard low dynamic range (LDR) cameras. While the traditional exposure bracketing approach which captures several images at different exposures has recently been adapted to the multi-view case, we find such methods to fall short of capturing the full dynamic range of indoor scenes, which includes very bright light sources. In this paper, we present PanDORA: a PANoramic Dual-Observer Radiance Acquisition system for the casual capture of indoor scenes in high dynamic range. Our proposed system comprises two 360{\deg} cameras rigidly attached to a portable tripod. The cameras simultaneously acquire two 360{\deg} videos: one at a regular exposure and the other at a very fast exposure, allowing a user to simply wave the apparatus casually around the scene in a matter of minutes. The resulting images are fed to a NeRF-based algorithm that reconstructs the scene's full high dynamic range. Compared to HDR baselines from previous work, our approach reconstructs the full HDR radiance of indoor scenes without sacrificing the visual quality while retaining the ease of capture from recent NeRF-like approaches.
翻译:大多数新颖视角合成方法(如NeRF)无法捕捉场景真实的高动态范围(HDR)辐射度,因为它们通常基于标准低动态范围(LDR)相机拍摄的照片进行训练。虽然传统通过拍摄多张不同曝光度图像的包围曝光方法近期已被适配到多视角场景中,但我们发现此类方法仍难以完整捕捉室内场景(包含极亮光源)的全部动态范围。本文提出PanDORA:一种全景双观测者辐射度采集系统,用于便捷获取室内场景的高动态范围数据。该系统由刚性连接在便携三脚架上的两个360°相机组成,可同步采集两段360°视频:一段采用常规曝光,另一段采用极短曝光,用户仅需手持设备在场景中随意挥动数分钟即可完成采集。所得图像输入基于NeRF的算法,可重建场景的完整高动态范围辐射度。与现有HDR基线方法相比,本方法在保持近期类NeRF方法采集便捷性的同时,既能完整重建室内场景的HDR辐射度,又不会牺牲视觉质量。