We propose a novel inverse rendering method that enables the transformation of existing indoor panoramas with new indoor furniture layouts under natural illumination. To achieve this, we captured indoor HDR panoramas along with real-time outdoor hemispherical HDR photographs. Indoor and outdoor HDR images were linearly calibrated with measured absolute luminance values for accurate scene relighting. Our method consists of three key components: (1) panoramic furniture detection and removal, (2) automatic floor layout design, and (3) global rendering with scene geometry, new furniture objects, and a real-time outdoor photograph. We demonstrate the effectiveness of our workflow in rendering indoor scenes under different outdoor illumination conditions. Additionally, we contribute a new calibrated HDR (Cali-HDR) dataset that consists of 137 calibrated indoor panoramas and their associated outdoor photographs.
翻译:我们提出了一种新颖的逆渲染方法,能够在自然光照条件下,将现有室内全景图与新家具布局相结合进行变换。为实现此目标,我们采集了室内高动态范围(HDR)全景图以及实时的室外半球形HDR照片。室内外HDR图像通过实测绝对亮度值进行线性校准,以实现精确的场景重光照。该方法包含三个关键组成部分:(1)全景家具检测与移除,(2)自动地板布局设计,(3)基于场景几何、新家具对象及实时室外照片的全局渲染。我们通过实验验证了该方法在不同室外光照条件下渲染室内场景的有效性。此外,我们贡献了一个新的校准HDR(Cali-HDR)数据集,包含137张经校准的室内全景图及其对应的室外照片。