We present a novel approach for interactive light editing in indoor scenes from a single multi-view scene capture. Our method leverages a generative image-based light decomposition model that factorizes complex indoor scene illumination into its constituent light sources. This factorization enables independent manipulation of individual light sources, specifically allowing control over their state (on/off), chromaticity, and intensity. We further introduce multi-view lighting harmonization to ensure consistent propagation of the lighting decomposition across all scene views. This is integrated into a relightable 3D Gaussian splatting representation, providing real-time interactive control over the individual light sources. Our results demonstrate highly photorealistic lighting decomposition and relighting outcomes across diverse indoor scenes. We evaluate our method on both synthetic and real-world datasets and provide a quantitative and qualitative comparison to state-of-the-art techniques. For video results and interactive demos, see https://luxremix.github.io.
翻译:我们提出了一种基于单次多视角场景采集实现室内场景交互式光照编辑的新方法。该方法利用一种基于生成式图像的分解模型,将复杂的室内场景光照分解为其构成光源。这种分解使得能够独立操控各个光源,特别是控制其状态(开/关)、色度和强度。我们进一步引入了多视角光照协调技术,以确保光照分解在所有场景视角中保持一致传播。该技术被集成到一个可重光照的3D高斯泼溅表示中,从而实现对各个光源的实时交互控制。我们的实验结果表明,该方法在多种室内场景中均能实现高度逼真的光照分解与重光照效果。我们在合成数据集和真实世界数据集上评估了该方法,并与最先进的技术进行了定量和定性比较。视频结果和交互式演示请访问 https://luxremix.github.io。