We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis. Each Gaussian is augmented with spectral radiance, represented via per-band spherical harmonics, and optimized under a dual-loss supervision scheme combining RGB and multispectral signals. To improve rendering fidelity, we perform spectral-to-RGB conversion at the pixel level, allowing richer spectral cues to be retained during optimization. Our method is evaluated on both public and self-captured real-world datasets, demonstrating consistent improvements over the RGB-only 3DGS baseline in terms of image quality and spectral consistency. Notably, it excels in challenging scenes involving translucent materials and anisotropic reflections. The proposed approach maintains the compactness and real-time efficiency of 3DGS while laying the foundation for future integration with physically based shading models.
翻译:我们提出三维高斯泼溅(3DGS)的多光谱扩展方法,用于波长感知的新视角合成。每个高斯体素通过逐波段球谐函数表示的光谱辐射度进行增强,并在结合RGB与多光谱信号的双损失监督框架下优化。为提升渲染保真度,我们在像素级执行光谱到RGB的转换,使更丰富的光谱信息在优化过程中得以保留。该方法在公开数据集和自采真实世界数据集上均取得验证,在图像质量和光谱一致性方面相较纯RGB的3DGS基线呈现持续改进。特别地,该方法在半透明材料和各向异性反射等挑战性场景中表现优异。所提方案在保持3DGS紧凑性与实时效率的同时,为未来与基于物理的着色模型融合奠定基础。