Pansharpening aims to generate high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) and panchromatic (PAN) observations. Most existing deep learning methods treat pansharpening as fixed-grid prediction, which limits scale adaptation. To address this, we propose GSPan, a framework that introduces 2D Gaussian Splatting (GS) into pansharpening. Instead of directly predicting pixels, GSPan represents band-wise residual details as continuous and learnable 2D Gaussian primitives. We design a Dual-Stream Hierarchical Interaction (DSHI) architecture with a Spatial-Spectral Interactive Attention (SSIA) module to estimate these primitives from complementary PAN and MS observations. The predicted primitives are rendered as a residual detail field and injected into the upsampled MS image. This continuous representation allows GSPan to render fused images on arbitrary target sampling grids without scale-specific retraining. It further enables a Scale-Decoupled Asymmetric Inference (SDAI) strategy, which estimates primitives at a reduced resolution and renders the fused image at the target resolution for efficient large-scene pansharpening. Experiments on QuickBird, GaoFen-2, WorldView-3, and WorldView-3-4K datasets show that GSPan delivers state-of-the-art fusion performance. Moreover, SDAI markedly accelerates inference, achieving a favorable trade-off between computational efficiency and fusion quality. Our results demonstrate the potential of continuous Gaussian residual representations as a flexible and scale-decoupled alternative to fixed-grid prediction.
翻译:全色锐化旨在通过融合低分辨率多光谱(LRMS)与全色(PAN)观测数据,生成高分辨率多光谱(HRMS)图像。现有深度学习方法大多将全色锐化视为固定网格预测,限制了其尺度适应能力。为此,本文提出GSPan框架,将二维高斯泼溅(2D Gaussian Splatting, GS)引入全色锐化。不同于直接预测像素,GSPan将逐波段残差细节表示为连续且可学习的二维高斯基元。我们设计了包含空间-光谱交互注意力(SSIA)模块的双流分层交互(DSHI)架构,从互补的PAN与MS观测中估计这些基元。预测的基元被渲染为残差细节场,并注入到上采样的MS图像中。这种连续表示使GSPan无需针对特定尺度重新训练,即可在任意目标采样网格上渲染融合图像。此外,该方法支持一种尺度解耦非对称推理(SDAI)策略,即先以降分辨率估计基元,再在目标分辨率下渲染融合图像,从而实现高效的大场景全色锐化。在QuickBird、GaoFen-2、WorldView-3及WorldView-3-4K数据集上的实验表明,GSPan达到了最先进的融合性能。同时,SDAI显著加速了推理过程,在计算效率与融合质量之间实现了良好的权衡。实验结果证明了连续高斯残差表示作为灵活且尺度解耦的固定网格预测替代方案的潜力。