In this paper, we study the problem of efficiently and effectively embedding the high-dimensional spatio-spectral information of hyperspectral (HS) images, guided by feature diversity. Specifically, based on the theoretical formulation that feature diversity is correlated with the rank of the unfolded kernel matrix, we rectify 3D convolution by modifying its topology to enhance the rank upper-bound. This modification yields a rank-enhanced spatial-spectral symmetrical convolution set (ReS$^3$-ConvSet), which not only learns diverse and powerful feature representations but also saves network parameters. Additionally, we also propose a novel diversity-aware regularization (DA-Reg) term that directly acts on the feature maps to maximize independence among elements. To demonstrate the superiority of the proposed ReS$^3$-ConvSet and DA-Reg, we apply them to various HS image processing and analysis tasks, including denoising, spatial super-resolution, and classification. Extensive experiments show that the proposed approaches outperform state-of-the-art methods both quantitatively and qualitatively to a significant extent. The code is publicly available at https://github.com/jinnh/ReSSS-ConvSet.
翻译:本文研究如何在高光谱图像的高维空间-光谱信息嵌入中,以特征多样性为指导,实现高效且有效的特征表示。具体而言,基于特征多样性与展开核矩阵秩相关的理论公式,我们通过修改3D卷积的拓扑结构来提升其秩上界,从而得到秩增强的空间-光谱对称卷积集(ReS$^3$-ConvSet)。该卷积集不仅能学习多样且强大的特征表示,还能节省网络参数。此外,我们还提出了一种新颖的多样性感知正则化(DA-Reg)项,直接作用于特征图以最大化元素间的独立性。为验证所提ReS$^3$-ConvSet和DA-Reg的优越性,我们将其应用于高光谱图像处理的多种任务,包括去噪、空间超分辨率和分类。大量实验表明,所提方法在定量和定性上均显著优于现有最先进方法。代码已公开在https://github.com/jinnh/ReSSS-ConvSet。