In this letter, we introduce deep active learning (AL) for multi-label classification (MLC) problems in remote sensing (RS). In particular, we investigate the effectiveness of several AL query functions for MLC of RS images. Unlike the existing AL query functions (which are defined for single-label classification or semantic segmentation problems), each query function in this paper is based on the evaluation of two criteria: i) multi-label uncertainty; and ii) multi-label diversity. The multi-label uncertainty criterion is associated to the confidence of the deep neural networks (DNNs) in correctly assigning multi-labels to each image. To assess this criterion, we investigate three strategies: i) learning multi-label loss ordering; ii) measuring temporal discrepancy of multi-label predictions; and iii) measuring magnitude of approximated gradient embeddings. The multi-label diversity criterion is associated to the selection of a set of images that are as diverse as possible to each other that prevents redundancy among them. To assess this criterion, we exploit a clustering based strategy. We combine each of the above-mentioned uncertainty strategies with the clustering based diversity strategy, resulting in three different query functions. All the considered query functions are introduced for the first time in the framework of MLC problems in RS. Experimental results obtained on two benchmark archives show that these query functions result in the selection of a highly informative set of samples at each iteration of the AL process.
翻译:在本论文中,我们提出了深度主动学习方法,用于解决遥感领域中的多标签分类问题。具体而言,我们探究了多种主动学习查询函数在遥感图像多标签分类中的有效性。与现有的针对单标签分类或语义分割问题的主动学习查询函数不同,本文提出的每个查询函数均基于两个评价准则:i)多标签不确定性;ii)多标签多样性。多标签不确定性准则与深度神经网络正确为每幅图像分配多标签的置信度相关。为评估该准则,我们研究了三种策略:i)学习多标签损失排序;ii)测量多标签预测的时间差异;iii)测量近似梯度嵌入的幅度。多标签多样性准则则与选取一组尽可能互异的图像相关,以防止它们之间的冗余。为评估该准则,我们采用了基于聚类的策略。我们将上述每种不确定性策略与基于聚类的多样性策略相结合,形成了三种不同的查询函数。所有考虑的查询函数均为首次引入遥感多标签分类问题的框架中。在两个基准数据集上获得的实验结果表明,这些查询函数能够在主动学习过程的每次迭代中选择出高度信息量的样本集。