Huge challenges exist for old landslide detection because their morphology features have been partially or strongly transformed over a long time and have little difference from their surrounding. Besides, small-sample problem also restrict in-depth learning. In this paper, an iterative classification and semantic segmentation network (ICSSN) is developed, which can greatly enhance both object-level and pixel-level classification performance by iteratively upgrading the feature extractor shared by two network. An object-level contrastive learning (OCL) strategy is employed in the object classification sub-network featuring a siamese network to realize the global features extraction, and a sub-object-level contrastive learning (SOCL) paradigm is designed in the semantic segmentation sub-network to efficiently extract salient features from boundaries of landslides. Moreover, an iterative training strategy is elaborated to fuse features in semantic space such that both object-level and pixel-level classification performance are improved. The proposed ICSSN is evaluated on the real landslide data set, and the experimental results show that ICSSN can greatly improve the classification and segmentation accuracy of old landslide detection. For the semantic segmentation task, compared to the baseline, the F1 score increases from 0.5054 to 0.5448, the mIoU improves from 0.6405 to 0.6610, the landslide IoU improved from 0.3381 to 0.3743, and the object-level detection accuracy of old landslides is enhanced from 0.55 to 0.9. For the object classification task, the F1 score increases from 0.8846 to 0.9230, and the accuracy score is up from 0.8375 to 0.8875.
翻译:老滑坡探测面临巨大挑战,因其形态特征历经长期作用已部分或强烈变化,与周边环境差异甚微。此外,小样本问题亦制约深度学习。本文提出一种迭代式分类与语义分割网络(ICSSN),通过迭代升级两网络共享的特征提取器,显著提升对象级与像素级分类性能。在对象分类子网络中,采用对象级对比学习(OCL)策略构建孪生网络,以实现全局特征提取;同时,在语义分割子网络中设计子对象级对比学习(SOCL)范式,以高效提取滑坡边界显著特征。此外,本文还提出一种迭代训练策略,通过融合语义空间特征,同步提升对象级与像素级分类性能。基于真实滑坡数据集的实验结果表明,ICSSN能显著提升老滑坡探测的分类与分割精度。在语义分割任务中,相比基线模型,F1分数从0.5054提升至0.5448,mIoU从0.6405提升至0.6610,滑坡IoU从0.3381提升至0.3743,老滑坡对象级检测准确率从0.55提升至0.9。在对象分类任务中,F1分数从0.8846提升至0.9230,准确率从0.8375提升至0.8875。