Deep neural networks (DNNs) have found widespread applications in interpreting remote sensing (RS) imagery. However, it has been demonstrated in previous works that DNNs are vulnerable to different types of noises, particularly adversarial noises. Surprisingly, there has been a lack of comprehensive studies on the robustness of RS tasks, prompting us to undertake a thorough survey and benchmark on the robustness of image classification and object detection in RS. To our best knowledge, this study represents the first comprehensive examination of both natural robustness and adversarial robustness in RS tasks. Specifically, we have curated and made publicly available datasets that contain natural and adversarial noises. These datasets serve as valuable resources for evaluating the robustness of DNNs-based models. To provide a comprehensive assessment of model robustness, we conducted meticulous experiments with numerous different classifiers and detectors, encompassing a wide range of mainstream methods. Through rigorous evaluation, we have uncovered insightful and intriguing findings, which shed light on the relationship between adversarial noise crafting and model training, yielding a deeper understanding of the susceptibility and limitations of various models, and providing guidance for the development of more resilient and robust models
翻译:深度神经网络(DNNs)在遥感影像解译中得到了广泛应用。然而,已有研究表明,DNNs易受不同类型噪声(特别是对抗噪声)的影响。令人惊讶的是,关于遥感任务鲁棒性的综合研究尚属匮乏,这促使我们对遥感影像分类与目标检测的鲁棒性进行了全面的调研与基准测试。据我们所知,本研究首次系统性地考察了遥感任务中的自然鲁棒性与对抗鲁棒性。具体而言,我们整理并公开了包含自然噪声与对抗噪声的数据集,这些数据集可作为评估基于DNNs模型鲁棒性的宝贵资源。为全面评估模型鲁棒性,我们针对众多不同分类器与检测器开展了精细实验,涵盖了广泛的主流方法。通过严格评估,我们获得了富有洞见且引人深思的发现,这些发现揭示了对抗噪声生成与模型训练之间的关系,加深了对各类模型脆弱性与局限性的理解,并为开发更具韧性和鲁棒性的模型提供了指导。