Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients), where each client stores data locally and only shares model updates with a central server. This makes FL a suitable learning paradigm for remote sensing (RS) image classification tasks, where data centralization may be restricted due to legal and privacy constraints. However, a key challenge in applying FL to RS tasks is the communication overhead caused by the frequent exchange of large model updates between clients and the central server. To address this issue, in this paper we propose a novel strategy (denoted as FedX) that uses explanation-guided pruning to reduce communication overhead by minimizing the size of the transmitted models without compromising performance. FedX leverages backpropagation-based explanation methods to estimate the task-specific importance of model components and prunes the least relevant ones at the central server. The resulting sparse global model is then sent to clients, substantially reducing communication overhead. We evaluate FedX on multi-label scene classification using the BigEarthNet-S2 dataset and single-label scene classification using the EuroSAT dataset. Experimental results show the success of FedX in significantly reducing the number of shared model parameters while enhancing the generalization capability of the global model, compared to both unpruned model and state-of-the-art pruning methods. The code of FedX will be available at https://git.tu-berlin.de/rsim/FedX.
翻译:联邦学习(FL)使得深度神经网络能够在去中心化的数据档案(即客户端)上进行协同训练,其中每个客户端在本地存储数据,仅与中央服务器共享模型更新。这使得FL成为遥感(RS)图像分类任务的一种合适的学习范式,因为在遥感任务中,由于法律和隐私限制,数据集中化可能受到制约。然而,将FL应用于RS任务的一个关键挑战是客户端与中央服务器之间频繁交换大型模型更新所带来的通信开销。为解决此问题,本文提出了一种新颖的策略(记为FedX),该策略利用解释引导的剪枝来减少通信开销,其方法是在不影响性能的前提下最小化传输模型的规模。FedX利用基于反向传播的解释方法来估计模型组件在特定任务中的重要性,并在中央服务器剪枝最不相关的组件。随后,将得到的稀疏全局模型发送给客户端,从而显著降低通信开销。我们在使用BigEarthNet-S2数据集的多标签场景分类任务以及使用EuroSAT数据集的单标签场景分类任务上评估了FedX。实验结果表明,与未剪枝的模型以及最先进的剪枝方法相比,FedX成功地显著减少了共享模型参数的数量,同时增强了全局模型的泛化能力。FedX的代码将在 https://git.tu-berlin.de/rsim/FedX 提供。