Paper Reading AI Learner

FedX: Explanation-Guided Pruning for Communication-Efficient Federated Learning in Remote Sensing

2025-08-08 12:21:58
Bar{\i}\c{s} B\"uy\"ukta\c{s}, Jonas Klotz, Beg\"um Demir

Abstract

Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients), where each client stores data locally and only shares model updates with a central server. This makes FL a suitable learning paradigm for remote sensing (RS) image classification tasks, where data centralization may be restricted due to legal and privacy constraints. However, a key challenge in applying FL to RS tasks is the communication overhead caused by the frequent exchange of large model updates between clients and the central server. To address this issue, in this paper we propose a novel strategy (denoted as FedX) that uses explanation-guided pruning to reduce communication overhead by minimizing the size of the transmitted models without compromising performance. FedX leverages backpropagation-based explanation methods to estimate the task-specific importance of model components and prunes the least relevant ones at the central server. The resulting sparse global model is then sent to clients, substantially reducing communication overhead. We evaluate FedX on multi-label scene classification using the BigEarthNet-S2 dataset and single-label scene classification using the EuroSAT dataset. Experimental results show the success of FedX in significantly reducing the number of shared model parameters while enhancing the generalization capability of the global model, compared to both unpruned model and state-of-the-art pruning methods. The code of FedX will be available at this https URL.

Abstract (translated)

联邦学习(FL)使得分布式数据存储库(即客户端)之间可以协作训练深度神经网络,每个客户端本地存储数据,并仅与中央服务器共享模型更新。这使联邦学习成为遥感(RS)图像分类任务的合适学习范式,在这些任务中,由于法律和隐私限制的原因,可能无法集中化数据。然而,将联邦学习应用于遥感任务的关键挑战是频繁交换大型模型更新所导致的通信开销。为了解决这个问题,本文提出了一种新的策略(称为FedX),该策略利用解释引导剪枝来减少通信开销,在不影响性能的前提下最小化传输模型的大小。FedX采用基于反向传播的解释方法估计任务特定的模型组件的重要性,并在中央服务器上裁剪掉最不相关的组件。由此产生的稀疏全局模型随后被发送到客户端,显著减少了通信开销。 我们在多标签场景分类(使用BigEarthNet-S2数据集)和单标签场景分类(使用EuroSAT数据集)的任务中评估了FedX。实验结果表明,与未剪枝的模型及最先进的剪枝方法相比,FedX在大幅度减少共享模型参数数量的同时增强了全局模型的泛化能力。FedX的代码将在以下链接提供:[https URL]。

URL

https://arxiv.org/abs/2508.06256

PDF

https://arxiv.org/pdf/2508.06256.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot