Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


View a PDF of the paper titled Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments, by Pengcheng Sun and 8 other authors

View PDF
HTML (experimental)

Abstract:Non-independent and identically distributed (Non- IID) data adversely affects federated learning (FL) while heterogeneity in communication quality can undermine the reliability of model parameter transmission, potentially degrading wireless FL convergence. This paper proposes a novel dual-segment clustering (DSC) strategy that jointly addresses communication and data heterogeneity in FL. This is achieved by defining a new signal-to-noise ratio (SNR) matrix and information quantity matrix to capture the communication and data heterogeneity, respectively. The celebrated affinity propagation algorithm is leveraged to iteratively refine the clustering of clients based on the newly defined matrices effectively enhancing model aggregation in heterogeneous environments. The convergence analysis and experimental results show that the DSC strategy can improve the convergence rate of wireless FL and demonstrate superior accuracy in heterogeneous environments compared to classical clustering methods.

Submission history

From: Pengcheng Sun [view email]
[v1]
Wed, 15 May 2024 11:46:47 UTC (670 KB)
[v2]
Thu, 14 Nov 2024 08:06:46 UTC (2,055 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.