Communication-Efficient Personalized Federated Learning: A Comprehensive Investigation of Strategies and Challenges

Authors

  • Shuyu Kang

DOI:

https://doi.org/10.54097/jw4jz719

Keywords:

Personalized Federated Learning (PFL), Communication Efficiency, System Heterogeneity, Statistical Heterogeneity.

Abstract

Personalized Federated Learning (PFL) has emerged as a key paradigm to address statistical heterogeneity in distributed machine learning, tailoring models to individual client data. However, personalization strategies often exacerbate the communication bottleneck, a critical challenge compounded by system heterogeneity across edge devices. This survey provides a comprehensive and structured overview of communication optimization techniques within PFL. This paper proposes a novel taxonomy that categorizes the state-of-the-art into three pillars: (1) architectural methods, such as parameter-efficient learning and structured pruning, that minimize the size of model updates; (2) adaptive process methods, including personalized compression and resource-aware client selection, that optimize the communication protocol; (3) topological frameworks, like clustered and decentralized learning, that restructure collaborative pathways. For each category, this paper analyzes the intricate trade-offs between personalization effectiveness, communication cost, and system complexity. Furthermore, this paper highlights critical challenges related to fairness, robustness, and security that arise from these optimization techniques. Finally, this paper identifies open challenges and chart future research directions, advocating for hybrid, automated frameworks that co-design for efficiency, equity, and security to advance the deployment of robust PFL systems in the real world.

Downloads

Download data is not yet available.

References

[1] Li T, Sahu AK, Talwalkar A, Smith V. Federated learning: Challenges, methods, and future directions. IEEE Signal Process Mag 2020; 37 (3): 50–60.

[2] McMahan B, Moore E, Ramage D, Hampson S, y Arcas BA. Communication-efficient learning of deep networks from decentralized data. In: Proc. Int. Conf. Artificial Intelligence and Statistics. PMLR; 2017.

[3] Kulkarni V, Kulkarni M, Pant A. Survey of personalization techniques for federated learning. In: Proc. 2020 4th World Conf. Smart Trends in Systems, Security and Sustainability (WorldS4). IEEE; 2020.

[4] Tan AZ, Yu H, Zhang L, Yang Q. Towards personalized federated learning. IEEE Trans Neural Netw Learn Syst 2022; 34 (12): 9587–9603.

[5] Yang Q, Liu Y, Chen T, Tong Y. Federated machine learning: Concept and applications. ACM Trans Intell Syst Technol 2019; 10 (2): 1–19.

[6] Ma X, Wang L, Zhang Z, Li J, Zhang Y. Layer-wised model aggregation for personalized federated learning. In: Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 2022.

[7] Wang Z, Chen X, Zhu H, Zhang R, Zhang J. Federated low-rank adaptation for large language model fine-tuning over wireless networks. In: Proc. IEEE Global Commun. Conf. (GLOBECOM). IEEE; 2024.

[8] Wang T, Chen J, Sun J, Li Y. Personalized federated learning via heterogeneous modular networks. In: Proc. IEEE Int. Conf. Data Mining (ICDM). IEEE; 2022.

[9] Hönig R, Zhao Y, Mullins R. DAdaQuant: Doubly-adaptive quantization for communication-efficient federated learning. In: Proc. Int. Conf. Machine Learning (ICML). PMLR; 2022.

[10] Xiang T, Xu X, Chen W, Li Y. Federated learning with dynamic epoch adjustment and collaborative training in mobile edge computing. IEEE Trans Mobile Comput 2023; 23 (5): 4092–4106.

[11] Fu L, Zhang Z, Li H, Liu X. Client selection in federated learning: Principles, challenges, and opportunities. IEEE Internet Things J 2023; 10 (24): 21811–21819.

[12] Yan Y, Tong X, Wang S. Clustered federated learning in heterogeneous environment. IEEE Trans Neural Netw Learn Syst 2023; 35 (9): 12796–12809.

[13] Pang X, Li X, Liu H, Zhang T. When federated learning meets knowledge distillation. IEEE Wireless Commun 2024; 31 (5): 208–214.

[14] Yuan L, Zhang P, Wang D, Xu C. Decentralized federated learning: A survey and perspective. IEEE Internet Things J 2024; 11 (21): 34617–34638.

Downloads

Published

29-01-2026

Issue

Section

Articles

How to Cite

Kang, S. (2026). Communication-Efficient Personalized Federated Learning: A Comprehensive Investigation of Strategies and Challenges. Academic Journal of Science and Technology, 19(2), 452-458. https://doi.org/10.54097/jw4jz719