Communication-Efficient Personalized Federated Learning: A Comprehensive Investigation of Strategies and Challenges
DOI:
https://doi.org/10.54097/jw4jz719Keywords:
Personalized Federated Learning (PFL), Communication Efficiency, System Heterogeneity, Statistical Heterogeneity.Abstract
Personalized Federated Learning (PFL) has emerged as a key paradigm to address statistical heterogeneity in distributed machine learning, tailoring models to individual client data. However, personalization strategies often exacerbate the communication bottleneck, a critical challenge compounded by system heterogeneity across edge devices. This survey provides a comprehensive and structured overview of communication optimization techniques within PFL. This paper proposes a novel taxonomy that categorizes the state-of-the-art into three pillars: (1) architectural methods, such as parameter-efficient learning and structured pruning, that minimize the size of model updates; (2) adaptive process methods, including personalized compression and resource-aware client selection, that optimize the communication protocol; (3) topological frameworks, like clustered and decentralized learning, that restructure collaborative pathways. For each category, this paper analyzes the intricate trade-offs between personalization effectiveness, communication cost, and system complexity. Furthermore, this paper highlights critical challenges related to fairness, robustness, and security that arise from these optimization techniques. Finally, this paper identifies open challenges and chart future research directions, advocating for hybrid, automated frameworks that co-design for efficiency, equity, and security to advance the deployment of robust PFL systems in the real world.
Downloads
References
[1] Li T, Sahu AK, Talwalkar A, Smith V. Federated learning: Challenges, methods, and future directions. IEEE Signal Process Mag 2020; 37 (3): 50–60.
[2] McMahan B, Moore E, Ramage D, Hampson S, y Arcas BA. Communication-efficient learning of deep networks from decentralized data. In: Proc. Int. Conf. Artificial Intelligence and Statistics. PMLR; 2017.
[3] Kulkarni V, Kulkarni M, Pant A. Survey of personalization techniques for federated learning. In: Proc. 2020 4th World Conf. Smart Trends in Systems, Security and Sustainability (WorldS4). IEEE; 2020.
[4] Tan AZ, Yu H, Zhang L, Yang Q. Towards personalized federated learning. IEEE Trans Neural Netw Learn Syst 2022; 34 (12): 9587–9603.
[5] Yang Q, Liu Y, Chen T, Tong Y. Federated machine learning: Concept and applications. ACM Trans Intell Syst Technol 2019; 10 (2): 1–19.
[6] Ma X, Wang L, Zhang Z, Li J, Zhang Y. Layer-wised model aggregation for personalized federated learning. In: Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 2022.
[7] Wang Z, Chen X, Zhu H, Zhang R, Zhang J. Federated low-rank adaptation for large language model fine-tuning over wireless networks. In: Proc. IEEE Global Commun. Conf. (GLOBECOM). IEEE; 2024.
[8] Wang T, Chen J, Sun J, Li Y. Personalized federated learning via heterogeneous modular networks. In: Proc. IEEE Int. Conf. Data Mining (ICDM). IEEE; 2022.
[9] Hönig R, Zhao Y, Mullins R. DAdaQuant: Doubly-adaptive quantization for communication-efficient federated learning. In: Proc. Int. Conf. Machine Learning (ICML). PMLR; 2022.
[10] Xiang T, Xu X, Chen W, Li Y. Federated learning with dynamic epoch adjustment and collaborative training in mobile edge computing. IEEE Trans Mobile Comput 2023; 23 (5): 4092–4106.
[11] Fu L, Zhang Z, Li H, Liu X. Client selection in federated learning: Principles, challenges, and opportunities. IEEE Internet Things J 2023; 10 (24): 21811–21819.
[12] Yan Y, Tong X, Wang S. Clustered federated learning in heterogeneous environment. IEEE Trans Neural Netw Learn Syst 2023; 35 (9): 12796–12809.
[13] Pang X, Li X, Liu H, Zhang T. When federated learning meets knowledge distillation. IEEE Wireless Commun 2024; 31 (5): 208–214.
[14] Yuan L, Zhang P, Wang D, Xu C. Decentralized federated learning: A survey and perspective. IEEE Internet Things J 2024; 11 (21): 34617–34638.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Academic Journal of Science and Technology

This work is licensed under a Creative Commons Attribution 4.0 International License.








