Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective

• URL: http://arxiv.org/abs/2405.20431v1
• Date: Thu, 30 May 2024 19:21:33 GMT
• Title: Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective
• Authors: Khiem Le, Nhan Luong-Ha, Manh Nguyen-Duc, Danh Le-Phuoc, Cuong Do, Kok-Seng Wong,
• Abstract summary: Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning. However, the practical deployment of FL systems faces a significant bottleneck: the communication overhead. This survey investigates various strategies and advancements made in communication-efficient FL.
• Score: 1.088537320059347
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data. However, the practical deployment of FL systems faces a significant bottleneck: the communication overhead caused by frequently exchanging large model updates between numerous devices and a central server. This communication inefficiency can hinder training speed, model performance, and the overall feasibility of real-world FL applications. In this survey, we investigate various strategies and advancements made in communication-efficient FL, highlighting their impact and potential to overcome the communication challenges inherent in FL systems. Specifically, we define measures for communication efficiency, analyze sources of communication inefficiency in FL systems, and provide a taxonomy and comprehensive review of state-of-the-art communication-efficient FL methods. Additionally, we discuss promising future research directions for enhancing the communication efficiency of FL systems. By addressing the communication bottleneck, FL can be effectively applied and enable scalable and practical deployment across diverse applications that require privacy-preserving, decentralized machine learning, such as IoT, healthcare, or finance.

Related papers

• FS-Real: Towards Real-World Cross-Device Federated Learning [60.91678132132229]
  Federated Learning (FL) aims to train high-quality models in collaboration with distributed clients while not uploading their local data. There is still a considerable gap between the flourishing FL research and real-world scenarios, mainly caused by the characteristics of heterogeneous devices and its scales. We propose an efficient and scalable prototyping system for real-world cross-device FL, FS-Real.
  arXiv  Detail & Related papers  (2023-03-23T15:37:17Z)
• A Federated Learning-enabled Smart Street Light Monitoring Application: Benefits and Future Challenges [1.405197962967472]
  Federated Learning (FL) plays a pivotal role in providing privacy-preserving and communication efficient Machine Learning frameworks. We evaluate the feasibility of FL in the context of a Smart Cities Street Light Monitoring application.
  arXiv  Detail & Related papers  (2022-08-27T12:26:25Z)
• FedComm: Federated Learning as a Medium for Covert Communication [56.376997104843355]
  Federated Learning (FL) is a solution to mitigate the privacy implications related to the adoption of deep learning. This paper thoroughly investigates the communication capabilities of an FL scheme. We introduce FedComm, a novel multi-system covert-communication technique.
  arXiv  Detail & Related papers  (2022-01-21T17:05:56Z)
• Federated Learning over Wireless IoT Networks with Optimized Communication and Resources [98.18365881575805]
  Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention. It is of interest to investigate fast responding and accurate FL schemes over wireless systems. We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
  arXiv  Detail & Related papers  (2021-10-22T13:25:57Z)
• Communication-Efficient Hierarchical Federated Learning for IoT Heterogeneous Systems with Imbalanced Data [42.26599494940002]
  Federated learning (FL) is a distributed learning methodology that allows multiple nodes to cooperatively train a deep learning model. This paper studies the potential of hierarchical FL in IoT heterogeneous systems. It proposes an optimized solution for user assignment and resource allocation on multiple edge nodes.
  arXiv  Detail & Related papers  (2021-07-14T08:32:39Z)
• Convergence Analysis and System Design for Federated Learning over Wireless Networks [16.978276697446724]
  Federated learning (FL) has emerged as an important and promising learning scheme in IoT. FL training requires frequent model exchange, which is largely affected by the wireless communication network. In this paper, we analyze the convergence rate of FL training considering the joint impact of communication network and training settings.
  arXiv  Detail & Related papers  (2021-04-30T02:33:29Z)
• To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices [78.38046945665538]
  federated learning (FL) over massive mobile edge devices opens new horizons for numerous intelligent mobile applications. FL imposes huge communication and computation burdens on participating devices due to periodical global synchronization and continuous local training. We develop a convergence-guaranteed FL algorithm enabling flexible communication compression.
  arXiv  Detail & Related papers  (2020-12-22T02:54:18Z)
• Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications [55.65768284748698]
  Machine learning (ML) is a promising enabler for the fifth generation (5G) communication systems and beyond. This article aims to provide a holistic overview of relevant communication and ML principles, and thereby present communication-efficient and distributed learning frameworks with selected use cases.
  arXiv  Detail & Related papers  (2020-08-06T12:37:14Z)
• Wireless Communications for Collaborative Federated Learning [160.82696473996566]
  Internet of Things (IoT) devices may not be able to transmit their collected data to a central controller for training machine learning models. Google's seminal FL algorithm requires all devices to be directly connected with a central controller. This paper introduces a novel FL framework, called collaborative FL (CFL), which enables edge devices to implement FL with less reliance on a central controller.
  arXiv  Detail & Related papers  (2020-06-03T20:00:02Z)
• Evaluating the Communication Efficiency in Federated Learning Algorithms [3.713348568329249]
  Recently, in light of new privacy legislations in many countries, the concept of Federated Learning (FL) has been introduced. In FL, mobile users are empowered to learn a global model by aggregating their local models, without sharing the privacy-sensitive data. This raises the challenge of communication cost when implementing FL at large scale.
  arXiv  Detail & Related papers  (2020-04-06T15:31:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.