Towards Energy Efficient Federated Learning over 5G+ Mobile Devices

• URL: http://arxiv.org/abs/2101.04866v1
• Date: Wed, 13 Jan 2021 04:13:54 GMT
• Title: Towards Energy Efficient Federated Learning over 5G+ Mobile Devices
• Authors: Dian Shi, Liang Li, Rui Chen, Pavana Prakash, Miao Pan, Yuguang Fang
• Abstract summary: federated learning (FL) over 5G+ mobile devices pushes AI functions to mobile devices and initiates a new era of on-device AI applications. Huge energy consumption is one of the most significant obstacles restricting the development of FL over battery-constrained 5G+ mobile devices. We make a trade-off between energy consumption for "working" (i.e., local computing) and that for "talking" (i.e., wireless communications) in order to boost the overall energy efficiency.
• Score: 26.970421001190896
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The continuous convergence of machine learning algorithms, 5G and beyond (5G+) wireless communications, and artificial intelligence (AI) hardware implementation hastens the birth of federated learning (FL) over 5G+ mobile devices, which pushes AI functions to mobile devices and initiates a new era of on-device AI applications. Despite the remarkable progress made in FL, huge energy consumption is one of the most significant obstacles restricting the development of FL over battery-constrained 5G+ mobile devices. To address this issue, in this paper, we investigate how to develop energy efficient FL over 5G+ mobile devices by making a trade-off between energy consumption for "working" (i.e., local computing) and that for "talking" (i.e., wireless communications) in order to boost the overall energy efficiency. Specifically, we first examine energy consumption models for graphics processing unit (GPU) computation and wireless transmissions. Then, we overview the state of the art of integrating FL procedure with energy-efficient learning techniques (e.g., gradient sparsification, weight quantization, pruning, etc.). Finally, we present several potential future research directions for FL over 5G+ mobile devices from the perspective of energy efficiency.

Related papers

• 5G Cellular -- An Energy Efficiency Perspective [0.0]
  The aim of this study is to see the technology enablers for 5G from an energy efficiency perspective. Efforts will be made to point out specific areas in 5G cellular where improvements or modifications could make 5G cellular more energy efficient.
  arXiv  Detail & Related papers  (2024-02-18T20:01:55Z)
• Federated Learning for 6G: Paradigms, Taxonomy, Recent Advances and Insights [52.024964564408]
  This paper examines the added-value of implementing Federated Learning throughout all levels of the protocol stack. It presents important FL applications, addresses hot topics, provides valuable insights and explicits guidance for future research and developments. Our concluding remarks aim to leverage the synergy between FL and future 6G, while highlighting FL's potential to revolutionize wireless industry.
  arXiv  Detail & Related papers  (2023-12-07T20:39:57Z)
• A Practical Cross-Device Federated Learning Framework over 5G Networks [47.72735882790756]
  The concept of federated learning (FL) was first proposed by Google in 2016. We propose a novel cross-device federated learning framework using anonymous communication technology and ring signature. In addition, our scheme implements a contribution-based incentive mechanism to encourage mobile users to participate in FL.
  arXiv  Detail & Related papers  (2022-04-18T02:31:06Z)
• Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs [62.91362897985057]
  An Intelligent IoT Environment (iIoTe) is comprised of heterogeneous devices that can collaboratively execute semi-autonomous IoT applications. This paper provides a state-of-the-art overview of these technologies and illustrates their functionality and performance, with special attention to the tradeoff among resources, latency, privacy and energy consumption.
  arXiv  Detail & Related papers  (2021-10-04T19:41:42Z)
• To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices [78.38046945665538]
  federated learning (FL) over massive mobile edge devices opens new horizons for numerous intelligent mobile applications. FL imposes huge communication and computation burdens on participating devices due to periodical global synchronization and continuous local training. We develop a convergence-guaranteed FL algorithm enabling flexible communication compression.
  arXiv  Detail & Related papers  (2020-12-22T02:54:18Z)
• To Talk or to Work: Energy Efficient Federated Learning over Mobile Devices via the Weight Quantization and 5G Transmission Co-Design [49.95746344960136]
  Federated learning (FL) is a new paradigm for large-scale learning tasks across mobile devices. It is not clear how to establish an effective wireless network architecture to support FL over mobile devices. We develop a wireless transmission and weight quantization co-design for energy efficient FL over heterogeneous 5G mobile devices.
  arXiv  Detail & Related papers  (2020-12-21T01:13:44Z)
• Wireless Communications for Collaborative Federated Learning [160.82696473996566]
  Internet of Things (IoT) devices may not be able to transmit their collected data to a central controller for training machine learning models. Google's seminal FL algorithm requires all devices to be directly connected with a central controller. This paper introduces a novel FL framework, called collaborative FL (CFL), which enables edge devices to implement FL with less reliance on a central controller.
  arXiv  Detail & Related papers  (2020-06-03T20:00:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.