Blind Federated Learning via Over-the-Air q-QAM

• URL: http://arxiv.org/abs/2311.04253v2
• Date: Fri, 19 Apr 2024 16:25:49 GMT
• Title: Blind Federated Learning via Over-the-Air q-QAM
• Authors: Saeed Razavikia, José Mairton Barros Da Silva Júnior, Carlo Fischione,
• Abstract summary: We investigate edge learning over a fading multiple federated channel. We introduce a pioneering digital-the-air modulation over the federated uplink-the-air channel. We find that the number of antennas at the edge server and adopting higher-order modulations improve the accuracy up to 60%.
• Score: 11.956183457374186
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In this work, we investigate federated edge learning over a fading multiple access channel. To alleviate the communication burden between the edge devices and the access point, we introduce a pioneering digital over-the-air computation strategy employing q-ary quadrature amplitude modulation, culminating in a low latency communication scheme. Indeed, we propose a new federated edge learning framework in which edge devices use digital modulation for over-the-air uplink transmission to the edge server while they have no access to the channel state information. Furthermore, we incorporate multiple antennas at the edge server to overcome the fading inherent in wireless communication. We analyze the number of antennas required to mitigate the fading impact effectively. We prove a non-asymptotic upper bound for the mean squared error for the proposed federated learning with digital over-the-air uplink transmissions under both noisy and fading conditions. Leveraging the derived upper bound, we characterize the convergence rate of the learning process of a non-convex loss function in terms of the mean square error of gradients due to the fading channel. Furthermore, we substantiate the theoretical assurances through numerical experiments concerning mean square error and the convergence efficacy of the digital federated edge learning framework. Notably, the results demonstrate that augmenting the number of antennas at the edge server and adopting higher-order modulations improve the model accuracy up to 60\%.

Related papers

• Communication-Efficient Federated Learning over Wireless Channels via Gradient Sketching [23.523969065599193]
  We propose Federated Proximal Sketching (FPS), tailored towards band-limited wireless channels. FPS uses a count sketch data structure to address the bandwidth bottleneck and enable efficient compression. We demonstrate the stability, accuracy, and efficiency of FPS in comparison to state-of-the-art methods on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2024-10-30T20:01:08Z)
• A SER-based Device Selection Mechanism in Multi-bits Quantization Federated Learning [6.922030110539386]
  This paper analyze the influence of wireless communication on federated learning (FL) through symbol error rate (SER) In FL system, non-orthogonal multiple access (NOMA) can be used as the basic communication framework to reduce the communication congestion and interference caused by multiple users. The gradient parameters are quantized into multiple bits to retain more gradient information to the maximum extent and to improve the tolerance of transmission errors.
  arXiv  Detail & Related papers  (2024-04-20T06:27:01Z)
• Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method [14.986031916712108]
  Cross-device federated learning (FL) is a growing machine learning framework whereby multiple edge devices collaborate to train a model without disclosing their raw data. We show how to harness the wireless channel in the learning algorithm itself instead of to analyze it remove its impact.
  arXiv  Detail & Related papers  (2024-01-30T21:46:09Z)
• Over-the-Air Federated Learning and Optimization [52.5188988624998]
  We focus on Federated learning (FL) via edge-the-air computation (AirComp) We describe the convergence of AirComp-based FedAvg (AirFedAvg) algorithms under both convex and non- convex settings. For different types of local updates that can be transmitted by edge devices (i.e., model, gradient, model difference), we reveal that transmitting in AirFedAvg may cause an aggregation error. In addition, we consider more practical signal processing schemes to improve the communication efficiency and extend the convergence analysis to different forms of model aggregation error caused by these signal processing schemes.
  arXiv  Detail & Related papers  (2023-10-16T05:49:28Z)
• Edge Intelligence Over the Air: Two Faces of Interference in Federated Learning [95.31679010587473]
  Federated edge learning is envisioned as the bedrock of enabling intelligence in next-generation wireless networks. This article provides a comprehensive overview of the positive and negative effects of interference on over-the-air-based edge learning systems.
  arXiv  Detail & Related papers  (2023-06-17T09:04:48Z)
• Accelerated Gradient Descent Learning over Multiple Access Fading Channels [9.840290491547162]
  We consider a distributed learning problem in a wireless network, consisting of N distributed edge devices and a parameter server (PS) We develop a novel Accelerated Gradient-descent Multiple Access (AGMA) algorithm that uses momentum-based gradient signals over noisy fading MAC to improve the convergence rate as compared to existing methods.
  arXiv  Detail & Related papers  (2021-07-26T19:51:40Z)
• Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach [30.1988598440727]
  We develop a unified communication-learning optimization problem to jointly optimize device selection, over-the-air transceiver design, and RIS configuration. Numerical experiments show that the proposed design achieves substantial learning accuracy improvement compared with the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-11-20T08:54:13Z)
• Blind Federated Edge Learning [93.29571175702735]
  We study federated edge learning (FEEL), where wireless edge devices, each with its own dataset, learn a global model. We propose an analog over-the-air' aggregation scheme, in which the devices transmit their local updates in an uncoded fashion.
  arXiv  Detail & Related papers  (2020-10-19T16:22:28Z)
• Deep Learning Based Antenna Selection for Channel Extrapolation in FDD Massive MIMO [54.54508321463112]
  In massive multiple-input multiple-output (MIMO) systems, the large number of antennas would bring a great challenge for the acquisition of the accurate channel state information. We utilize the neural networks (NNs) to capture the inherent connection between the uplink and downlink channel data sets and extrapolate the downlink channels from a subset of the uplink channel state information. We study the antenna subset selection problem in order to achieve the best channel extrapolation and decrease the data size of NNs.
  arXiv  Detail & Related papers  (2020-09-03T13:38:52Z)
• A Compressive Sensing Approach for Federated Learning over Massive MIMO Communication Systems [82.2513703281725]
  Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices. We present a compressive sensing approach for federated learning over massive multiple-input multiple-output communication systems.
  arXiv  Detail & Related papers  (2020-03-18T05:56:27Z)
• Gradient Statistics Aware Power Control for Over-the-Air Federated Learning [59.40860710441232]
  Federated learning (FL) is a promising technique that enables many edge devices to train a machine learning model collaboratively in wireless networks. This paper studies the power control problem for over-the-air FL by taking gradient statistics into account.
  arXiv  Detail & Related papers  (2020-03-04T14:06:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.