Federated Linear Bandit Learning via Over-the-Air Computation

• URL: http://arxiv.org/abs/2308.13298v2
• Date: Mon, 28 Aug 2023 04:21:38 GMT
• Title: Federated Linear Bandit Learning via Over-the-Air Computation
• Abstract summary: We investigate federated contextual linear bandit learning within a wireless system that comprises a server and multiple devices. The primary objective is to minimize cumulative regret across all devices within a finite time horizon. We propose a customized linear bandits scheme, where each device transmits an analog signal, and the server receives a superposition of these signals distorted by channel noise.
• Score: 42.69435493503121
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In this paper, we investigate federated contextual linear bandit learning within a wireless system that comprises a server and multiple devices. Each device interacts with the environment, selects an action based on the received reward, and sends model updates to the server. The primary objective is to minimize cumulative regret across all devices within a finite time horizon. To reduce the communication overhead, devices communicate with the server via over-the-air computation (AirComp) over noisy fading channels, where the channel noise may distort the signals. In this context, we propose a customized federated linear bandits scheme, where each device transmits an analog signal, and the server receives a superposition of these signals distorted by channel noise. A rigorous mathematical analysis is conducted to determine the regret bound of the proposed scheme. Both theoretical analysis and numerical experiments demonstrate the competitive performance of our proposed scheme in terms of regret bounds in various settings.

Related papers

• Applied AI-Enhanced RF Interference Rejection [2.3977391435533373]
  deep learning approaches trained on both the signal of interest (SOI) and the signal mixture (SOI plus interference) can outperform traditional approaches.<n>We show that unintelligible transmissions become intelligible via metrics such as Perceptual Evaluation of Speech Quality (PESQ)<n>We believe these same techniques can be applied to a broader set of national security scenarios, as well as having commercial applications.
  arXiv  Detail & Related papers  (2026-04-14T18:55:12Z)
• Joint Sensing, Communication, and Computation for Vertical Federated Edge Learning in Edge Perception Network [75.78245138352698]
  In this paper, we consider an integrated sensing, communication, and computation-enabled edge perception network.<n>Multiple edge devices utilize wireless signals to sense environmental information for updating their local models, and the edge server aggregates feature embeddings via over-the-air computation for global model training.<n>First, we analyze the convergence behavior of the ISCC-enabled VFEEL in terms of the loss function degradation in the presence of wireless sensing noise and aggregation distortions during AirComp.
  arXiv  Detail & Related papers  (2025-12-03T02:20:58Z)
• Integrated Sensing, Communication, and Computation for Over-the-Air Federated Edge Learning [52.904670248426626]
  This paper studies an over-the-air federated edge learning (Air-FEEL) system with integrated sensing, communication, and computation.<n>We derive a low-complexity I SCC algorithm by alternately optimizing the batch size control and the network resource allocation.
  arXiv  Detail & Related papers  (2025-08-21T02:46:46Z)
• Machine Intelligence on Wireless Edge Networks [4.593295337659598]
  Machine intelligence on edge devices enables low-latency processing and improved privacy.<n>Current systems frequently avoid local model storage by sending queries to a server.<n>We present the opposite approach: broadcasting model weights to clients that perform inference locally.
  arXiv  Detail & Related papers  (2025-06-13T20:26:30Z)
• Collaborative Edge AI Inference over Cloud-RAN [37.3710464868215]
  A cloud radio access network (Cloud-RAN) based collaborative edge AI inference architecture is proposed. Specifically, geographically distributed devices capture real-time noise-corrupted sensory data samples and extract the noisy local feature vectors. We allow each RRH receives local feature vectors from all devices over the same resource blocks simultaneously by leveraging an over-the-air computation (AirComp) technique. These aggregated feature vectors are quantized and transmitted to a central processor for further aggregation and downstream inference tasks.
  arXiv  Detail & Related papers  (2024-04-09T04:26:16Z)
• Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method [14.986031916712108]
  Cross-device federated learning (FL) is a growing machine learning framework whereby multiple edge devices collaborate to train a model without disclosing their raw data. We show how to harness the wireless channel in the learning algorithm itself instead of to analyze it remove its impact.
  arXiv  Detail & Related papers  (2024-01-30T21:46:09Z)
• Over-the-Air Federated Learning and Optimization [52.5188988624998]
  We focus on Federated learning (FL) via edge-the-air computation (AirComp) We describe the convergence of AirComp-based FedAvg (AirFedAvg) algorithms under both convex and non- convex settings. For different types of local updates that can be transmitted by edge devices (i.e., model, gradient, model difference), we reveal that transmitting in AirFedAvg may cause an aggregation error. In addition, we consider more practical signal processing schemes to improve the communication efficiency and extend the convergence analysis to different forms of model aggregation error caused by these signal processing schemes.
  arXiv  Detail & Related papers  (2023-10-16T05:49:28Z)
• GraSens: A Gabor Residual Anti-aliasing Sensing Framework for Action Recognition using WiFi [52.530330427538885]
  WiFi-based human action recognition (HAR) has been regarded as a promising solution in applications such as smart living and remote monitoring. We propose an end-to-end Gabor residual anti-aliasing sensing network (GraSens) to directly recognize the actions using the WiFi signals from the wireless devices in diverse scenarios.
  arXiv  Detail & Related papers  (2022-05-24T10:20:16Z)
• Towards an AI-Driven Universal Anti-Jamming Solution with Convolutional Interference Cancellation Network [4.450750414447688]
  Wireless links are increasingly used to deliver critical services, while intentional interference (jamming) remains a very serious threat to such services. We propose an approach that relies on advances in Machine Learning, and the promises of neural accelerators and software defined radios. We develop a two-antenna prototype system and evaluate our jamming cancellation approach in various environment settings and modulation schemes.
  arXiv  Detail & Related papers  (2022-03-18T03:30:57Z)
• Unit-Modulus Wireless Federated Learning Via Penalty Alternating Minimization [64.76619508293966]
  Wireless federated learning (FL) is an emerging machine learning paradigm that trains a global parametric model from distributed datasets via wireless communications. This paper proposes a wireless FL framework, which uploads local model parameters and computes global model parameters via wireless communications.
  arXiv  Detail & Related papers  (2021-08-31T08:19:54Z)
• Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approach [28.616890702473526]
  We consider a many-to-one wireless architecture for federated learning at the network edge. The local updates at edge devices should be carefully crafted and compressed to match the wireless communication resources available. We propose SGD-based bandlimited coordinate descent algorithms for such settings.
  arXiv  Detail & Related papers  (2021-02-16T06:21:08Z)
• Conditioning Trick for Training Stable GANs [70.15099665710336]
  We propose a conditioning trick, called difference departure from normality, applied on the generator network in response to instability issues during GAN training. We force the generator to get closer to the departure from normality function of real samples computed in the spectral domain of Schur decomposition.
  arXiv  Detail & Related papers  (2020-10-12T16:50:22Z)
• A Compressive Sensing Approach for Federated Learning over Massive MIMO Communication Systems [82.2513703281725]
  Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices. We present a compressive sensing approach for federated learning over massive multiple-input multiple-output communication systems.
  arXiv  Detail & Related papers  (2020-03-18T05:56:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.