Federated Learning via Lattice Joint Source-Channel Coding

• URL: http://arxiv.org/abs/2403.01023v1
• Date: Fri, 1 Mar 2024 22:53:57 GMT
• Title: Federated Learning via Lattice Joint Source-Channel Coding
• Abstract summary: This paper introduces a universal federated learning framework that enables over-the-air computation via digital communications. Without relying on channel state information at devices, this scheme employs lattice codes to both quantize model parameters and exploit interference from the devices.
• Score: 22.315782805190036
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: This paper introduces a universal federated learning framework that enables over-the-air computation via digital communications, using a new joint source-channel coding scheme. Without relying on channel state information at devices, this scheme employs lattice codes to both quantize model parameters and exploit interference from the devices. A novel two-layer receiver structure at the server is designed to reliably decode an integer combination of the quantized model parameters as a lattice point for the purpose of aggregation. Numerical experiments validate the effectiveness of the proposed scheme. Even with the challenges posed by channel conditions and device heterogeneity, the proposed scheme markedly surpasses other over-the-air FL strategies.

Related papers

• Wireless TokenCom: RL-Based Tokenizer Agreement for Multi-User Wireless Token Communications [59.84545048095092]
  Token Communications (TokenCom) has recently emerged as an effective new paradigm, where tokens are the unified units of communications computations.<n>We investigate a multi-user downlink wireless TokenCom scenario, where the base station transmits multiple users.
  arXiv  Detail & Related papers  (2026-02-12T19:00:33Z)
• Compute-Update Federated Learning: A Lattice Coding Approach Over-the-Air [18.88978854474189]
  This paper introduces a federated learning framework that enables over-the-air computation via digital communications. We propose a novel receiver structure at the server, designed to reliably decode an integer combination of the quantized model parameters.
  arXiv  Detail & Related papers  (2024-09-10T08:52:24Z)
• Over-the-Air Federated Learning and Optimization [52.5188988624998]
  We focus on Federated learning (FL) via edge-the-air computation (AirComp) We describe the convergence of AirComp-based FedAvg (AirFedAvg) algorithms under both convex and non- convex settings. For different types of local updates that can be transmitted by edge devices (i.e., model, gradient, model difference), we reveal that transmitting in AirFedAvg may cause an aggregation error. In addition, we consider more practical signal processing schemes to improve the communication efficiency and extend the convergence analysis to different forms of model aggregation error caused by these signal processing schemes.
  arXiv  Detail & Related papers  (2023-10-16T05:49:28Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• Over-the-Air Split Machine Learning in Wireless MIMO Networks [56.27831295707334]
  In split machine learning (ML), different partitions of a neural network (NN) are executed by different computing nodes. To ease communication burden, over-the-air computation (OAC) can efficiently implement all or part of the computation at the same time of communication.
  arXiv  Detail & Related papers  (2022-10-07T15:39:11Z)
• Neural Network-based OFDM Receiver for Resource Constrained IoT Devices [44.8697473676516]
  We explore a novel, modular Machine Learning (ML)-based receiver chain design for the Internet of Things (IoT) ML blocks replace the individual processing blocks of an OFDM receiver, and we describe this swapping for the legacy channel estimation, symbol demapping, and decoding blocks with Neural Networks (NNs) Our evaluations demonstrate that the proposed modular NN-based receiver improves bit error rate of the traditional non-ML receiver by averagely 61% and 10% for the simulated and over-the-air datasets, respectively.
  arXiv  Detail & Related papers  (2022-05-12T15:32:35Z)
• Algorithms for the Communication of Samples [9.442139459221783]
  We propose two new coding schemes with practical advantages over previous approaches. First, we introduce ordered random coding (ORC) which uses a simple trick to reduce the coding cost of previous approaches. Second, we describe a hybrid coding scheme which uses dithered quantization to efficiently communicate samples from distributions with bounded support.
  arXiv  Detail & Related papers  (2021-10-25T11:04:01Z)
• Channel Estimation Based on Machine Learning Paradigm for Spatial Modulation OFDM [0.0]
  Deep neural network (DNN) is integrated with spatial modulation-orthogonal frequency division multiplexing (SM-OFDM) technique for end-to-end data detection over Rayleigh fading channel. This proposed system directly demodulates the received symbols, leaving the channel estimation done only implicitly.
  arXiv  Detail & Related papers  (2021-09-15T10:54:56Z)
• Model-Driven Deep Learning Based Channel Estimation and Feedback for Millimeter-Wave Massive Hybrid MIMO Systems [61.78590389147475]
  This paper proposes a model-driven deep learning (MDDL)-based channel estimation and feedback scheme for millimeter-wave (mmWave) systems. To reduce the uplink pilot overhead for estimating the high-dimensional channels from a limited number of radio frequency (RF) chains, we propose to jointly train the phase shift network and the channel estimator as an auto-encoder. Numerical results show that the proposed MDDL-based channel estimation and feedback scheme outperforms the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-04-22T13:34:53Z)
• Cluster-Based Cooperative Digital Over-the-Air Aggregation for Wireless Federated Edge Learning [9.179817518536545]
  We study a federated learning system at the wireless edge that uses over-the-air computation (AirComp) In such a system, users transmit their messages over a multi-access channel concurrently to achieve fast model aggregation. We propose an improved digital AirComp scheme to relax its requirements on the transmitters, where users perform phase correction and transmit with full power.
  arXiv  Detail & Related papers  (2020-08-03T16:29:52Z)
• Suppress and Balance: A Simple Gated Network for Salient Object Detection [89.88222217065858]
  We propose a simple gated network (GateNet) to solve both issues at once. With the help of multilevel gate units, the valuable context information from the encoder can be optimally transmitted to the decoder. In addition, we adopt the atrous spatial pyramid pooling based on the proposed "Fold" operation (Fold-ASPP) to accurately localize salient objects of various scales.
  arXiv  Detail & Related papers  (2020-07-16T02:00:53Z)
• Data-Driven Symbol Detection via Model-Based Machine Learning [117.58188185409904]
  We review a data-driven framework to symbol detection design which combines machine learning (ML) and model-based algorithms. In this hybrid approach, well-known channel-model-based algorithms are augmented with ML-based algorithms to remove their channel-model-dependence. Our results demonstrate that these techniques can yield near-optimal performance of model-based algorithms without knowing the exact channel input-output statistical relationship.
  arXiv  Detail & Related papers  (2020-02-14T06:58:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.