Deep Reinforcement Learning for Interference Management in UAV-based 3D Networks: Potentials and Challenges

• URL: http://arxiv.org/abs/2305.07069v1
• Date: Thu, 11 May 2023 18:06:46 GMT
• Title: Deep Reinforcement Learning for Interference Management in UAV-based 3D Networks: Potentials and Challenges
• Authors: Mojtaba Vaezi, Xingqin Lin, Hongliang Zhang, Walid Saad, and H. Vincent Poor
• Abstract summary: We show that interference can still be effectively mitigated even without knowing its channel information. By harnessing interference, the proposed solutions enable the continued growth of civilian UAVs.
• Score: 137.47736805685457
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modern cellular networks are multi-cell and use universal frequency reuse to maximize spectral efficiency. This results in high inter-cell interference. This problem is growing as cellular networks become three-dimensional with the adoption of unmanned aerial vehicles (UAVs). This is because the strength and number of interference links rapidly increase due to the line-of-sight channels in UAV communications. Existing interference management solutions need each transmitter to know the channel information of interfering signals, rendering them impractical due to excessive signaling overhead. In this paper, we propose leveraging deep reinforcement learning for interference management to tackle this shortcoming. In particular, we show that interference can still be effectively mitigated even without knowing its channel information. We then discuss novel approaches to scale the algorithms with linear/sublinear complexity and decentralize them using multi-agent reinforcement learning. By harnessing interference, the proposed solutions enable the continued growth of civilian UAVs.

Related papers

• TBSN: Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising [94.09442506816724]
  Blind-spot networks (BSN) have been prevalent network architectures in self-supervised image denoising (SSID) We present a transformer-based blind-spot network (TBSN) by analyzing and redesigning the transformer operators that meet the blind-spot requirement. For spatial self-attention, an elaborate mask is applied to the attention matrix to restrict its receptive field, thus mimicking the dilated convolution. For channel self-attention, we observe that it may leak the blind-spot information when the channel number is greater than spatial size in the deep layers of multi-scale architectures.
  arXiv  Detail & Related papers  (2024-04-11T15:39:10Z)
• Multi-Agent Context Learning Strategy for Interference-Aware Beam Allocation in mmWave Vehicular Communications [8.29063749138322]
  We develop a new strategy called Multi-Agent Context Learning (MACOL) to manage interference while allocating mmWave beams to serve vehicles in the network. Our approach demonstrates that by leveraging knowledge of neighbouring beam status, the machine learning agent can identify and avoid potential interfering transmissions to other ongoing transmissions.
  arXiv  Detail & Related papers  (2024-01-04T15:43:55Z)
• Spectrum Breathing: Protecting Over-the-Air Federated Learning Against Interference [101.9031141868695]
  Mobile networks can be compromised by interference from neighboring cells or jammers. We propose Spectrum Breathing, which cascades-gradient pruning and spread spectrum to suppress interference without bandwidth expansion. We show a performance tradeoff between gradient-pruning and interference-induced error as regulated by the breathing depth.
  arXiv  Detail & Related papers  (2023-05-10T07:05:43Z)
• Data-Driven Blind Synchronization and Interference Rejection for Digital Communication Signals [98.95383921866096]
  We study the potential of data-driven deep learning methods for separation of two communication signals from an observation of their mixture. We show that capturing high-resolution temporal structures (nonstationarities) leads to substantial performance gains. We propose a domain-informed neural network (NN) design that is able to improve upon both "off-the-shelf" NNs and classical detection and interference rejection methods.
  arXiv  Detail & Related papers  (2022-09-11T14:10:37Z)
• Towards an AI-Driven Universal Anti-Jamming Solution with Convolutional Interference Cancellation Network [4.450750414447688]
  Wireless links are increasingly used to deliver critical services, while intentional interference (jamming) remains a very serious threat to such services. We propose an approach that relies on advances in Machine Learning, and the promises of neural accelerators and software defined radios. We develop a two-antenna prototype system and evaluate our jamming cancellation approach in various environment settings and modulation schemes.
  arXiv  Detail & Related papers  (2022-03-18T03:30:57Z)
• Interference Suppression Using Deep Learning: Current Approaches and Open Challenges [2.179313476241343]
  In this paper, we review a wide range of techniques that have used deep learning to suppress interference. We provide comparison and guidelines for many different types of deep learning techniques in interference suppression. In addition, we highlight challenges and potential future research directions for the successful adoption of deep learning in interference suppression.
  arXiv  Detail & Related papers  (2021-12-16T16:07:42Z)
• Jamming-Resilient Path Planning for Multiple UAVs via Deep Reinforcement Learning [1.2330326247154968]
  Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks. In this paper, we aim to find collision-free paths for multiple cellular-connected UAVs. We propose an offline temporal difference (TD) learning algorithm with online signal-to-interference-plus-noise ratio mapping to solve the problem.
  arXiv  Detail & Related papers  (2021-04-09T16:52:33Z)
• Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning [56.94644428312295]
  Wireless connectivity is instrumental in enabling federated learning (FL) Channel randomnessperturbs each worker inversions model update while multiple workers updates incur significant interference on bandwidth. In A-FADMM, all workers upload their model updates to the parameter server using a single channel via analog transmissions. This not only saves communication bandwidth, but also hides each worker's exact model update trajectory from any eavesdropper.
  arXiv  Detail & Related papers  (2020-07-03T16:31:15Z)
• Decentralized Learning for Channel Allocation in IoT Networks over Unlicensed Bandwidth as a Contextual Multi-player Multi-armed Bandit Game [134.88020946767404]
  We study a decentralized channel allocation problem in an ad-hoc Internet of Things network underlaying on the spectrum licensed to a primary cellular network. Our study maps this problem into a contextual multi-player, multi-armed bandit game, and proposes a purely decentralized, three-stage policy learning algorithm through trial-and-error.
  arXiv  Detail & Related papers  (2020-03-30T10:05:35Z)
• Reinforcement Learning for Mitigating Intermittent Interference in Terahertz Communication Networks [4.999585439793266]
  Uncoordinated transmissions by a large number of users can cause substantial interference in terahertz networks. New framework based on reinforcement learning is proposed that uses an adaptive multi-thresholding strategy.
  arXiv  Detail & Related papers  (2020-03-10T16:28:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.