Multi-Agent Context Learning Strategy for Interference-Aware Beam Allocation in mmWave Vehicular Communications

• URL: http://arxiv.org/abs/2401.02323v1
• Date: Thu, 4 Jan 2024 15:43:55 GMT
• Title: Multi-Agent Context Learning Strategy for Interference-Aware Beam Allocation in mmWave Vehicular Communications
• Authors: Abdulkadir Kose, Haeyoung Lee, Chuan Heng Foh, Mohammad Shojafar
• Abstract summary: We develop a new strategy called Multi-Agent Context Learning (MACOL) to manage interference while allocating mmWave beams to serve vehicles in the network. Our approach demonstrates that by leveraging knowledge of neighbouring beam status, the machine learning agent can identify and avoid potential interfering transmissions to other ongoing transmissions.
• Score: 8.29063749138322
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Millimeter wave (mmWave) has been recognized as one of key technologies for 5G and beyond networks due to its potential to enhance channel bandwidth and network capacity. The use of mmWave for various applications including vehicular communications has been extensively discussed. However, applying mmWave to vehicular communications faces challenges of high mobility nodes and narrow coverage along the mmWave beams. Due to high mobility in dense networks, overlapping beams can cause strong interference which leads to performance degradation. As a remedy, beam switching capability in mmWave can be utilized. Then, frequent beam switching and cell change become inevitable to manage interference, which increase computational and signalling complexity. In order to deal with the complexity in interference control, we develop a new strategy called Multi-Agent Context Learning (MACOL), which utilizes Contextual Bandit to manage interference while allocating mmWave beams to serve vehicles in the network. Our approach demonstrates that by leveraging knowledge of neighbouring beam status, the machine learning agent can identify and avoid potential interfering transmissions to other ongoing transmissions. Furthermore, we show that even under heavy traffic loads, our proposed MACOL strategy is able to maintain low interference levels at around 10%.

Related papers

• Deep Reinforcement Learning for Interference Management in UAV-based 3D Networks: Potentials and Challenges [137.47736805685457]
  We show that interference can still be effectively mitigated even without knowing its channel information. By harnessing interference, the proposed solutions enable the continued growth of civilian UAVs.
  arXiv  Detail & Related papers  (2023-05-11T18:06:46Z)
• Deep Learning and Image Super-Resolution-Guided Beam and Power Allocation for mmWave Networks [80.37827344656048]
  We develop a deep learning (DL)-guided hybrid beam and power allocation approach for millimeter-wave (mmWave) networks. We exploit the synergy of supervised learning and super-resolution technology to enable low-overhead beam- and power allocation.
  arXiv  Detail & Related papers  (2023-05-08T05:40:54Z)
• Beam Management in Ultra-dense mmWave Network via Federated Reinforcement Learning: An Intelligent and Secure Approach [19.01563068819449]
  Key challenge of ultra-dense mmWave network (UDmmWave) is beam management due to high propagation delay limited beam coverage. In this paper, a novel beam management scheme is presented which can theoretically protect user privacy while reducing handoff cost.
  arXiv  Detail & Related papers  (2022-10-04T01:47:33Z)
• Artificial Intelligence Empowered Multiple Access for Ultra Reliable and Low Latency THz Wireless Networks [76.89730672544216]
  Terahertz (THz) wireless networks are expected to catalyze the beyond fifth generation (B5G) era. To satisfy the ultra-reliability and low-latency demands of several B5G applications, novel mobility management approaches are required. This article presents a holistic MAC layer approach that enables intelligent user association and resource allocation, as well as flexible and adaptive mobility management.
  arXiv  Detail & Related papers  (2022-08-17T03:00:24Z)
• Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation [48.150466900765316]
  Split-learning (SL) has recently gained popularity due to its inherent privacy-preserving capabilities and ability to enable collaborative inference for devices with limited computational power. Standard SL algorithms assume an ideal underlying digital communication system and ignore the problem of scarce communication bandwidth. We propose a novel SL framework to solve the remote inference problem that introduces an additional layer at the agent side and constrains the choices of the weights and the biases to ensure over the air aggregation.
  arXiv  Detail & Related papers  (2021-06-02T07:49:41Z)
• Multi-hop RIS-Empowered Terahertz Communications: A DRL-based Hybrid Beamforming Design [39.21220050099642]
  Wireless communication in the TeraHertz band (0.1--10 THz) is envisioned as one of the key enabling technologies for the future sixth generation (6G) wireless communication systems. We propose a novel hybrid beamforming scheme for the multi-hop RIS-assisted communication networks to improve the coverage range at THz-band frequencies.
  arXiv  Detail & Related papers  (2021-01-22T14:56:28Z)
• Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method [43.95403787396996]
  Wireless communication in the TeraHertz band (0.1--10 THz) is envisioned as one of the key enabling technologies for the future six generation (6G) wireless communication systems. We propose a novel hybrid beamforming scheme for the multi-hop RIS-assisted communication networks to improve the coverage range at THz-band frequencies.
  arXiv  Detail & Related papers  (2020-09-20T07:51:49Z)
• Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning [56.94644428312295]
  Wireless connectivity is instrumental in enabling federated learning (FL) Channel randomnessperturbs each worker inversions model update while multiple workers updates incur significant interference on bandwidth. In A-FADMM, all workers upload their model updates to the parameter server using a single channel via analog transmissions. This not only saves communication bandwidth, but also hides each worker's exact model update trajectory from any eavesdropper.
  arXiv  Detail & Related papers  (2020-07-03T16:31:15Z)
• Reinforcement Learning for Mitigating Intermittent Interference in Terahertz Communication Networks [4.999585439793266]
  Uncoordinated transmissions by a large number of users can cause substantial interference in terahertz networks. New framework based on reinforcement learning is proposed that uses an adaptive multi-thresholding strategy.
  arXiv  Detail & Related papers  (2020-03-10T16:28:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.