Deep Reinforcement Learning Algorithms for Hybrid V2X Communication: A Benchmarking Study

• URL: http://arxiv.org/abs/2310.03767v1
• Date: Wed, 4 Oct 2023 12:32:14 GMT
• Title: Deep Reinforcement Learning Algorithms for Hybrid V2X Communication: A Benchmarking Study
• Authors: Fouzi Boukhalfa, Reda Alami, Mastane Achab, Eric Moulines, Mehdi Bennis
• Abstract summary: This paper addresses the vertical handover problem in V2X using Deep Reinforcement Learning (DRL) algorithms. The benchmarked algorithms outperform the current state-of-the-art approaches in terms of redundancy and usage rate of V-VLC headlights.
• Score: 39.214784277182304
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In today's era, autonomous vehicles demand a safety level on par with aircraft. Taking a cue from the aerospace industry, which relies on redundancy to achieve high reliability, the automotive sector can also leverage this concept by building redundancy in V2X (Vehicle-to-Everything) technologies. Given the current lack of reliable V2X technologies, this idea is particularly promising. By deploying multiple RATs (Radio Access Technologies) in parallel, the ongoing debate over the standard technology for future vehicles can be put to rest. However, coordinating multiple communication technologies is a complex task due to dynamic, time-varying channels and varying traffic conditions. This paper addresses the vertical handover problem in V2X using Deep Reinforcement Learning (DRL) algorithms. The goal is to assist vehicles in selecting the most appropriate V2X technology (DSRC/V-VLC) in a serpentine environment. The results show that the benchmarked algorithms outperform the current state-of-the-art approaches in terms of redundancy and usage rate of V-VLC headlights. This result is a significant reduction in communication costs while maintaining a high level of reliability. These results provide strong evidence for integrating advanced DRL decision mechanisms into the architecture as a promising approach to solving the vertical handover problem in V2X.

Related papers

• Diffusion-based Auction Mechanism for Efficient Resource Management in 6G-enabled Vehicular Metaverses [57.010829427434516]
  In 6G-enable Vehicular Metaverses, vehicles are represented by Vehicle Twins (VTs), which serve as digital replicas of physical vehicles. VT tasks are resource-intensive and need to be offloaded to ground Base Stations (BSs) for fast processing. We propose a learning-based Modified Second-Bid (MSB) auction mechanism to optimize resource allocation between ground BSs and UAVs.
  arXiv  Detail & Related papers  (2024-11-01T04:34:54Z)
• Joint Optimization of Age of Information and Energy Consumption in NR-V2X System based on Deep Reinforcement Learning [13.62746306281161]
  Vehicle-to-Everything (V2X) specifications based on 5G New Radio (NR) technology. Mode 2 Side-Link (SL) communication resembles Mode 4 in LTE-V2X, allowing direct communication between vehicles. interference cancellation method is employed to mitigate this impact.
  arXiv  Detail & Related papers  (2024-07-11T12:54:38Z)
• Resource Allocation for Twin Maintenance and Computing Task Processing in Digital Twin Vehicular Edge Computing Network [48.15151800771779]
  Vehicle edge computing (VEC) can provide computing caching services by deploying VEC servers near vehicles. However, VEC networks still face challenges such as high vehicle mobility. This study examines two types of delays caused by twin processing within the network.
  arXiv  Detail & Related papers  (2024-07-10T12:08:39Z)
• Graph Neural Networks and Deep Reinforcement Learning Based Resource Allocation for V2X Communications [43.443526528832145]
  This paper proposes a method that integrates Graph Neural Networks (GNN) with Deep Reinforcement Learning (DRL) to address this challenge. By constructing a dynamic graph with communication links as nodes, the model aims to ensure a high success rate for V2V communication. The proposed method retains the global feature learning capabilities of GNN and supports distributed network deployment.
  arXiv  Detail & Related papers  (2024-07-09T03:14:11Z)
• Hybrid-Generative Diffusion Models for Attack-Oriented Twin Migration in Vehicular Metaverses [58.264499654343226]
  Vehicle Twins (VTs) are digital twins that provide immersive virtual services for Vehicular Metaverse Users (VMUs) High mobility of vehicles, uneven deployment of edge servers, and potential security threats pose challenges to achieving efficient and reliable VT migrations. We propose a secure and reliable VT migration framework in vehicular metaverses.
  arXiv  Detail & Related papers  (2024-07-05T11:11:33Z)
• Novel Actor-Critic Algorithm for Robust Decision Making of CAV under Delays and Loss of V2X Data [3.9160947065896803]
  This paper proposes a novel 'Blind Actor-Critic' algorithm that guarantees robust driving performance in V2X environment with delayed and/or lost data. We evaluate the performance of our algorithm in a simulation environment and compare it to benchmark approaches.
  arXiv  Detail & Related papers  (2024-05-08T14:14:03Z)
• DRL-Based RAT Selection in a Hybrid Vehicular Communication Network [2.345902601618188]
  Cooperative intelligent transport systems rely on a set of Vehicle-to-Everything (V2X) applications to enhance road safety. New V2X applications depend on a significant amount of shared data and require high reliability, low end-to-end (E2E) latency, and high throughput. We propose an intelligent, scalable hybrid vehicular communication architecture that leverages the performance of multiple Radio Access Technologies (RATs) to meet the needs of these applications.
  arXiv  Detail & Related papers  (2024-04-03T08:13:07Z)
• Connected and Automated Vehicles Investment and Smart Infrastructure in Tennessee Part 3: Infrastructure and Vehicular communications: From Dedicated Short-Range Communications to Cellular Vehicle-to-Everything [0.6552063740259303]
  This report explores the transition from Dedicated Short-Range communication (DSRC) V2X to Cellular Vehicle to Everything (C-V2X) The implication is that DSRC V2X deployments (and future deployments) should migrate to C-V2X. Complicating the migration to C-V2X is TDOT's role in traffic signal operations and maintenance. C-V2X technologies are not widely tested-interference by unlicensed devices and channel congestion can adversely affect safety-critical applications.
  arXiv  Detail & Related papers  (2023-04-06T06:28:32Z)
• V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer [58.71845618090022]
  We build a holistic attention model, namely V2X-ViT, to fuse information across on-road agents. V2X-ViT consists of alternating layers of heterogeneous multi-agent self-attention and multi-scale window self-attention. To validate our approach, we create a large-scale V2X perception dataset.
  arXiv  Detail & Related papers  (2022-03-20T20:18:25Z)
• Transferable Deep Reinforcement Learning Framework for Autonomous Vehicles with Joint Radar-Data Communications [69.24726496448713]
  We propose an intelligent optimization framework based on the Markov Decision Process (MDP) to help the AV make optimal decisions. We then develop an effective learning algorithm leveraging recent advances of deep reinforcement learning techniques to find the optimal policy for the AV. We show that the proposed transferable deep reinforcement learning framework reduces the obstacle miss detection probability by the AV up to 67% compared to other conventional deep reinforcement learning approaches.
  arXiv  Detail & Related papers  (2021-05-28T08:45:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.