Learning Value of Information towards Joint Communication and Control in 6G V2X

• URL: http://arxiv.org/abs/2505.06978v2
• Date: Thu, 26 Jun 2025 15:01:20 GMT
• Title: Learning Value of Information towards Joint Communication and Control in 6G V2X
• Authors: Lei Lei, Kan Zheng, Xuemin, Shen,
• Abstract summary: We propose a systematic VoI modeling framework grounded in the MDP, Reinforcement Learning (RL) and Optimal Control theories.<n>We present a structured approach to leverage the various VoI metrics for optimizing the When", What", and How" to communicate problems.
• Score: 12.846064594551873
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As Cellular Vehicle-to-Everything (C-V2X) evolves towards future sixth-generation (6G) networks, Connected Autonomous Vehicles (CAVs) are emerging to become a key application. Leveraging data-driven Machine Learning (ML), especially Deep Reinforcement Learning (DRL), is expected to significantly enhance CAV decision-making in both vehicle control and V2X communication under uncertainty. These two decision-making processes are closely intertwined, with the value of information (VoI) acting as a crucial bridge between them. In this paper, we introduce Sequential Stochastic Decision Process (SSDP) models to define and assess VoI, demonstrating their application in optimizing communication systems for CAVs. Specifically, we formally define the SSDP model and demonstrate that the MDP model is a special case of it. The SSDP model offers a key advantage by explicitly representing the set of information that can enhance decision-making when available. Furthermore, as current research on VoI remains fragmented, we propose a systematic VoI modeling framework grounded in the MDP, Reinforcement Learning (RL) and Optimal Control theories. We define different categories of VoI and discuss their corresponding estimation methods. Finally, we present a structured approach to leverage the various VoI metrics for optimizing the ``When", ``What", and ``How" to communicate problems. For this purpose, SSDP models are formulated with VoI-associated reward functions derived from VoI-based optimization objectives. While we use a simple vehicle-following control problem to illustrate the proposed methodology, it holds significant potential to facilitate the joint optimization of stochastic, sequential control and communication decisions in a wide range of networked control systems.

Related papers

• VoI-Driven Joint Optimization of Control and Communication in Vehicular Digital Twin Network [18.562734500767075]
  The vision of sixth-generation (6G) wireless networks paves the way for the seamless integration of digital twins into vehicular networks, giving rise to a Vehicular Digital Twin Network (VDTN)<n>We first propose the architecture of VDTN, emphasizing key modules that center on functions related to the joint optimization of control and communication.<n>We introduce a novel joint optimization framework, which involves iterative processing of two Deep Reinforcement Learning (DRL) modules corresponding to control and communication to derive the optimal policy.
  arXiv  Detail & Related papers  (2025-05-12T00:53:37Z)
• Explainable AI for UAV Mobility Management: A Deep Q-Network Approach for Handover Minimization [4.7430397428031785]
  This paper introduces an explainable AI (XAI) framework to provide deeper insights into how various state parameters influence handover decisions.<n>By quantifying the impact of key features such as reference signal received power (RSRP), our approach enhances the interpretability and reliability of RL-based handover solutions.
  arXiv  Detail & Related papers  (2025-04-25T14:11:51Z)
• Opportunistic Collaborative Planning with Large Vision Model Guided Control and Joint Query-Service Optimization [74.92515821144484]
  Navigating autonomous vehicles in open scenarios is a challenge due to the difficulties in handling unseen objects.<n>Existing solutions either rely on small models that struggle with generalization or large models that are resource-intensive.<n>This paper proposes opportunistic collaborative planning (OCP), which seamlessly integrates efficient local models with powerful cloud models.
  arXiv  Detail & Related papers  (2025-04-25T04:07:21Z)
• Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning [28.375064269304975]
  This paper presents a semantic-aware multi-modal resource allocation (SAMRA) for multi-task using multi-agent reinforcement learning (MARL) The proposed approach leverages the semantic information to optimize the allocation of communication resources. It achieves significant gains in quality of experience (QoE) and communication efficiency in C-V2X platooning scenarios.
  arXiv  Detail & Related papers  (2024-11-07T12:55:35Z)
• Enhancing Multi-Step Reasoning Abilities of Language Models through Direct Q-Function Optimization [49.362750475706235]
  Reinforcement Learning (RL) plays a crucial role in aligning large language models with human preferences and improving their ability to perform complex tasks.<n>We introduce Direct Q-function Optimization (DQO), which formulates the response generation process as a Markov Decision Process (MDP) and utilizes the soft actor-critic (SAC) framework to optimize a Q-function directly parameterized by the language model.<n> Experimental results on two math problem-solving datasets, GSM8K and MATH, demonstrate that DQO outperforms previous methods, establishing it as a promising offline reinforcement learning approach for aligning language models.
  arXiv  Detail & Related papers  (2024-10-11T23:29:20Z)
• Making Large Language Models Better Planners with Reasoning-Decision Alignment [70.5381163219608]
  We motivate an end-to-end decision-making model based on multimodality-augmented LLM. We propose a reasoning-decision alignment constraint between the paired CoTs and planning results. We dub our proposed large language planners with reasoning-decision alignment as RDA-Driver.
  arXiv  Detail & Related papers  (2024-08-25T16:43:47Z)
• Generalized Multi-Objective Reinforcement Learning with Envelope Updates in URLLC-enabled Vehicular Networks [12.323383132739195]
  We develop a novel multi-objective reinforcement learning framework to jointly optimize wireless network selection and autonomous driving policies.<n>The proposed framework is designed to maximize the traffic flow and minimize collisions by controlling the vehicle's motion dynamics.<n>The proposed policies enable autonomous vehicles to adopt safe driving behaviors with improved connectivity.
  arXiv  Detail & Related papers  (2024-05-18T16:31:32Z)
• Enhancing Information Maximization with Distance-Aware Contrastive Learning for Source-Free Cross-Domain Few-Shot Learning [55.715623885418815]
  Cross-Domain Few-Shot Learning methods require access to source domain data to train a model in the pre-training phase. Due to increasing concerns about data privacy and the desire to reduce data transmission and training costs, it is necessary to develop a CDFSL solution without accessing source data. This paper proposes an Enhanced Information Maximization with Distance-Aware Contrastive Learning method to address these challenges.
  arXiv  Detail & Related papers  (2024-03-04T12:10:24Z)
• Deep Reinforcement Learning Aided Platoon Control Relying on V2X Information [78.18186960475974]
  The impact of Vehicle-to-Everything (V2X) communications on platoon control performance is investigated. Our objective is to find the specific set of information that should be shared among the vehicles for the construction of the most appropriate state space. More meritorious information is given higher priority in transmission, since including it in the state space has a higher probability in offsetting the negative effect of having higher state dimensions.
  arXiv  Detail & Related papers  (2022-03-28T02:11:54Z)
• AI-aided Traffic Control Scheme for M2M Communications in the Internet of Vehicles [61.21359293642559]
  The dynamics of traffic and the heterogeneous requirements of different IoV applications are not considered in most existing studies. We consider a hybrid traffic control scheme and use proximal policy optimization (PPO) method to tackle it.
  arXiv  Detail & Related papers  (2022-03-05T10:54:05Z)
• Evaluating model-based planning and planner amortization for continuous control [79.49319308600228]
  We take a hybrid approach, combining model predictive control (MPC) with a learned model and model-free policy learning. We find that well-tuned model-free agents are strong baselines even for high DoF control problems. We show that it is possible to distil a model-based planner into a policy that amortizes the planning without any loss of performance.
  arXiv  Detail & Related papers  (2021-10-07T12:00:40Z)
• Model-based Reinforcement Learning: A Survey [2.564530030795554]
  Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is a important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This paper presents a survey of the integration of both fields, better known as model-based reinforcement learning.
  arXiv  Detail & Related papers  (2020-06-30T12:10:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.