Equivariant Multi-agent Reinforcement Learning for Multimodal Vehicle-to-Infrastructure Systems

• URL: http://arxiv.org/abs/2604.06914v1
• Date: Wed, 08 Apr 2026 10:13:29 GMT
• Title: Equivariant Multi-agent Reinforcement Learning for Multimodal Vehicle-to-Infrastructure Systems
• Abstract summary: We study a vehicle-to-infrastructure (V2I) system where distributed base stations (BSs) act as road-side units (RSUs)<n>We consider a decentralized rate problem, where each RSU relies on its local observations to optimize its resources.<n>We recast this problem as a distributed multi-agent reinforcement learning (MARL) problem, by incorporating symmetries in terms of vehicles' locations.
• Score: 27.423287406667885
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we study a vehicle-to-infrastructure (V2I) system where distributed base stations (BSs) acting as road-side units (RSUs) collect multimodal (wireless and visual) data from moving vehicles. We consider a decentralized rate maximization problem, where each RSU relies on its local observations to optimize its resources, while all RSUs must collaborate to guarantee favorable network performance. We recast this problem as a distributed multi-agent reinforcement learning (MARL) problem, by incorporating rotation symmetries in terms of vehicles' locations. To exploit these symmetries, we propose a novel self-supervised learning framework where each BS agent aligns the latent features of its multimodal observation to extract the positions of the vehicles in its local region. Equipped with this sensing data at each RSU, we train an equivariant policy network using a graph neural network (GNN) with message passing layers, such that each agent computes its policy locally, while all agents coordinate their policies via a signaling scheme that overcomes partial observability and guarantees the equivariance of the global policy. We present numerical results carried out in a simulation environment, where ray-tracing and computer graphics are used to collect wireless and visual data. Results show the generalizability of our self-supervised and multimodal sensing approach, achieving more than two-fold accuracy gains over baselines, and the efficiency of our equivariant MARL training, attaining more than 50% performance gains over standard approaches.

Related papers

• HEAT: Heterogeneous End-to-End Autonomous Driving via Trajectory-Guided World Models [50.18051979020699]
  End-to-end autonomous driving has emerged as a compelling alternative to traditional modular pipelines.<n>We propose a trajectory-driven learning paradigm that organizes training around planning trajectories.<n>We show that a single unified model can be trained on heterogeneous datasets while maintaining strong performance within each domain.
  arXiv  Detail & Related papers  (2026-05-19T10:12:01Z)
• Multi-Agent DRL for V2X Resource Allocation: Disentangling Challenges and Benchmarking Solutions [51.22818149833102]
  Multi-agent reinforcement learning (MARL) has emerged as a promising approach for radio resource allocation in vehicle-to-everything (C-V2X) networks.<n>However, the multifaceted challenges inherent to MARL are often intertwined, making it difficult to understand their individual impact on performance in vehicular environments.<n>We bridge this gap by formulating C-V2X RRA as a sequence of multi-agent interference games with progressively increasing complexity.
  arXiv  Detail & Related papers  (2026-02-18T14:46:56Z)
• A Measurement Report Data-Driven Framework for Localized Statistical Channel Modeling [25.91473621688449]
  Localized statistical channel modeling (LSCM) is crucial for effective performance evaluation in digital twin-assisted network optimization.<n>Existing methods rely heavily on drive test data with high collection costs and limited spatial coverage.<n>We propose a measurement report (MR) data-driven framework for LSCM, exploiting the low-cost and extensive collection of MR data.
  arXiv  Detail & Related papers  (2025-09-16T10:59:22Z)
• Generalization in Reinforcement Learning for Radio Access Networks [2.9822261313236513]
  We propose a generalization-centered RL framework for RAN control.<n>It robustly reconstructs dynamically varying states from partial and noisy observations.<n>It encodes static and semi-static information, such as radio nodes, cell attributes, and their topology, through graph representations.
  arXiv  Detail & Related papers  (2025-07-09T07:22:22Z)
• Leveraging Optimal Transport for Distributed Two-Sample Testing: An Integrated Transportation Distance-based Framework [2.65043787671605]
  This paper introduces a novel framework for distributed two-sample testing using the Integrated Transportation Distance (ITD)<n>A permutation test procedure is proposed for implementation in distributed settings, allowing for efficient computation while preserving data privacy.<n>Results indicate that ITD effectively aggregates information across distributed clients, detecting subtle distributional shifts that might be missed when examining individual clients.
  arXiv  Detail & Related papers  (2025-06-19T05:59:48Z)
• FedRAV: Hierarchically Federated Region-Learning for Traffic Object Classification of Autonomous Vehicles [7.8896851741869085]
  We propose a novel hierarchically Federated Region-learning framework of Autonomous Vehicles (FedRAV) FedRAV adaptively divides a large area containing vehicles into sub-regions based on the defined region-wise distance, and achieves personalized vehicular models and regional models. Experiment results demonstrate that our framework outperforms those known algorithms, and improves the accuracy by at least 3.69%.
  arXiv  Detail & Related papers  (2024-11-21T09:45:55Z)
• AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning [98.26836657967162]
  textbfAgentOhana aggregates agent trajectories from distinct environments, spanning a wide array of scenarios. textbfxLAM-v0.1, a large action model tailored for AI agents, demonstrates exceptional performance across various benchmarks.
  arXiv  Detail & Related papers  (2024-02-23T18:56:26Z)
• FedRSU: Federated Learning for Scene Flow Estimation on Roadside Units [50.930389484343515]
  Roadside unit (RSU) can significantly improve the safety and robustness of autonomous vehicles through Vehicle-to-Everything (V2X) communication. Currently, the usage of a single RSU mainly focuses on real-time inference and V2X collaboration. Integrating the vast amounts of data from numerous RSUs can provide a rich source of data for model training. We introduce FedRSU, an innovative federated learning framework for self-supervised scene flow estimation.
  arXiv  Detail & Related papers  (2024-01-23T15:52:57Z)
• On Addressing Heterogeneity in Federated Learning for Autonomous Vehicles Connected to a Drone Orchestrator [32.61132332561498]
  We envision a federated learning (FL) scenario in service of amending the performance of autonomous road vehicles. We focus on the issue of accelerating the learning of a particular class of critical object (CO), that may harm the nominal operation of an autonomous vehicle.
  arXiv  Detail & Related papers  (2021-08-05T16:25:48Z)
• Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning [85.6386289476598]
  We develop a novel adversarial graph representation adaptation (AGRA) framework for cross-domain holistic-local feature co-adaptation. We conduct extensive and fair evaluations on several popular benchmarks and show that the proposed AGRA framework outperforms previous state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-08-03T15:00:31Z)
• Global Distance-distributions Separation for Unsupervised Person Re-identification [93.39253443415392]
  Existing unsupervised ReID approaches often fail in correctly identifying the positive samples and negative samples through the distance-based matching/ranking. We introduce a global distance-distributions separation constraint over the two distributions to encourage the clear separation of positive and negative samples from a global view. We show that our method leads to significant improvement over the baselines and achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2020-06-01T07:05:39Z)
• Reinforcement Learning Based Vehicle-cell Association Algorithm for Highly Mobile Millimeter Wave Communication [53.47785498477648]
  This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. We first formulate the user state (VU) problem as a discrete non-vehicle association optimization problem. The proposed solution achieves up to 15% gains in terms sum of user complexity and 20% reduction in VUE compared to several baseline designs.
  arXiv  Detail & Related papers  (2020-01-22T08:51:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.