Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation
- URL: http://arxiv.org/abs/2605.21309v1
- Date: Wed, 20 May 2026 15:36:46 GMT
- Title: Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation
- Abstract summary: This paper introduces Hyper-V2X, a hypernetwork-based framework for estimating both aleatoric uncertainties in V2X-based perception.<n>Our approach is architectureagnostic, and can be seamlessly integrating with modern cooperative backbones such as CoBEVT.
- Score: 0.5926203312586108
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Cooperative perception enabled by Vehicle-to-Everything (V2X) communication enhances autonomous driving safety by creating a unified environmental representation through shared sensory data. While recent works have advanced multi-agent fusion for improved perception, uncertainty quantification in such cooperative frameworks remains largely unexplored. This paper introduces Hyper-V2X, a hypernetwork-based framework for estimating both epistemic and aleatoric uncertainties in V2X-based perception. Specifically, we propose a partial weight generation scheme and V2X context embedding module that conditions a Bayesian hypernetwork on fused multi-agent features to generate weight distributions for stochastic Bird's-Eye-View (BEV) segmentation. Unlike existing deterministic BEV models, Hyper-V2X enables efficient uncertainty estimation with little computation overhead. Our approach is architecture-agnostic, and can be seamlessly integrating with modern cooperative backbones such as CoBEVT. Experiments on the OPV2V benchmark demonstrate that Hyper-V2X provides accurate, well-calibrated uncertainty estimates and improves overall perception reliability. Our code and benchmark are publicly available under an open-source license: https://github.com/abhishekjagtap1/Hyper-V2X
Related papers
- VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation [50.18051979020699]
VIPS is a benchmark for cooperative autonomous driving in V2I settings based on pseudo-simulation.<n>CoS-V2X is a cooperative planning framework based on sparse representations.
arXiv Detail & Related papers (2026-09-02T11:32:52Z) - OmniV2X: A Generative Foundation Planner for Efficient End-to-End Cooperative Driving [14.897356806344696]
We present OmniV2X, a generative foundation model for vehicle-to-everything (V2X) cooperative driving.<n>The model directly interprets independent context sequences comprising multi-modal and multi-agent observations.
arXiv Detail & Related papers (2026-06-19T07:00:14Z) - End-to-End 3D Spatiotemporal Perception with Multimodal Fusion and V2X Collaboration [7.235781104512231]
X-2V2X is a multi-modal fused end-to-end framework for v2x collaboration.<n>It unifies multi-view multimodal sensing within shared representation.<n>X-V2X achieves robust and temporally stable perception in complex traffic scenarios.
arXiv Detail & Related papers (2025-12-26T02:20:22Z) - QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception [47.35478308553379]
We introduce textbfQuantV2X, the first fully quantized multi-agent system for efficient deployment of cooperative perception.<n>Despite operating under low-bit constraints, QuantV2X achieves accuracy comparable to full-precision systems.<n>Results highlight the viability of a fully quantized multi-agent intermediate fusion system for real-world deployment.
arXiv Detail & Related papers (2025-09-03T20:39:03Z) - Generate Realistic Test Scenes for V2X Communication Systems [16.608937542327418]
We design and implement V2XGen, an automated testing tool for V2X cooperative perception systems.<n>V2XGen utilizes a high-fidelity approach to generate realistic cooperative object instances and strategically place them within the background data.<n>We conduct experiments on V2XGen using multiple cooperative perception systems with different fusion schemes to assess its performance on various tasks.
arXiv Detail & Related papers (2025-06-09T04:35:53Z) - Mixed Signals: A Diverse Point Cloud Dataset for Heterogeneous LiDAR V2X Collaboration [57.3519952529079]
Vehicle-to-everything (V2X) collaborative perception has emerged as a promising solution to address the limitations of single-vehicle perception systems.<n>To address these gaps, we present Mixed Signals, a comprehensive V2X dataset featuring 45.1k point clouds and 240.6k bounding boxes.<n>Our dataset provides point clouds and bounding box annotations across 10 classes, ensuring reliable data for perception training.
arXiv Detail & Related papers (2025-02-19T23:53:00Z) - CooPre: Cooperative Pretraining for V2X Cooperative Perception [47.00472259100765]
CooPre is a self-supervised learning framwork for V2X cooperative perception.<n>We develop a V2X bird-eye-view (BEV) guided masking strategy which effectively allows the model to pay attention to 3D features across heterogeneous V2X agents.<n>CooPre achieves a 4% mAP improvement on V2X-Real dataset and surpasses baseline performance using only 50% of the training data.
arXiv Detail & Related papers (2024-08-20T23:39:26Z) - Hybrid-Generative Diffusion Models for Attack-Oriented Twin Migration in Vehicular Metaverses [58.264499654343226]
Vehicle Twins (VTs) are digital twins that provide immersive virtual services for Vehicular Metaverse Users (VMUs)
High mobility of vehicles, uneven deployment of edge servers, and potential security threats pose challenges to achieving efficient and reliable VT migrations.
We propose a secure and reliable VT migration framework in vehicular metaverses.
arXiv Detail & Related papers (2024-07-05T11:11:33Z) - FSD V2: Improving Fully Sparse 3D Object Detection with Virtual Voxels [57.05834683261658]
We present FSDv2, an evolution that aims to simplify the previous FSDv1 while eliminating the inductive bias introduced by its handcrafted instance-level representation.
We develop a suite of components to complement the virtual voxel concept, including a virtual voxel encoder, a virtual voxel mixer, and a virtual voxel assignment strategy.
arXiv Detail & Related papers (2023-08-07T17:59:48Z) - V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision
Transformer [58.71845618090022]
We build a holistic attention model, namely V2X-ViT, to fuse information across on-road agents.
V2X-ViT consists of alternating layers of heterogeneous multi-agent self-attention and multi-scale window self-attention.
To validate our approach, we create a large-scale V2X perception dataset.
arXiv Detail & Related papers (2022-03-20T20:18:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.