How the Fusion of Onboard Sensors and V2X Data can Improve (or not) the Cooperative Perception of Connected Automated Vehicles
- URL: http://arxiv.org/abs/2607.07114v1
- Date: Wed, 08 Jul 2026 07:55:53 GMT
- Title: How the Fusion of Onboard Sensors and V2X Data can Improve (or not) the Cooperative Perception of Connected Automated Vehicles
- Abstract summary: This study analyzes the impact of sensing measurement errors, V2X packet losses, and inaccuracies on the effectiveness of cooperative perception.<n>The results highlight the potential of cooperative perception to enhance perception levels and range compared to using onboard sensors alone.<n>They also identify key challenges related to the generation of ghost vehicles during the fusion process.
- Score: 0.3359875577705537
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Automated vehicles rely on onboard sensors to perceive their surroundings and navigate autonomously. However, sensor performance may degrade under adverse weather conditions or when line-of-sight is obstructed. Cooperative perception (or collective perception) is expected to mitigate these limitations by enabling Connected and Automated Vehicles (CAVs) to share sensor data and collaboratively enhance situational awareness. Several studies have analyzed the potential of cooperative perception, yet the fusion of V2X data with information from onboard sensors has received limited focus. V2X data may contain errors that affect the quality of the fused data, and hence the effectiveness of cooperative perception. This study analyzes the impact of sensing measurement errors, V2X packet losses, and GNSS inaccuracies on the effectiveness of cooperative perception. The results highlight the potential of cooperative perception to enhance perception levels and range compared to using onboard sensors alone. However, they also identify key challenges related to the generation of ghost vehicles during the fusion process, which must be addressed to prevent V2X data from introducing additional errors when fused with onboard sensor data.
Related papers
- VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation [50.18051979020699]
VIPS is a benchmark for cooperative autonomous driving in V2I settings based on pseudo-simulation.<n>CoS-V2X is a cooperative planning framework based on sparse representations.
arXiv Detail & Related papers (2026-09-02T11:32:52Z) - Robust Fusion of Object-Level V2X for Learned 3D Object Detection [2.1999185330214828]
Vehicle-to-everything (V2X) communication is becoming increasingly available, enabling vehicles to share their own state as object-level information.<n>We study how V2X information can be integrated into 3D object detection and how robust the resulting system is to realistic V2X imperfections.<n>Our results demonstrate that while object-level cooperative information can substantially improve detection performance, achieving an NDS of 0.80 under favorable conditions, models trained on idealized data become fragile and over-reliant on V2X.
arXiv Detail & Related papers (2026-05-01T12:06:07Z) - Research Challenges and Progress in the End-to-End V2X Cooperative Autonomous Driving Competition [54.341718589800855]
Vehicle-to-everything (V2X) communication has emerged as a key enabler for extending perception range and enhancing driving safety.<n>We organized the End-to-End Autonomous Driving through V2X Cooperation Challenge, which features two tracks: cooperative temporal perception and cooperative end-to-end planning.<n>This paper describes the design and outcomes of the challenge, highlights key research problems including bandwidth-aware fusion, robust multi-agent planning, and heterogeneous sensor integration.
arXiv Detail & Related papers (2025-07-29T09:06:40Z) - S2S-Net: Addressing the Domain Gap of Heterogeneous Sensor Systems in LiDAR-Based Collective Perception [0.6228127137267275]
This study is the first to address the Sensor2Sensor domain gap in vehicle-to-vehicle (V2V) collective perception.<n>First, we present our sensor-domain robust architecture S2S-Net.<n>Then, an in-depth analysis of the Sensor2Sensor domain adaptation capabilities of state-of-the-art CP methods and S2S-Net is conducted.
arXiv Detail & Related papers (2025-04-24T09:38:59Z) - CooTest: An Automated Testing Approach for V2X Communication Systems [15.570594621752834]
We design and implement CooTest, the first automated testing tool of the V2X-oriented cooperative perception module.
CooTest can effectively detect erroneous behaviors under various V2X-oriented driving conditions.
arXiv Detail & Related papers (2024-08-29T12:01:21Z) - Interruption-Aware Cooperative Perception for V2X Communication-Aided
Autonomous Driving [49.42873226593071]
We propose V2X communication INterruption-aware COoperative Perception (V2X-INCOP) for V2X communication-aided autonomous driving.
We use historical cooperation information to recover missing information due to the interruptions and alleviate the impact of the interruption issue.
Experiments on three public cooperative perception datasets demonstrate that the proposed method is effective in alleviating the impacts of communication interruption on cooperative perception.
arXiv Detail & Related papers (2023-04-24T04:59:13Z) - Toward an AI-enabled Connected Industry: AGV Communication and Sensor Measurement Datasets [33.89321466798318]
This paper presents two wireless measurement campaigns in industrial testbeds: industrial Vehicle-to-vehicle (iV2V) and industrial Vehicle-to-infrastructure plus Sensor (iV2I+)
iV2V covers sidelink communication scenarios between Automated Guided Vehicles (AGVs), while iV2I+ is conducted at an industrial setting where an autonomous cleaning robot is connected to a private cellular network.
The combination of different communication technologies within a common measurement methodology provides insights that can be exploited by Machine Learning (ML) for tasks such as fingerprinting, line-of-sight detection, prediction of quality of service or
arXiv Detail & Related papers (2022-12-20T15:04:20Z) - Edge-Aided Sensor Data Sharing in Vehicular Communication Networks [8.67588704947974]
We consider sensor data sharing and fusion in a vehicular network with both, vehicle-to-infrastructure and vehicle-to-vehicle communication.
We propose a method, named Bidirectional Feedback Noise Estimation (BiFNoE), in which an edge server collects and caches sensor measurement data from vehicles.
We show that the perception accuracy is on average improved by around 80 % with only 12 kbps uplink and 28 kbps downlink bandwidth.
arXiv Detail & Related papers (2022-06-17T16:30:56Z) - Radar Voxel Fusion for 3D Object Detection [0.0]
This paper develops a low-level sensor fusion network for 3D object detection.
The radar sensor fusion proves especially beneficial in inclement conditions such as rain and night scenes.
arXiv Detail & Related papers (2021-06-26T20:34:12Z) - Complex-valued Convolutional Neural Networks for Enhanced Radar Signal
Denoising and Interference Mitigation [73.0103413636673]
We propose the use of Complex-Valued Convolutional Neural Networks (CVCNNs) to address the issue of mutual interference between radar sensors.
CVCNNs increase data efficiency, speeds up network training and substantially improves the conservation of phase information during interference removal.
arXiv Detail & Related papers (2021-04-29T10:06:29Z) - Learning to Communicate and Correct Pose Errors [75.03747122616605]
We study the setting proposed in V2VNet, where nearby self-driving vehicles jointly perform object detection and motion forecasting in a cooperative manner.
We propose a novel neural reasoning framework that learns to communicate, to estimate potential errors, and to reach a consensus about those errors.
arXiv Detail & Related papers (2020-11-10T18:19:40Z) - Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision
Action Recognition [131.6328804788164]
We propose a framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos)
The SAKDN uses multiple wearable-sensors as teacher modalities and uses RGB videos as student modality.
arXiv Detail & Related papers (2020-09-01T03:38:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.