When Autonomous Vehicle Meets V2X Cooperative Perception: How Far Are We?

• URL: http://arxiv.org/abs/2509.24927v1
• Date: Mon, 29 Sep 2025 15:28:27 GMT
• Title: When Autonomous Vehicle Meets V2X Cooperative Perception: How Far Are We?
• Authors: An Guo, Shuoxiao Zhang, Enyi Tang, Xinyu Gao, Haomin Pang, Haoxiang Tian, Yanzhou Mu, Wu Wen, Chunrong Fang, Zhenyu Chen,
• Abstract summary: Vehicle-to-Everything (V2X) cooperative perception has the potential to address limitations in sensing distant objects.<n>In this study, we evaluate the impact of cooperative perception on the ego vehicle's perception performance.<n>Our results reveal potential risks and vulnerabilities in critical components of cooperative perception systems.
• Score: 22.371763887363034
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the tremendous advancement of deep learning and communication technology, Vehicle-to-Everything (V2X) cooperative perception has the potential to address limitations in sensing distant objects and occlusion for a single-agent perception system. V2X cooperative perception systems are software systems characterized by diverse sensor types and cooperative agents, varying fusion schemes, and operation under different communication conditions. Therefore, their complex composition gives rise to numerous operational challenges. Furthermore, when cooperative perception systems produce erroneous predictions, the types of errors and their underlying causes remain insufficiently explored. To bridge this gap, we take an initial step by conducting an empirical study of V2X cooperative perception. To systematically evaluate the impact of cooperative perception on the ego vehicle's perception performance, we identify and analyze six prevalent error patterns in cooperative perception systems. We further conduct a systematic evaluation of the critical components of these systems through our large-scale study and identify the following key findings: (1) The LiDAR-based cooperation configuration exhibits the highest perception performance; (2) Vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication exhibit distinct cooperative perception performance under different fusion schemes; (3) Increased cooperative perception errors may result in a higher frequency of driving violations; (4) Cooperative perception systems are not robust against communication interference when running online. Our results reveal potential risks and vulnerabilities in critical components of cooperative perception systems. We hope that our findings can better promote the design and repair of cooperative perception systems.

Related papers

• Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspective [2.7251914328668314]
  Collaborative Perception (CP) has emerged as a promising solution to mitigate these issues.<n>This study follows the PRISMA 2020 guidelines and includes 106 peer-reviewed articles.
  arXiv  Detail & Related papers  (2025-04-06T21:56:04Z)
• CooTest: An Automated Testing Approach for V2X Communication Systems [15.570594621752834]
  We design and implement CooTest, the first automated testing tool of the V2X-oriented cooperative perception module. CooTest can effectively detect erroneous behaviors under various V2X-oriented driving conditions.
  arXiv  Detail & Related papers  (2024-08-29T12:01:21Z)
• CMP: Cooperative Motion Prediction with Multi-Agent Communication [21.60646440715162]
  This paper explores the feasibility and effectiveness of cooperative motion prediction.<n>Our method, CMP, takes LiDAR signals as model input to enhance tracking and prediction capabilities.<n>In particular, CMP reduces the average prediction error by 12.3% compared with the strongest baseline.
  arXiv  Detail & Related papers  (2024-03-26T17:53:27Z)
• Vehicle-to-Everything Cooperative Perception for Autonomous Driving [46.292402824957975]
  Vehicle-to-everything cooperative perception plays a crucial role in extending the perception range and increasing detection accuracy.<n>Key techniques for enabling reliable perception sharing, such as agent selection, data alignment, and feature fusion, are examined in detail.<n>The paper concludes by outlining promising research directions to support future advancements in vehicle-to-everything cooperative perception.
  arXiv  Detail & Related papers  (2023-10-05T13:19:48Z)
• Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection [57.13665112065285]
  Human-Object Interaction (HOI) detection is a challenging computer vision task. We present a framework that enhances HOI detection by incorporating structured text knowledge.
  arXiv  Detail & Related papers  (2023-07-25T14:20:52Z)
• Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving [49.42873226593071]
  We propose V2X communication INterruption-aware COoperative Perception (V2X-INCOP) for V2X communication-aided autonomous driving. We use historical cooperation information to recover missing information due to the interruptions and alleviate the impact of the interruption issue. Experiments on three public cooperative perception datasets demonstrate that the proposed method is effective in alleviating the impacts of communication interruption on cooperative perception.
  arXiv  Detail & Related papers  (2023-04-24T04:59:13Z)
• HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformer [4.957079586254435]
  HM-ViT is the first unified multi-agent hetero-modal cooperative perception framework. It can collaboratively predict 3D objects for highly dynamic vehicle-to-vehicle (V2V) collaborations with varying numbers and types of agents.
  arXiv  Detail & Related papers  (2023-04-20T20:09:59Z)
• V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer [58.71845618090022]
  We build a holistic attention model, namely V2X-ViT, to fuse information across on-road agents. V2X-ViT consists of alternating layers of heterogeneous multi-agent self-attention and multi-scale window self-attention. To validate our approach, we create a large-scale V2X perception dataset.
  arXiv  Detail & Related papers  (2022-03-20T20:18:25Z)
• Learning to Communicate and Correct Pose Errors [75.03747122616605]
  We study the setting proposed in V2VNet, where nearby self-driving vehicles jointly perform object detection and motion forecasting in a cooperative manner. We propose a novel neural reasoning framework that learns to communicate, to estimate potential errors, and to reach a consensus about those errors.
  arXiv  Detail & Related papers  (2020-11-10T18:19:40Z)
• End-to-End Models for the Analysis of System 1 and System 2 Interactions based on Eye-Tracking Data [99.00520068425759]
  We propose a computational method, within a modified visual version of the well-known Stroop test, for the identification of different tasks and potential conflicts events. A statistical analysis shows that the selected variables can characterize the variation of attentive load within different scenarios. We show that Machine Learning techniques allow to distinguish between different tasks with a good classification accuracy.
  arXiv  Detail & Related papers  (2020-02-03T17:46:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.