Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunities

• URL: http://arxiv.org/abs/2401.01544v1
• Date: Wed, 3 Jan 2024 05:33:14 GMT
• Title: Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunities
• Authors: Senkang Hu, Zhengru Fang, Yiqin Deng, Xianhao Chen, Yuguang Fang
• Abstract summary: Collaborative perception with connected and autonomous vehicles (CAVs) shows a promising solution to overcoming these limitations. In this article, we first identify the challenges of collaborative perception, such as data sharing asynchrony, data volume, and pose errors. We propose a scheme to deal with communication efficiency and latency problems, which is a channel-aware collaborative perception framework.
• Score: 10.749959052350594
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Autonomous driving has attracted significant attention from both academia and industries, which is expected to offer a safer and more efficient driving system. However, current autonomous driving systems are mostly based on a single vehicle, which has significant limitations which still poses threats to driving safety. Collaborative perception with connected and autonomous vehicles (CAVs) shows a promising solution to overcoming these limitations. In this article, we first identify the challenges of collaborative perception, such as data sharing asynchrony, data volume, and pose errors. Then, we discuss the possible solutions to address these challenges with various technologies, where the research opportunities are also elaborated. Furthermore, we propose a scheme to deal with communication efficiency and latency problems, which is a channel-aware collaborative perception framework to dynamically adjust the communication graph and minimize latency, thereby improving perception performance while increasing communication efficiency. Finally, we conduct experiments to demonstrate the effectiveness of our proposed scheme.

Related papers

• Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework [79.088116316919]
  Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. This paper proposes CoDrivingLLM, an interactive and learnable LLM-driven cooperative driving framework.
  arXiv  Detail & Related papers  (2024-09-19T14:36:00Z)
• The RoboDrive Challenge: Drive Anytime Anywhere in Any Condition [136.32656319458158]
  The 2024 RoboDrive Challenge was crafted to propel the development of driving perception technologies. This year's challenge consisted of five distinct tracks and attracted 140 registered teams from 93 institutes across 11 countries. The competition culminated in 15 top-performing solutions.
  arXiv  Detail & Related papers  (2024-05-14T17:59:57Z)
• Adaptive Communications in Collaborative Perception with Domain Alignment for Autonomous Driving [21.11621380546942]
  We propose ACC-DA, a channel-aware collaborative perception framework. We first design a transmission delay minimization method, which can construct the communication graph. We then propose an adaptive data reconstruction mechanism, which can dynamically adjust the rate-distortion trade-off to enhance perception efficiency.
  arXiv  Detail & Related papers  (2023-09-15T03:53:35Z)
• Convergence of Communications, Control, and Machine Learning for Secure and Autonomous Vehicle Navigation [78.60496411542549]
  Connected and autonomous vehicles (CAVs) can reduce human errors in traffic accidents, increase road efficiency, and execute various tasks. Reaping these benefits requires CAVs to autonomously navigate to target destinations. This article proposes solutions using the convergence of communication theory, control theory, and machine learning to enable effective and secure CAV navigation.
  arXiv  Detail & Related papers  (2023-07-05T21:38:36Z)
• Selective Communication for Cooperative Perception in End-to-End Autonomous Driving [8.680676599607123]
  We propose a novel selective communication algorithm for cooperative perception. Our algorithm is shown to produce higher success rates than a random selection approach on previously studied safety-critical driving scenario simulations.
  arXiv  Detail & Related papers  (2023-05-26T18:13:17Z)
• Collaborative Perception for Autonomous Driving: Current Status and Future Trend [33.6716877086539]
  Collaborative perception has been proposed which enables vehicles to share information to perceive the environments beyond line-of-sight and field-of-view. This paper introduces the fundamental concepts, generalizing the collaboration modes and summarizing the key ingredients and applications of collaborative perception.
  arXiv  Detail & Related papers  (2022-08-22T14:51:29Z)
• Vehicle-road Cooperative Simulation and 3D Visualization System [0.0]
  Vehicle-road collaboration technology can overcome the limits and improve the traffic safety and efficiency. It requires rigorous testing and verification methods to ensure the reliability and trustworthiness of the technology.
  arXiv  Detail & Related papers  (2022-07-14T04:53:54Z)
• Learning energy-efficient driving behaviors by imitating experts [75.12960180185105]
  This paper examines the role of imitation learning in bridging the gap between control strategies and realistic limitations in communication and sensing. We show that imitation learning can succeed in deriving policies that, if adopted by 5% of vehicles, may boost the energy-efficiency of networks with varying traffic conditions by 15% using only local observations.
  arXiv  Detail & Related papers  (2022-06-28T17:08:31Z)
• COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles [54.61668577827041]
  We introduce COOPERNAUT, an end-to-end learning model that uses cross-vehicle perception for vision-based cooperative driving. Our experiments on AutoCastSim suggest that our cooperative perception driving models lead to a 40% improvement in average success rate.
  arXiv  Detail & Related papers  (2022-05-04T17:55:12Z)
• Collaborative Driving: Learning- Aided Joint Topology Formulation and Beamforming [24.54541437306899]
  We envision collaborative autonomous driving, a new framework that jointly controls driving topology and formulate vehicular networks in the mmWave/THz bands. As a swarm intelligence system, the collaborative driving scheme goes beyond existing autonomous driving patterns based on single-vehicle intelligence. We show two promising approaches for mmWave/THz-based vehicle-to-vehicle (V2V) communications.
  arXiv  Detail & Related papers  (2022-03-18T12:50:35Z)
• Learning to Communicate and Correct Pose Errors [75.03747122616605]
  We study the setting proposed in V2VNet, where nearby self-driving vehicles jointly perform object detection and motion forecasting in a cooperative manner. We propose a novel neural reasoning framework that learns to communicate, to estimate potential errors, and to reach a consensus about those errors.
  arXiv  Detail & Related papers  (2020-11-10T18:19:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.