Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges

• URL: http://arxiv.org/abs/2301.06262v4
• Date: Wed, 30 Aug 2023 08:21:13 GMT
• Title: Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges
• Authors: Yushan Han, Hui Zhang, Huifang Li, Yi Jin, Congyan Lang, Yidong Li
• Abstract summary: Collaborative perception is essential to address occlusion and sensor failure issues in autonomous driving. This work reviews recent achievements in this field to bridge this gap and motivate future research.
• Score: 19.0876933975015
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Collaborative perception is essential to address occlusion and sensor failure issues in autonomous driving. In recent years, theoretical and experimental investigations of novel works for collaborative perception have increased tremendously. So far, however, few reviews have focused on systematical collaboration modules and large-scale collaborative perception datasets. This work reviews recent achievements in this field to bridge this gap and motivate future research. We start with a brief overview of collaboration schemes. After that, we systematically summarize the collaborative perception methods for ideal scenarios and real-world issues. The former focuses on collaboration modules and efficiency, and the latter is devoted to addressing the problems in actual application. Furthermore, we present large-scale public datasets and summarize quantitative results on these benchmarks. Finally, we highlight gaps and overlook challenges between current academic research and real-world applications. The project page is https://github.com/CatOneTwo/Collaborative-Perception-in-Autonomous-Driving

Related papers

• Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions [62.0123588983514]
  Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields. We reformulate the peer-review process as a multi-turn, long-context dialogue, incorporating distinct roles for authors, reviewers, and decision makers. We construct a comprehensive dataset containing over 26,841 papers with 92,017 reviews collected from multiple sources.
  arXiv  Detail & Related papers  (2024-06-09T08:24:17Z)
• CoPeD-Advancing Multi-Robot Collaborative Perception: A Comprehensive Dataset in Real-World Environments [8.177157078744571]
  This paper presents a pioneering and comprehensive real-world multi-robot collaborative perception dataset. It features raw sensor inputs, pose estimation, and optional high-level perception annotation. We believe this work will unlock the potential research of high-level scene understanding through multi-modal collaborative perception in multi-robot settings.
  arXiv  Detail & Related papers  (2024-05-23T15:59:48Z)
• A Review of Cooperation in Multi-agent Learning [5.334450724000142]
  Cooperation in multi-agent learning (MAL) is a topic at the intersection of numerous disciplines. This paper provides an overview of the fundamental concepts, problem settings and algorithms of multi-agent learning.
  arXiv  Detail & Related papers  (2023-12-08T16:42:15Z)
• Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark [55.898771405172155]
  Federated learning has emerged as a promising paradigm for privacy-preserving collaboration among different parties. We provide a systematic overview of the important and recent developments of research on federated learning.
  arXiv  Detail & Related papers  (2023-11-12T06:32:30Z)
• Parsing Objects at a Finer Granularity: A Survey [54.72819146263311]
  Fine-grained visual parsing is important in many real-world applications, e.g., agriculture, remote sensing, and space technologies. Predominant research efforts tackle these fine-grained sub-tasks following different paradigms. We conduct an in-depth study of the advanced work from a new perspective of learning the part relationship.
  arXiv  Detail & Related papers  (2022-12-28T04:20:10Z)
• Collaborative Perception for Autonomous Driving: Current Status and Future Trend [33.6716877086539]
  Collaborative perception has been proposed which enables vehicles to share information to perceive the environments beyond line-of-sight and field-of-view. This paper introduces the fundamental concepts, generalizing the collaboration modes and summarizing the key ingredients and applications of collaborative perception.
  arXiv  Detail & Related papers  (2022-08-22T14:51:29Z)
• Using Hashtags to Analyze Purpose and Technology Application of Open-Source Project Related to COVID-19 [5.89408513477919]
  This study examines trends in projects with different functionalities and the relationship between functionalities and technologies. The study results show an imbalance in the number of projects with varying functionalities in the GitHub community. The spontaneous behavior of developers may lack organization and make it challenging to target needs.
  arXiv  Detail & Related papers  (2022-07-03T02:37:31Z)
• Benchopt: Reproducible, efficient and collaborative optimization benchmarks [67.29240500171532]
  Benchopt is a framework to automate, reproduce and publish optimization benchmarks in machine learning. Benchopt simplifies benchmarking for the community by providing an off-the-shelf tool for running, sharing and extending experiments.
  arXiv  Detail & Related papers  (2022-06-27T16:19:24Z)
• Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
  We present an in-depth analysis of existing deep learning-based methods for modelling social interactions. We propose two knowledge-based data-driven methods to effectively capture these social interactions. We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
  arXiv  Detail & Related papers  (2020-07-07T17:19:56Z)
• Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making [66.72253432908693]
  Kinship recognition is a challenging problem with many practical applications. We review the public resources and data challenges that enabled and inspired many to hone-in on the views. For the tenth anniversary, the demo code is provided for the various kin-based tasks.
  arXiv  Detail & Related papers  (2020-06-29T13:25:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.