Producing and Leveraging Online Map Uncertainty in Trajectory Prediction

• URL: http://arxiv.org/abs/2403.16439v1
• Date: Mon, 25 Mar 2024 05:58:33 GMT
• Title: Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
• Authors: Xunjiang Gu, Guanyu Song, Igor Gilitschenski, Marco Pavone, Boris Ivanovic,
• Abstract summary: We extend state-of-the-art online map estimation methods to additionally estimate uncertainty. In doing so, we find that incorporating uncertainty yields up to 50% faster training convergence and up to 15% better prediction performance.
• Score: 30.190497345299004
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: High-definition (HD) maps have played an integral role in the development of modern autonomous vehicle (AV) stacks, albeit with high associated labeling and maintenance costs. As a result, many recent works have proposed methods for estimating HD maps online from sensor data, enabling AVs to operate outside of previously-mapped regions. However, current online map estimation approaches are developed in isolation of their downstream tasks, complicating their integration in AV stacks. In particular, they do not produce uncertainty or confidence estimates. In this work, we extend multiple state-of-the-art online map estimation methods to additionally estimate uncertainty and show how this enables more tightly integrating online mapping with trajectory forecasting. In doing so, we find that incorporating uncertainty yields up to 50% faster training convergence and up to 15% better prediction performance on the real-world nuScenes driving dataset.

Related papers

• Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding [8.857237929151795]
  MFTP is a Map-Free Trajectory Prediction method that offers several advantages. First, it eliminates the need for HD maps during inference while still benefiting from map priors during training via knowledge distillation. Second, we present a novel hierarchical encoder that effectively extracts spatial-temporal agent features and aggregates them into multiple trajectory queries.
  arXiv  Detail & Related papers  (2024-11-17T04:50:44Z)
• Accelerating Online Mapping and Behavior Prediction via Direct BEV Feature Attention [30.190497345299004]
  We propose exposing the rich internal features of online map estimation methods and show how they enable more tightly integrating online mapping with trajectory forecasting. In doing so, we find that directly accessing internal BEV features yields up to 73% faster inference speeds and up to 29% more accurate predictions on the real-world nuScenes dataset.
  arXiv  Detail & Related papers  (2024-07-09T08:59:27Z)
• Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Maps [51.24861159115138]
  Standard Definition (SD) maps are more affordable and have worldwide coverage, offering a scalable alternative. We propose a novel framework to integrate SD maps into online map prediction and propose a Transformer-based encoder, SD Map Representations from transFormers. This enhancement consistently and significantly boosts (by up to 60%) lane detection and topology prediction on current state-of-the-art online map prediction methods.
  arXiv  Detail & Related papers  (2023-11-07T15:42:22Z)
• Enhancing Mapless Trajectory Prediction through Knowledge Distillation [19.626383744807068]
  High-definition maps (HD maps) may suffer from the high cost of annotation or restrictions of law that limits their widespread use. In this paper, we tackle the problem of improving the consistency of multi-modal prediction trajectories and the real road topology. Our solution is generalizable for common trajectory prediction networks and does not bring extra computation burden.
  arXiv  Detail & Related papers  (2023-06-25T09:05:48Z)
• Online Map Vectorization for Autonomous Driving: A Rasterization Perspective [58.71769343511168]
  We introduce a newization-based evaluation metric, which has superior sensitivity and is better suited to real-world autonomous driving scenarios. We also propose MapVR (Map Vectorization via Rasterization), a novel framework that applies differentiableization to preciseized outputs and then performs geometry-aware supervision on HD maps.
  arXiv  Detail & Related papers  (2023-06-18T08:51:14Z)
• Interpretable Self-Aware Neural Networks for Robust Trajectory Prediction [50.79827516897913]
  We introduce an interpretable paradigm for trajectory prediction that distributes the uncertainty among semantic concepts. We validate our approach on real-world autonomous driving data, demonstrating superior performance over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2022-11-16T06:28:20Z)
• PreTraM: Self-Supervised Pre-training via Connecting Trajectory and Map [58.53373202647576]
  We propose PreTraM, a self-supervised pre-training scheme for trajectory forecasting. It consists of two parts: 1) Trajectory-Map Contrastive Learning, where we project trajectories and maps to a shared embedding space with cross-modal contrastive learning, and 2) Map Contrastive Learning, where we enhance map representation with contrastive learning on large quantities of HD-maps. On top of popular baselines such as AgentFormer and Trajectron++, PreTraM boosts their performance by 5.5% and 6.9% relatively in FDE-10 on the challenging nuScenes dataset.
  arXiv  Detail & Related papers  (2022-04-21T23:01:21Z)
• Robust Monocular Localization in Sparse HD Maps Leveraging Multi-Task Uncertainty Estimation [28.35592701148056]
  We present a novel monocular localization approach based on a sliding-window pose graph. We propose an efficient multi-task uncertainty-aware perception module. Our approach enables robust and accurate 6D localization in challenging urban scenarios.
  arXiv  Detail & Related papers  (2021-10-20T13:46:15Z)
• Trajectory Prediction for Autonomous Driving with Topometric Map [10.831436392239585]
  State-of-the-art autonomous driving systems rely on high definition (HD) maps for localization and navigation. We propose an end-to-end transformer networks based approach for map-less autonomous driving.
  arXiv  Detail & Related papers  (2021-05-09T08:16:16Z)
• Injecting Knowledge in Data-driven Vehicle Trajectory Predictors [82.91398970736391]
  Vehicle trajectory prediction tasks have been commonly tackled from two perspectives: knowledge-driven or data-driven. In this paper, we propose to learn a "Realistic Residual Block" (RRB) which effectively connects these two perspectives. Our proposed method outputs realistic predictions by confining the residual range and taking into account its uncertainty.
  arXiv  Detail & Related papers  (2021-03-08T16:03:09Z)
• MP3: A Unified Model to Map, Perceive, Predict and Plan [84.07678019017644]
  MP3 is an end-to-end approach to mapless driving where the input is raw sensor data and a high-level command. We show that our approach is significantly safer, more comfortable, and can follow commands better than the baselines in challenging long-term closed-loop simulations.
  arXiv  Detail & Related papers  (2021-01-18T00:09:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.