Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation

• URL: http://arxiv.org/abs/2411.11002v1
• Date: Sun, 17 Nov 2024 08:38:18 GMT
• Title: Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation
• Authors: Nayeon Kim, Hongje Seong, Daehyun Ji, Sujin Jang,
• Abstract summary: MapUnveiler is a novel paradigm of clip-level vectorized HD map construction. It unveils the occluded map elements within a clip input by relating dense image representations with efficient clip tokens. MapUnveiler associates inter-clip information through clip token propagation, effectively utilizing long-term temporal map information.
• Score: 14.480713752871521
• License:
• Abstract: Predicting and constructing road geometric information (e.g., lane lines, road markers) is a crucial task for safe autonomous driving, while such static map elements can be repeatedly occluded by various dynamic objects on the road. Recent studies have shown significantly improved vectorized high-definition (HD) map construction performance, but there has been insufficient investigation of temporal information across adjacent input frames (i.e., clips), which may lead to inconsistent and suboptimal prediction results. To tackle this, we introduce a novel paradigm of clip-level vectorized HD map construction, MapUnveiler, which explicitly unveils the occluded map elements within a clip input by relating dense image representations with efficient clip tokens. Additionally, MapUnveiler associates inter-clip information through clip token propagation, effectively utilizing long-term temporal map information. MapUnveiler runs efficiently with the proposed clip-level pipeline by avoiding redundant computation with temporal stride while building a global map relationship. Our extensive experiments demonstrate that MapUnveiler achieves state-of-the-art performance on both the nuScenes and Argoverse2 benchmark datasets. We also showcase that MapUnveiler significantly outperforms state-of-the-art approaches in a challenging setting, achieving +10.7% mAP improvement in heavily occluded driving road scenes. The project page can be found at https://mapunveiler.github.io.

Related papers

• TopoSD: Topology-Enhanced Lane Segment Perception with SDMap Prior [70.84644266024571]
  We propose to train a perception model to "see" standard definition maps (SDMaps) We encode SDMap elements into neural spatial map representations and instance tokens, and then incorporate such complementary features as prior information. Based on the lane segment representation framework, the model simultaneously predicts lanes, centrelines and their topology.
  arXiv  Detail & Related papers  (2024-11-22T06:13:42Z)
• Neural Semantic Map-Learning for Autonomous Vehicles [85.8425492858912]
  We present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment. Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field. We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T10:10:03Z)
• ADMap: Anti-disturbance framework for reconstructing online vectorized HD map [9.218463154577616]
  This paper proposes the Anti-disturbance Map reconstruction framework (ADMap) To mitigate point-order jitter, the framework consists of three modules: Multi-Scale Perception Neck, Instance Interactive Attention (IIA), and Vector Direction Difference Loss (VDDL)
  arXiv  Detail & Related papers  (2024-01-24T01:37:27Z)
• ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Construction [42.874195888422584]
  We propose a novel end-to-end pipeline for online long-range vectorized high-definition (HD) map construction using on-board camera sensors. We exploit the properties of map elements to improve the performance of map construction.
  arXiv  Detail & Related papers  (2023-10-20T09:46:24Z)
• StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Construction [36.1596833523566]
  We present StreamMapNet, a novel online mapping pipeline adept at long-sequence temporal modeling of videos. StreamMapNet employs multi-point attention and temporal information which empowers the construction of large-range local HD maps with high stability.
  arXiv  Detail & Related papers  (2023-08-24T05:22:43Z)
• MapTRv2: An End-to-End Framework for Online Vectorized HD Map Construction [40.07726377230152]
  High-definition (HD) map provides abundant and precise static environmental information of the driving scene. We present textbfMap textbfTRansformer, an end-to-end framework for online vectorized HD map construction.
  arXiv  Detail & Related papers  (2023-08-10T17:56:53Z)
• Online Map Vectorization for Autonomous Driving: A Rasterization Perspective [58.71769343511168]
  We introduce a newization-based evaluation metric, which has superior sensitivity and is better suited to real-world autonomous driving scenarios. We also propose MapVR (Map Vectorization via Rasterization), a novel framework that applies differentiableization to preciseized outputs and then performs geometry-aware supervision on HD maps.
  arXiv  Detail & Related papers  (2023-06-18T08:51:14Z)
• VectorMapNet: End-to-end Vectorized HD Map Learning [18.451587680552464]
  We introduce an end-to-end vectorized HD map learning pipeline, termed VectorMapNet. This pipeline can explicitly model the spatial relation between map elements and generate vectorized maps friendly to downstream autonomous driving tasks. Experiments show that VectorMapNet achieve strong map learning performance on both nuScenes and Argo2 dataset.
  arXiv  Detail & Related papers  (2022-06-17T17:57:13Z)
• HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps [81.86923212296863]
  HD maps are maps with precise definitions of road lanes with rich semantics of the traffic rules. There are only a small amount of real-world road topologies and geometries, which significantly limits our ability to test out the self-driving stack. We propose HDMapGen, a hierarchical graph generation model capable of producing high-quality and diverse HD maps.
  arXiv  Detail & Related papers  (2021-06-28T17:59:30Z)
• Learning Lane Graph Representations for Motion Forecasting [92.88572392790623]
  We construct a lane graph from raw map data to preserve the map structure. We exploit a fusion network consisting of four types of interactions, actor-to-lane, lane-to-lane, lane-to-actor and actor-to-actor. Our approach significantly outperforms the state-of-the-art on the large scale Argoverse motion forecasting benchmark.
  arXiv  Detail & Related papers  (2020-07-27T17:59:49Z)
• VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation [74.56282712099274]
  This paper introduces VectorNet, a hierarchical graph neural network that exploits the spatial locality of individual road components represented by vectors. By operating on the vectorized high definition (HD) maps and agent trajectories, we avoid lossy rendering and computationally intensive ConvNet encoding steps. We evaluate VectorNet on our in-house behavior prediction benchmark and the recently released Argoverse forecasting dataset.
  arXiv  Detail & Related papers  (2020-05-08T19:07:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.