VectorMapNet: End-to-end Vectorized HD Map Learning
- URL: http://arxiv.org/abs/2206.08920v6
- Date: Mon, 26 Jun 2023 05:40:58 GMT
- Title: VectorMapNet: End-to-end Vectorized HD Map Learning
- Authors: Yicheng Liu, Tianyuan Yuan, Yue Wang, Yilun Wang, Hang Zhao
- Abstract summary: We introduce an end-to-end vectorized HD map learning pipeline, termed VectorMapNet.
This pipeline can explicitly model the spatial relation between map elements and generate vectorized maps friendly to downstream autonomous driving tasks.
Experiments show that VectorMapNet achieve strong map learning performance on both nuScenes and Argo2 dataset.
- Score: 18.451587680552464
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Autonomous driving systems require High-Definition (HD) semantic maps to
navigate around urban roads. Existing solutions approach the semantic mapping
problem by offline manual annotation, which suffers from serious scalability
issues. Recent learning-based methods produce dense rasterized segmentation
predictions to construct maps. However, these predictions do not include
instance information of individual map elements and require heuristic
post-processing to obtain vectorized maps. To tackle these challenges, we
introduce an end-to-end vectorized HD map learning pipeline, termed
VectorMapNet. VectorMapNet takes onboard sensor observations and predicts a
sparse set of polylines in the bird's-eye view. This pipeline can explicitly
model the spatial relation between map elements and generate vectorized maps
that are friendly to downstream autonomous driving tasks. Extensive experiments
show that VectorMapNet achieve strong map learning performance on both nuScenes
and Argoverse2 dataset, surpassing previous state-of-the-art methods by 14.2
mAP and 14.6mAP. Qualitatively, VectorMapNet is capable of generating
comprehensive maps and capturing fine-grained details of road geometry. To the
best of our knowledge, VectorMapNet is the first work designed towards
end-to-end vectorized map learning from onboard observations. Our project
website is available at
\url{https://tsinghua-mars-lab.github.io/vectormapnet/}.
Related papers
- Enhancing Vectorized Map Perception with Historical Rasterized Maps [37.48510990922406]
We propose HRMapNet, leveraging a low-cost Historical Rasterized Map to enhance online vectorized map perception.
The historicalized map can be easily constructed from past predicted vectorized results and provides valuable complementary information.
HRMapNet can be integrated with most online vectorized map perception methods.
arXiv Detail & Related papers (2024-09-01T05:22:33Z) - ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD
Map Construction [42.874195888422584]
We propose a novel end-to-end pipeline for online long-range vectorized high-definition (HD) map construction using on-board camera sensors.
We exploit the properties of map elements to improve the performance of map construction.
arXiv Detail & Related papers (2023-10-20T09:46:24Z) - Online Map Vectorization for Autonomous Driving: A Rasterization
Perspective [58.71769343511168]
We introduce a newization-based evaluation metric, which has superior sensitivity and is better suited to real-world autonomous driving scenarios.
We also propose MapVR (Map Vectorization via Rasterization), a novel framework that applies differentiableization to preciseized outputs and then performs geometry-aware supervision on HD maps.
arXiv Detail & Related papers (2023-06-18T08:51:14Z) - InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learning [6.062751776009753]
We propose online HD map learning framework that detects HD map elements from onboard sensor observations.
InstaGraM, instance-level graph modeling of HD map brings accurate and fast end-to-end vectorized HD map learning.
Our proposed network outperforms previous models by up to 13.7 mAP with up to 33.8X faster time.
arXiv Detail & Related papers (2023-01-10T08:15:35Z) - Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language
Navigation [87.52136927091712]
We address a practical yet challenging problem of training robot agents to navigate in an environment following a path described by some language instructions.
To achieve accurate and efficient navigation, it is critical to build a map that accurately represents both spatial location and the semantic information of the environment objects.
We propose a multi-granularity map, which contains both object fine-grained details (e.g., color, texture) and semantic classes, to represent objects more comprehensively.
arXiv Detail & Related papers (2022-10-14T04:23:27Z) - HDMapNet: An Online HD Map Construction and Evaluation Framework [23.19001503634617]
HD map construction is a crucial problem for autonomous driving.
Traditional HD maps are coupled with centimeter-level accurate localization which is unreliable in many scenarios.
Online map learning is a more scalable way to provide semantic and geometry priors to self-driving vehicles.
arXiv Detail & Related papers (2021-07-13T18:06:46Z) - HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps [81.86923212296863]
HD maps are maps with precise definitions of road lanes with rich semantics of the traffic rules.
There are only a small amount of real-world road topologies and geometries, which significantly limits our ability to test out the self-driving stack.
We propose HDMapGen, a hierarchical graph generation model capable of producing high-quality and diverse HD maps.
arXiv Detail & Related papers (2021-06-28T17:59:30Z) - Learning Lane Graph Representations for Motion Forecasting [92.88572392790623]
We construct a lane graph from raw map data to preserve the map structure.
We exploit a fusion network consisting of four types of interactions, actor-to-lane, lane-to-lane, lane-to-actor and actor-to-actor.
Our approach significantly outperforms the state-of-the-art on the large scale Argoverse motion forecasting benchmark.
arXiv Detail & Related papers (2020-07-27T17:59:49Z) - VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized
Representation [74.56282712099274]
This paper introduces VectorNet, a hierarchical graph neural network that exploits the spatial locality of individual road components represented by vectors.
By operating on the vectorized high definition (HD) maps and agent trajectories, we avoid lossy rendering and computationally intensive ConvNet encoding steps.
We evaluate VectorNet on our in-house behavior prediction benchmark and the recently released Argoverse forecasting dataset.
arXiv Detail & Related papers (2020-05-08T19:07:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.