Prior Based Online Lane Graph Extraction from Single Onboard Camera
Image
- URL: http://arxiv.org/abs/2307.13344v1
- Date: Tue, 25 Jul 2023 08:58:26 GMT
- Title: Prior Based Online Lane Graph Extraction from Single Onboard Camera
Image
- Authors: Yigit Baran Can, Alexander Liniger, Danda Pani Paudel, Luc Van Gool
- Abstract summary: We tackle online estimation of the lane graph from a single onboard camera image.
The prior is extracted from the dataset through a transformer based Wasserstein Autoencoder.
The autoencoder is then used to enhance the initial lane graph estimates.
- Score: 133.68032636906133
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The local road network information is essential for autonomous navigation.
This information is commonly obtained from offline HD-Maps in terms of lane
graphs. However, the local road network at a given moment can be drastically
different than the one given in the offline maps; due to construction works,
accidents etc. Moreover, the autonomous vehicle might be at a location not
covered in the offline HD-Map. Thus, online estimation of the lane graph is
crucial for widespread and reliable autonomous navigation. In this work, we
tackle online Bird's-Eye-View lane graph extraction from a single onboard
camera image. We propose to use prior information to increase quality of the
estimations. The prior is extracted from the dataset through a transformer
based Wasserstein Autoencoder. The autoencoder is then used to enhance the
initial lane graph estimates. This is done through optimization of the latent
space vector. The optimization encourages the lane graph estimation to be
logical by discouraging it to diverge from the prior distribution. We test the
method on two benchmark datasets, NuScenes and Argoverse. The results show that
the proposed method significantly improves the performance compared to
state-of-the-art methods.
Related papers
- Accelerating Online Mapping and Behavior Prediction via Direct BEV Feature Attention [30.190497345299004]
We propose exposing the rich internal features of online map estimation methods and show how they enable more tightly integrating online mapping with trajectory forecasting.
In doing so, we find that directly accessing internal BEV features yields up to 73% faster inference speeds and up to 29% more accurate predictions on the real-world nuScenes dataset.
arXiv Detail & Related papers (2024-07-09T08:59:27Z) - Online Lane Graph Extraction from Onboard Video [133.68032636906133]
We use the video stream from an onboard camera for online extraction of the surrounding's lane graph.
Using video, instead of a single image, as input poses both benefits and challenges in terms of combining the information from different timesteps.
A single model of this proposed simple, yet effective, method can process any number of images, including one, to produce accurate lane graphs.
arXiv Detail & Related papers (2023-04-03T12:36:39Z) - Learning and Aggregating Lane Graphs for Urban Automated Driving [26.34702432184092]
Lane graph estimation is an essential and highly challenging task in automated driving and HD map learning.
We propose a novel bottom-up approach to lane graph estimation from aerial imagery that aggregates multiple overlapping graphs into a single consistent graph.
We make our large-scale urban lane graph dataset and code publicly available at http://urbanlanegraph.cs.uni-freiburg.de.
arXiv Detail & Related papers (2023-02-13T08:23:35Z) - InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learning [6.062751776009753]
We propose online HD map learning framework that detects HD map elements from onboard sensor observations.
InstaGraM, instance-level graph modeling of HD map brings accurate and fast end-to-end vectorized HD map learning.
Our proposed network outperforms previous models by up to 13.7 mAP with up to 33.8X faster time.
arXiv Detail & Related papers (2023-01-10T08:15:35Z) - RCLane: Relay Chain Prediction for Lane Detection [76.62424079494285]
We present a new method for lane detection based on relay chain prediction.
Our strategy allows us to establish new state-of-the-art on four major benchmarks including TuSimple, CULane, CurveLanes and LLAMAS.
arXiv Detail & Related papers (2022-07-19T16:48:39Z) - Lane Graph Estimation for Scene Understanding in Urban Driving [34.82775302794312]
We propose a novel approach for lane geometry estimation from bird's-eye-view images.
We train a graph estimation model on multimodal bird's-eye-view data processed from the popular NuScenes dataset.
Our model shows promising performance for most evaluated urban scenes and can serve as a step towards automated generation of HD lane annotations for autonomous driving.
arXiv Detail & Related papers (2021-05-01T08:38:18Z) - LaneRCNN: Distributed Representations for Graph-Centric Motion
Forecasting [104.8466438967385]
LaneRCNN is a graph-centric motion forecasting model.
We learn a local lane graph representation per actor to encode its past motions and the local map topology.
We parameterize the output trajectories based on lane graphs, a more amenable prediction parameterization.
arXiv Detail & Related papers (2021-01-17T11:54:49Z) - DAGMapper: Learning to Map by Discovering Lane Topology [84.12949740822117]
We focus on drawing the lane boundaries of complex highways with many lanes that contain topology changes due to forks and merges.
We formulate the problem as inference in a directed acyclic graphical model (DAG), where the nodes of the graph encode geometric and topological properties of the local regions of the lane boundaries.
We show the effectiveness of our approach on two major North American Highways in two different states and show high precision and recall as well as 89% correct topology.
arXiv Detail & Related papers (2020-12-22T21:58:57Z) - Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset
for Intelligent Vehicles [72.04891523115535]
We propose road scene graph,a special scene-graph for intelligent vehicles.
It provides not only object proposals but also their pair-wise relationships.
By organizing them in a topological graph, these data are explainable, fully-connected, and could be easily processed by GCNs.
arXiv Detail & Related papers (2020-11-27T07:33:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.