Prior Based Online Lane Graph Extraction from Single Onboard Camera Image

• URL: http://arxiv.org/abs/2307.13344v1
• Date: Tue, 25 Jul 2023 08:58:26 GMT
• Title: Prior Based Online Lane Graph Extraction from Single Onboard Camera Image
• Authors: Yigit Baran Can, Alexander Liniger, Danda Pani Paudel, Luc Van Gool
• Abstract summary: We tackle online estimation of the lane graph from a single onboard camera image. The prior is extracted from the dataset through a transformer based Wasserstein Autoencoder. The autoencoder is then used to enhance the initial lane graph estimates.
• Score: 133.68032636906133
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The local road network information is essential for autonomous navigation. This information is commonly obtained from offline HD-Maps in terms of lane graphs. However, the local road network at a given moment can be drastically different than the one given in the offline maps; due to construction works, accidents etc. Moreover, the autonomous vehicle might be at a location not covered in the offline HD-Map. Thus, online estimation of the lane graph is crucial for widespread and reliable autonomous navigation. In this work, we tackle online Bird's-Eye-View lane graph extraction from a single onboard camera image. We propose to use prior information to increase quality of the estimations. The prior is extracted from the dataset through a transformer based Wasserstein Autoencoder. The autoencoder is then used to enhance the initial lane graph estimates. This is done through optimization of the latent space vector. The optimization encourages the lane graph estimation to be logical by discouraging it to diverge from the prior distribution. We test the method on two benchmark datasets, NuScenes and Argoverse. The results show that the proposed method significantly improves the performance compared to state-of-the-art methods.

Related papers

• TopoSD: Topology-Enhanced Lane Segment Perception with SDMap Prior [70.84644266024571]
  We propose to train a perception model to "see" standard definition maps (SDMaps) We encode SDMap elements into neural spatial map representations and instance tokens, and then incorporate such complementary features as prior information. Based on the lane segment representation framework, the model simultaneously predicts lanes, centrelines and their topology.
  arXiv  Detail & Related papers  (2024-11-22T06:13:42Z)
• LMT-Net: Lane Model Transformer Network for Automated HD Mapping from Sparse Vehicle Observations [11.395749549636868]
  Lane Model Transformer Network (LMT-Net) is an encoder-decoder neural network architecture that performs polyline encoding and predicts lane pairs and their connectivity. We evaluate the performance of LMT-Net on an internal dataset that consists of multiple vehicle observations as well as human annotations as Ground Truth (GT)
  arXiv  Detail & Related papers  (2024-09-19T02:14:35Z)
• Online Lane Graph Extraction from Onboard Video [133.68032636906133]
  We use the video stream from an onboard camera for online extraction of the surrounding's lane graph. Using video, instead of a single image, as input poses both benefits and challenges in terms of combining the information from different timesteps. A single model of this proposed simple, yet effective, method can process any number of images, including one, to produce accurate lane graphs.
  arXiv  Detail & Related papers  (2023-04-03T12:36:39Z)
• Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Construction [43.682460811194694]
  Lane graph construction is a promising but challenging task in autonomous driving. Previous methods usually model the lane graph at the pixel or piece level, and recover the lane graph by pixel-wise or piece-wise connection. We present a path-based online lane graph construction method, termed LaneGAP, which preserves the continuity of the lane and encodes traffic information for planning.
  arXiv  Detail & Related papers  (2023-03-15T17:59:13Z)
• Learning and Aggregating Lane Graphs for Urban Automated Driving [26.34702432184092]
  Lane graph estimation is an essential and highly challenging task in automated driving and HD map learning. We propose a novel bottom-up approach to lane graph estimation from aerial imagery that aggregates multiple overlapping graphs into a single consistent graph. We make our large-scale urban lane graph dataset and code publicly available at http://urbanlanegraph.cs.uni-freiburg.de.
  arXiv  Detail & Related papers  (2023-02-13T08:23:35Z)
• RCLane: Relay Chain Prediction for Lane Detection [76.62424079494285]
  We present a new method for lane detection based on relay chain prediction. Our strategy allows us to establish new state-of-the-art on four major benchmarks including TuSimple, CULane, CurveLanes and LLAMAS.
  arXiv  Detail & Related papers  (2022-07-19T16:48:39Z)
• Lane Graph Estimation for Scene Understanding in Urban Driving [34.82775302794312]
  We propose a novel approach for lane geometry estimation from bird's-eye-view images. We train a graph estimation model on multimodal bird's-eye-view data processed from the popular NuScenes dataset. Our model shows promising performance for most evaluated urban scenes and can serve as a step towards automated generation of HD lane annotations for autonomous driving.
  arXiv  Detail & Related papers  (2021-05-01T08:38:18Z)
• DAGMapper: Learning to Map by Discovering Lane Topology [84.12949740822117]
  We focus on drawing the lane boundaries of complex highways with many lanes that contain topology changes due to forks and merges. We formulate the problem as inference in a directed acyclic graphical model (DAG), where the nodes of the graph encode geometric and topological properties of the local regions of the lane boundaries. We show the effectiveness of our approach on two major North American Highways in two different states and show high precision and recall as well as 89% correct topology.
  arXiv  Detail & Related papers  (2020-12-22T21:58:57Z)
• Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset for Intelligent Vehicles [72.04891523115535]
  We propose road scene graph,a special scene-graph for intelligent vehicles. It provides not only object proposals but also their pair-wise relationships. By organizing them in a topological graph, these data are explainable, fully-connected, and could be easily processed by GCNs.
  arXiv  Detail & Related papers  (2020-11-27T07:33:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.