LaneCPP: Continuous 3D Lane Detection using Physical Priors

• URL: http://arxiv.org/abs/2406.08381v1
• Date: Wed, 12 Jun 2024 16:31:06 GMT
• Title: LaneCPP: Continuous 3D Lane Detection using Physical Priors
• Authors: Maximilian Pittner, Joel Janai, Alexandru P. Condurache,
• Abstract summary: Lane CPP uses a continuous 3D lane detection model leveraging physical prior knowledge about the lane structure and road geometry. We show the benefits of our contributions and prove the meaningfulness of using priors to make 3D lane detection more robust.
• Score: 45.52331418900137
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Monocular 3D lane detection has become a fundamental problem in the context of autonomous driving, which comprises the tasks of finding the road surface and locating lane markings. One major challenge lies in a flexible but robust line representation capable of modeling complex lane structures, while still avoiding unpredictable behavior. While previous methods rely on fully data-driven approaches, we instead introduce a novel approach LaneCPP that uses a continuous 3D lane detection model leveraging physical prior knowledge about the lane structure and road geometry. While our sophisticated lane model is capable of modeling complex road structures, it also shows robust behavior since physical constraints are incorporated by means of a regularization scheme that can be analytically applied to our parametric representation. Moreover, we incorporate prior knowledge about the road geometry into the 3D feature space by modeling geometry-aware spatial features, guiding the network to learn an internal road surface representation. In our experiments, we show the benefits of our contributions and prove the meaningfulness of using priors to make 3D lane detection more robust. The results show that LaneCPP achieves state-of-the-art performance in terms of F-Score and geometric errors.

Related papers

• 3D Lane Detection from Front or Surround-View using Joint-Modeling & Matching [27.588395086563978]
  We propose a joint modeling approach that combines Bezier curves and methods. We also introduce a novel 3D Spatial, representing an exploration of 3D surround-view lane detection research. This innovative method establishes a new benchmark in front-view 3D lane detection on the Openlane dataset.
  arXiv  Detail & Related papers  (2024-01-16T01:12:24Z)
• Decoupling the Curve Modeling and Pavement Regression for Lane Detection [67.22629246312283]
  curve-based lane representation is a popular approach in many lane detection methods. We propose a new approach to the lane detection task by decomposing it into two parts: curve modeling and ground height regression.
  arXiv  Detail & Related papers  (2023-09-19T11:24:14Z)
• Reconstruct from Top View: A 3D Lane Detection Approach based on Geometry Structure Prior [19.1954119672487]
  We propose an advanced approach in targeting the problem of monocular 3D lane detection by leveraging geometry structure underneath process of 2D to 3D lane reconstruction. We first analyze the geometry between the 3D lane and its 2D representation on the ground and propose to impose explicit supervision based on the structure prior. Second, to reduce the structure loss in 2D lane representation, we directly extract top view lane information from front view images.
  arXiv  Detail & Related papers  (2022-06-21T04:03:03Z)
• ONCE-3DLanes: Building Monocular 3D Lane Detection [41.46466150783367]
  We present ONCE-3DLanes, a real-world autonomous driving dataset with lane layout annotation in 3D space. By exploiting the explicit relationship between point clouds and image pixels, a dataset annotation pipeline is designed to automatically generate high-quality 3D lane locations.
  arXiv  Detail & Related papers  (2022-04-30T16:35:25Z)
• Learning a Model for Inferring a Spatial Road Lane Network Graph using Self-Supervision [10.819463015526832]
  This paper presents the first self-supervised learning method to train a model to infer a spatially grounded lane-level road network graph. A formal road lane network model is presented and proves that any structured road scene can be represented by a directed acyclic graph of at most depth three. Results show that the model can generalize to new road layouts, unlike previous approaches, demonstrating its potential for real-world application.
  arXiv  Detail & Related papers  (2021-07-05T04:34:51Z)
• Learnable Online Graph Representations for 3D Multi-Object Tracking [156.58876381318402]
  We propose a unified and learning based approach to the 3D MOT problem. We employ a Neural Message Passing network for data association that is fully trainable. We show the merit of the proposed approach on the publicly available nuScenes dataset by achieving state-of-the-art performance of 65.6% AMOTA and 58% fewer ID-switches.
  arXiv  Detail & Related papers  (2021-04-23T17:59:28Z)
• Multi-Modal Fusion Transformer for End-to-End Autonomous Driving [59.60483620730437]
  We propose TransFuser, a novel Multi-Modal Fusion Transformer, to integrate image and LiDAR representations using attention. Our approach achieves state-of-the-art driving performance while reducing collisions by 76% compared to geometry-based fusion.
  arXiv  Detail & Related papers  (2021-04-19T11:48:13Z)
• Detecting 32 Pedestrian Attributes for Autonomous Vehicles [103.87351701138554]
  In this paper, we address the problem of jointly detecting pedestrians and recognizing 32 pedestrian attributes. We introduce a Multi-Task Learning (MTL) model relying on a composite field framework, which achieves both goals in an efficient way. We show competitive detection and attribute recognition results, as well as a more stable MTL training.
  arXiv  Detail & Related papers  (2020-12-04T15:10:12Z)
• Road Curb Detection and Localization with Monocular Forward-view Vehicle Camera [74.45649274085447]
  We propose a robust method for estimating road curb 3D parameters using a calibrated monocular camera equipped with a fisheye lens. Our approach is able to estimate the vehicle to curb distance in real time with mean accuracy of more than 90%.
  arXiv  Detail & Related papers  (2020-02-28T00:24:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.