Sparse Laneformer

• URL: http://arxiv.org/abs/2404.07821v1
• Date: Thu, 11 Apr 2024 15:00:55 GMT
• Title: Sparse Laneformer
• Authors: Ji Liu, Zifeng Zhang, Mingjie Lu, Hongyang Wei, Dong Li, Yile Xie, Jinzhang Peng, Lu Tian, Ashish Sirasao, Emad Barsoum,
• Abstract summary: We propose a transformer-based lane detection framework based on a sparse anchor mechanism. We generate sparse anchors with position-aware lane queries and angle queries instead of traditional explicit anchors. Our method, named Sparse Laneformer, is easy-to-implement and end-to-end trainable.
• Score: 14.198478706372995
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lane detection is a fundamental task in autonomous driving, and has achieved great progress as deep learning emerges. Previous anchor-based methods often design dense anchors, which highly depend on the training dataset and remain fixed during inference. We analyze that dense anchors are not necessary for lane detection, and propose a transformer-based lane detection framework based on a sparse anchor mechanism. To this end, we generate sparse anchors with position-aware lane queries and angle queries instead of traditional explicit anchors. We adopt Horizontal Perceptual Attention (HPA) to aggregate the lane features along the horizontal direction, and adopt Lane-Angle Cross Attention (LACA) to perform interactions between lane queries and angle queries. We also propose Lane Perceptual Attention (LPA) based on deformable cross attention to further refine the lane predictions. Our method, named Sparse Laneformer, is easy-to-implement and end-to-end trainable. Extensive experiments demonstrate that Sparse Laneformer performs favorably against the state-of-the-art methods, e.g., surpassing Laneformer by 3.0% F1 score and O2SFormer by 0.7% F1 score with fewer MACs on CULane with the same ResNet-34 backbone.

Related papers

• LDTR: Transformer-based Lane Detection with Anchor-chain Representation [11.184960972042406]
  Lane detection scenarios with limited- or no-visual-clue of lanes remain challenging and crucial for automated driving. Inspired by the DETR architecture, we propose LDTR, a transformer-based model to address these issues. Experimental results demonstrate that LDTR achieves state-of-the-art performance on well-known datasets.
  arXiv  Detail & Related papers  (2024-03-21T12:29:26Z)
• Sketch and Refine: Towards Fast and Accurate Lane Detection [69.63287721343907]
  Lane detection is a challenging task due to the complexity of real-world scenarios. Existing approaches, whether proposal-based or keypoint-based, suffer from depicting lanes effectively and efficiently. We present a "Sketch-and-Refine" paradigm that utilizes the merits of both keypoint-based and proposal-based methods. Experiments show that our SRLane can run at a fast speed (i.e., 278 FPS) while yielding an F1 score of 78.9%.
  arXiv  Detail & Related papers  (2024-01-26T09:28:14Z)
• Decoupling the Curve Modeling and Pavement Regression for Lane Detection [67.22629246312283]
  curve-based lane representation is a popular approach in many lane detection methods. We propose a new approach to the lane detection task by decomposing it into two parts: curve modeling and ground height regression.
  arXiv  Detail & Related papers  (2023-09-19T11:24:14Z)
• CLRerNet: Improving Confidence of Lane Detection with LaneIoU [3.2489082010225485]
  We show that correct lane positions are already among the predictions of an existing row-based detector. We propose LaneIoU that better correlates with the metric, by taking the local lane angles into consideration. We develop a novel detector coined CLRerNet featuring LaneIoU for the target assignment cost and loss functions.
  arXiv  Detail & Related papers  (2023-05-15T05:59:35Z)
• RCLane: Relay Chain Prediction for Lane Detection [76.62424079494285]
  We present a new method for lane detection based on relay chain prediction. Our strategy allows us to establish new state-of-the-art on four major benchmarks including TuSimple, CULane, CurveLanes and LLAMAS.
  arXiv  Detail & Related papers  (2022-07-19T16:48:39Z)
• A Keypoint-based Global Association Network for Lane Detection [47.93323407661912]
  Lane detection is a challenging task that requires predicting complex topology shapes of lane lines and distinguishing different types of lanes simultaneously. We propose a Global Association Network (GANet) to formulate the lane detection problem from a new perspective. Our method outperforms previous methods with F1 score of 79.63% on CULane and 97.71% on Tusimple dataset with high FPS.
  arXiv  Detail & Related papers  (2022-04-15T05:24:04Z)
• Laneformer: Object-aware Row-Column Transformers for Lane Detection [96.62919884511287]
  Laneformer is a transformer-based architecture tailored for lane detection in autonomous driving. Inspired by recent advances of the transformer encoder-decoder architecture in various vision tasks, we move forwards to design a new end-to-end Laneformer architecture.
  arXiv  Detail & Related papers  (2022-03-18T10:14:35Z)
• CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending [102.98909328368481]
  CurveLane-NAS is a novel lane-sensitive architecture search framework. It captures both long-ranged coherent and accurate short-range curve information. It unifies both architecture search and post-processing on curve lane predictions via point blending.
  arXiv  Detail & Related papers  (2020-07-23T17:23:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.