HoughLaneNet: Lane Detection with Deep Hough Transform and Dynamic Convolution

• URL: http://arxiv.org/abs/2307.03494v1
• Date: Fri, 7 Jul 2023 10:08:29 GMT
• Title: HoughLaneNet: Lane Detection with Deep Hough Transform and Dynamic Convolution
• Authors: Jia-Qi Zhang, Hao-Bin Duan, Jun-Long Chen, Ariel Shamir and Miao Wang
• Abstract summary: Lanes can present difficulties for detection, as they can be narrow, fragmented, and often obscured by heavy traffic. We propose a hierarchical Deep Hough Transform (DHT) approach that combines all lane features in an image into the Hough parameter space. Our proposed network structure demonstrates improved performance in detecting heavily occluded or worn lane images.
• Score: 8.97991745734826
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The task of lane detection has garnered considerable attention in the field of autonomous driving due to its complexity. Lanes can present difficulties for detection, as they can be narrow, fragmented, and often obscured by heavy traffic. However, it has been observed that the lanes have a geometrical structure that resembles a straight line, leading to improved lane detection results when utilizing this characteristic. To address this challenge, we propose a hierarchical Deep Hough Transform (DHT) approach that combines all lane features in an image into the Hough parameter space. Additionally, we refine the point selection method and incorporate a Dynamic Convolution Module to effectively differentiate between lanes in the original image. Our network architecture comprises a backbone network, either a ResNet or Pyramid Vision Transformer, a Feature Pyramid Network as the neck to extract multi-scale features, and a hierarchical DHT-based feature aggregation head to accurately segment each lane. By utilizing the lane features in the Hough parameter space, the network learns dynamic convolution kernel parameters corresponding to each lane, allowing the Dynamic Convolution Module to effectively differentiate between lane features. Subsequently, the lane features are fed into the feature decoder, which predicts the final position of the lane. Our proposed network structure demonstrates improved performance in detecting heavily occluded or worn lane images, as evidenced by our extensive experimental results, which show that our method outperforms or is on par with state-of-the-art techniques.

Related papers

• ENet-21: An Optimized light CNN Structure for Lane Detection [1.4542411354617986]
  This study develops an optimal structure for the lane detection problem. It offers a promising solution for driver assistance features in modern vehicles. Experiments on the TuSimple dataset support the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2024-03-28T19:07:26Z)
• TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Images [64.63004710817239]
  We propose a novel Transformer-based learning framework named TransY-Net for remote sensing image CD. It improves the feature extraction from a global view and combines multi-level visual features in a pyramid manner. Our proposed method achieves a new state-of-the-art performance on four optical and two SAR image CD benchmarks.
  arXiv  Detail & Related papers  (2023-10-22T07:42:19Z)
• RCLane: Relay Chain Prediction for Lane Detection [76.62424079494285]
  We present a new method for lane detection based on relay chain prediction. Our strategy allows us to establish new state-of-the-art on four major benchmarks including TuSimple, CULane, CurveLanes and LLAMAS.
  arXiv  Detail & Related papers  (2022-07-19T16:48:39Z)
• Laneformer: Object-aware Row-Column Transformers for Lane Detection [96.62919884511287]
  Laneformer is a transformer-based architecture tailored for lane detection in autonomous driving. Inspired by recent advances of the transformer encoder-decoder architecture in various vision tasks, we move forwards to design a new end-to-end Laneformer architecture.
  arXiv  Detail & Related papers  (2022-03-18T10:14:35Z)
• Lane Detection with Versatile AtrousFormer and Local Semantic Guidance [92.83267435275802]
  Lane detection is one of the core functions in autonomous driving. Most existing methods tend to resort to CNN-based techniques. We propose Atrous Transformer (AtrousFormer) to solve the problem.
  arXiv  Detail & Related papers  (2022-03-08T13:25:35Z)
• MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking [72.65494220685525]
  We propose a new dynamic modality-aware filter generation module (named MFGNet) to boost the message communication between visible and thermal data. We generate dynamic modality-aware filters with two independent networks. The visible and thermal filters will be used to conduct a dynamic convolutional operation on their corresponding input feature maps respectively. To address issues caused by heavy occlusion, fast motion, and out-of-view, we propose to conduct a joint local and global search by exploiting a new direction-aware target-driven attention mechanism.
  arXiv  Detail & Related papers  (2021-07-22T03:10:51Z)
• End-to-end Lane Shape Prediction with Transformers [13.103463647059634]
  Lane detection is widely used for lane departure warning and adaptive cruise control in autonomous vehicles. We propose an end-to-end method that directly outputs parameters of a lane shape model. The proposed method is validated on the TuSimple benchmark and shows state-of-the-art accuracy with the most lightweight model size and fastest speed.
  arXiv  Detail & Related papers  (2020-11-09T07:42:55Z)
• Lane Detection Model Based on Spatio-Temporal Network With Double Convolutional Gated Recurrent Units [11.968518335236787]
  Lane detection will remain an open problem for some time to come. A-temporal network with double Conal Gated Recurrent Units (ConvGRUs) proposed to address lane detection in challenging scenes. Our model can outperform the state-of-the-art lane detection models.
  arXiv  Detail & Related papers  (2020-08-10T06:50:48Z)
• Heatmap-based Vanishing Point boosts Lane Detection [3.8170259685864165]
  We propose a new multi-task fusion network architecture for high-precision lane detection. The proposed fusion strategy was tested using the public CULane dataset. The experimental results suggest that the lane detection accuracy of our method outperforms those of state-of-the-art (SOTA) methods.
  arXiv  Detail & Related papers  (2020-07-30T17:17:00Z)
• CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending [102.98909328368481]
  CurveLane-NAS is a novel lane-sensitive architecture search framework. It captures both long-ranged coherent and accurate short-range curve information. It unifies both architecture search and post-processing on curve lane predictions via point blending.
  arXiv  Detail & Related papers  (2020-07-23T17:23:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.