Contrastive Learning for Lane Detection via cross-similarity

• URL: http://arxiv.org/abs/2308.08242v4
• Date: Tue, 20 Aug 2024 08:11:20 GMT
• Title: Contrastive Learning for Lane Detection via cross-similarity
• Authors: Ali Zoljodi, Sadegh Abadijou, Mina Alibeigi, Masoud Daneshtalab,
• Abstract summary: Lane markings in road scenes pose a challenge due to their intricate nature, which is susceptible to unfavorable conditions. We present Contrastive Learning for Lane Detection via cross-similarity (CLLD) to enhance the resilience of lane detection models in real-world scenarios.
• Score: 0.5249805590164902
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting conditions, occlusions by other vehicles or pedestrians, and fading of colors over time. The detection process is further complicated by the presence of several lane shapes and natural variations, necessitating large amounts of data to train a robust lane detection model capable of handling various scenarios. In this paper, we present a novel self-supervised learning method termed Contrastive Learning for Lane Detection via cross-similarity (CLLD) to enhance the resilience of lane detection models in real-world scenarios, particularly when the visibility of lanes is compromised. CLLD introduces a contrastive learning (CL) method that assesses the similarity of local features within the global context of the input image. It uses the surrounding information to predict lane markings. This is achieved by integrating local feature contrastive learning with our proposed cross-similar operation. The local feature CL concentrates on extracting features from small patches, a necessity for accurately localizing lane segments. Meanwhile, cross-similarity captures global features, enabling the detection of obscured lane segments based on their surroundings. We enhance cross-similarity by randomly masking portions of input images in the process of augmentation. Extensive experiments on TuSimple and CuLane benchmarks demonstrate that CLLD outperforms SOTA contrastive learning methods, particularly in visibility-impairing conditions like shadows, while it also delivers comparable results under normal conditions. Compared to supervised learning, CLLD still excels in challenging scenarios such as shadows and crowded scenes, which are common in real-world driving.

Related papers

• LDTR: Transformer-based Lane Detection with Anchor-chain Representation [11.184960972042406]
  Lane detection scenarios with limited- or no-visual-clue of lanes remain challenging and crucial for automated driving. Inspired by the DETR architecture, we propose LDTR, a transformer-based model to address these issues. Experimental results demonstrate that LDTR achieves state-of-the-art performance on well-known datasets.
  arXiv  Detail & Related papers  (2024-03-21T12:29:26Z)
• LVLane: Deep Learning for Lane Detection and Classification in Challenging Conditions [2.5641096293146712]
  We present an end-to-end lane detection and classification system based on deep learning methodologies. In our study, we introduce a unique dataset meticulously curated to encompass scenarios that pose significant challenges for state-of-the-art (SOTA) lane localization models. We propose a CNN-based classification branch, seamlessly integrated with the detector, facilitating the identification of distinct lane types.
  arXiv  Detail & Related papers  (2023-07-13T16:09:53Z)
• Towards Effective Image Manipulation Detection with Proposal Contrastive Learning [61.5469708038966]
  We propose Proposal Contrastive Learning (PCL) for effective image manipulation detection. Our PCL consists of a two-stream architecture by extracting two types of global features from RGB and noise views respectively. Our PCL can be easily adapted to unlabeled data in practice, which can reduce manual labeling costs and promote more generalizable features.
  arXiv  Detail & Related papers  (2022-10-16T13:30:13Z)
• Repainting and Imitating Learning for Lane Detection [52.5220065495956]
  Current lane detection methods are struggling with the invisibility lane issue caused by heavy shadows. We propose a novel Repainting and Imitating Learning framework containing a pair of teacher and student. Our method introduces no extra time cost during inference and can be plug-and-play in various cutting-edge lane detection networks.
  arXiv  Detail & Related papers  (2022-10-11T02:26:39Z)
• Dual Contrastive Learning for General Face Forgery Detection [64.41970626226221]
  We propose a novel face forgery detection framework, named Dual Contrastive Learning (DCL), which constructs positive and negative paired data. To explore the essential discrepancies, Intra-Instance Contrastive Learning (Intra-ICL) is introduced to focus on the local content inconsistencies prevalent in the forged faces.
  arXiv  Detail & Related papers  (2021-12-27T05:44:40Z)
• Semantically Contrastive Learning for Low-light Image Enhancement [48.71522073014808]
  Low-light image enhancement (LLE) remains challenging due to the unfavorable prevailing low-contrast and weak-visibility problems of single RGB images. We propose an effective semantically contrastive learning paradigm for LLE (namely SCL-LLE) Our method surpasses the state-of-the-arts LLE models over six independent cross-scenes datasets.
  arXiv  Detail & Related papers  (2021-12-13T07:08:33Z)
• MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection [11.124150983521158]
  We propose a novel framework named Multi-modal Contrastive Classification by Locally Correlated Representations. Our MC-LCR aims to amplify implicit local discrepancies between authentic and forged faces from both spatial and frequency domains. We achieve state-of-the-art performance and demonstrate the robustness and generalization of our method.
  arXiv  Detail & Related papers  (2021-10-07T09:24:12Z)
• Local Relation Learning for Face Forgery Detection [73.73130683091154]
  We propose a novel perspective of face forgery detection via local relation learning. Specifically, we propose a Multi-scale Patch Similarity Module (MPSM), which measures the similarity between features of local regions. We also propose an RGB-Frequency Attention Module (RFAM) to fuse information in both RGB and frequency domains for more comprehensive local feature representation.
  arXiv  Detail & Related papers  (2021-05-06T10:44:32Z)
• Pluggable Weakly-Supervised Cross-View Learning for Accurate Vehicle Re-Identification [53.6218051770131]
  Cross-view consistent feature representation is key for accurate vehicle ReID. Existing approaches resort to supervised cross-view learning using extensive extra viewpoints annotations. We present a pluggable Weakly-supervised Cross-View Learning (WCVL) module for vehicle ReID.
  arXiv  Detail & Related papers  (2021-03-09T11:51:09Z)
• Lane Detection Model Based on Spatio-Temporal Network With Double Convolutional Gated Recurrent Units [11.968518335236787]
  Lane detection will remain an open problem for some time to come. A-temporal network with double Conal Gated Recurrent Units (ConvGRUs) proposed to address lane detection in challenging scenes. Our model can outperform the state-of-the-art lane detection models.
  arXiv  Detail & Related papers  (2020-08-10T06:50:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.