DA-RAW: Domain Adaptive Object Detection for Real-World Adverse Weather Conditions

• URL: http://arxiv.org/abs/2309.08152v2
• Date: Thu, 2 May 2024 13:30:29 GMT
• Title: DA-RAW: Domain Adaptive Object Detection for Real-World Adverse Weather Conditions
• Authors: Minsik Jeon, Junwon Seo, Jihong Min,
• Abstract summary: We present an unsupervised domain adaptation framework for object detection in adverse weather conditions. Our method resolves the style gap by concentrating on style-related information of high-level features. Using self-supervised contrastive learning, our framework then reduces the weather gap and acquires instance features that are robust to weather corruption.
• Score: 2.048226951354646
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Despite the success of deep learning-based object detection methods in recent years, it is still challenging to make the object detector reliable in adverse weather conditions such as rain and snow. For the robust performance of object detectors, unsupervised domain adaptation has been utilized to adapt the detection network trained on clear weather images to adverse weather images. While previous methods do not explicitly address weather corruption during adaptation, the domain gap between clear and adverse weather can be decomposed into two factors with distinct characteristics: a style gap and a weather gap. In this paper, we present an unsupervised domain adaptation framework for object detection that can more effectively adapt to real-world environments with adverse weather conditions by addressing these two gaps separately. Our method resolves the style gap by concentrating on style-related information of high-level features using an attention module. Using self-supervised contrastive learning, our framework then reduces the weather gap and acquires instance features that are robust to weather corruption. Extensive experiments demonstrate that our method outperforms other methods for object detection in adverse weather conditions.

Related papers

• Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal [53.15046196592023]
  We introduce test-time adaptation into adverse weather removal in videos. We propose the first framework that integrates test-time adaptation into the iterative diffusion reverse process.
  arXiv  Detail & Related papers  (2024-03-12T14:21:30Z)
• Enhancing Lidar-based Object Detection in Adverse Weather using Offset Sequences in Time [1.1725016312484975]
  Lidar-based object detection is significantly affected by adverse weather conditions such as rain and fog. Our research provides a comprehensive study of effective methods for mitigating the effects of adverse weather on the reliability of lidar-based object detection.
  arXiv  Detail & Related papers  (2024-01-17T08:31:58Z)
• Learning Real-World Image De-Weathering with Imperfect Supervision [57.748585821252824]
  Existing real-world de-weathering datasets often exhibit inconsistent illumination, position, and textures between the ground-truth images and the input degraded images. We develop a Consistent Label Constructor (CLC) to generate a pseudo-label as consistent as possible with the input degraded image. We combine the original imperfect labels and pseudo-labels to jointly supervise the de-weathering model by the proposed Information Allocation Strategy.
  arXiv  Detail & Related papers  (2023-10-23T14:02:57Z)
• Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather [44.711384869027775]
  Due to the domain gap, a detection model trained under clear weather may not perform well in foggy and rainy conditions. To bridge the domain gap and improve the performance of object detection in foggy and rainy weather, this paper presents a novel framework for domain-adaptive object detection.
  arXiv  Detail & Related papers  (2023-07-18T23:06:47Z)
• Exploring the Application of Large-scale Pre-trained Models on Adverse Weather Removal [97.53040662243768]
  We propose a CLIP embedding module to make the network handle different weather conditions adaptively. This module integrates the sample specific weather prior extracted by CLIP image encoder together with the distribution specific information learned by a set of parameters.
  arXiv  Detail & Related papers  (2023-06-15T10:06:13Z)
• Sit Back and Relax: Learning to Drive Incrementally in All Weather Conditions [16.014293219912]
  In autonomous driving scenarios, current object detection models show strong performance when tested in clear weather. We propose Domain-Incremental Learning through Activation Matching (DILAM) to adapt only the affine parameters of a clear weather pre-trained network to different weather conditions. Our memory bank is extremely lightweight, since affine parameters account for less than 2% of a typical object detector.
  arXiv  Detail & Related papers  (2023-05-30T11:37:41Z)
• Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather [25.964194141706923]
  This paper proposes a novel domain adaptive object detection framework for autonomous driving under foggy weather. Our method leverages both image-level and object-level adaptation to diminish the domain discrepancy in image style and object appearance. Experimental results on public benchmarks show the effectiveness and accuracy of the proposed method.
  arXiv  Detail & Related papers  (2022-10-27T05:09:10Z)
• Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing [70.16043883381677]
  In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres. In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions. We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
  arXiv  Detail & Related papers  (2022-01-10T10:02:40Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Robustness of Object Detectors in Degrading Weather Conditions [7.91378990016322]
  State-of-the-art object detection systems for autonomous driving achieve promising results in clear weather conditions. These systems need to work in degrading weather conditions, such as rain, fog and snow. Most approaches evaluate only on the KITTI dataset, which consists only of clear weather scenes.
  arXiv  Detail & Related papers  (2021-06-16T13:56:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.