WILD SAM: A Simulated-and-Real Data Augmentation for Autonomous Driving Perception under Challenging Weather

• URL: http://arxiv.org/abs/2605.01081v1
• Date: Fri, 01 May 2026 20:24:51 GMT
• Title: WILD SAM: A Simulated-and-Real Data Augmentation for Autonomous Driving Perception under Challenging Weather
• Abstract summary: We propose two new approaches to mitigate a safety-critical domain shift problem for autonomous vehicles.<n>First, we propose a Weather-Induced pseudo Label Denoising framework that filters noisy pseudo labels generated by real data captured under adverse weather conditions.<n>Second, we develop a novel hybrid training methodology, WILD SAM, that exploits both pseudo-label denoising and simulation-based training solutions.
• Score: 6.084235400921738
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The performance of state-of-the-art object detectors degrades significantly under adverse weather, causing a safety-critical domain shift problem for autonomous vehicles. Recent efforts address this problem by relying on synthetic data to train the object detectors, which limits their real-world applicability. Meanwhile, pseudo-labeling is widely used for cross-dataset domain adaptation problems. However, these methods have not been exploited by weather-based domain adaptation approaches due to the noisy nature of such labels generated under harsh weather conditions. In this paper, we propose two new approaches to mitigate this weather-induced domain shift. First, we propose a Weather-Induced pseudo Label Denoising (WILD) framework that filters noisy pseudo labels generated by real data captured under adverse weather conditions. Second, we develop a novel hybrid training methodology, WILD SAM, that exploits both pseudo-label denoising and simulation-based training solutions while using real-data from the target harsh-weather domain. We validate both proposed approaches, WILD and WILD SAM, on the recently released Four Seasons dataset across rainy and snowy scenarios. Experiments show that the proposed frameworks improve Average Precision (AP) up to 13\% and significantly reduce the weather-induced performance gap relative to the baseline. The code is available at: https://github.com/Kh-Hamed/WILD-SAM

Related papers

• SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions [81.31561238030939]
  SFDATrack is a source-free domain adaptive tracker for tracking objects in adverse weather conditions.<n>We show that SFDATrack achieves superior performance compared to state-of-the-art approaches.
  arXiv  Detail & Related papers  (2026-07-01T03:09:12Z)
• UMDATrack: Unified Multi-Domain Adaptive Tracking Under Adverse Weather Conditions [73.71632291123008]
  We propose UMDATrack, which maintains high-quality target state prediction under various adverse weather conditions.<n>Our code is available at https://github.com/Z-Z188/UMDATrack.
  arXiv  Detail & Related papers  (2025-07-01T10:43:57Z)
• SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removal [57.52777076116241]
  Adverse weather removal aims to restore clear vision under adverse weather conditions. This paper presents a pioneering semi-supervised all-in-one adverse weather removal framework built on the teacher-student network.
  arXiv  Detail & Related papers  (2024-09-29T12:12:22Z)
• Label-Efficient Semantic Segmentation of LiDAR Point Clouds in Adverse Weather Conditions [10.306226508237348]
  Adverse weather conditions can severely affect the performance of LiDAR sensors. Current approaches for detecting adverse weather points require large amounts of labeled data. This paper proposes a label-efficient approach to segment LiDAR point clouds in adverse weather.
  arXiv  Detail & Related papers  (2024-06-14T10:29:00Z)
• ControlUDA: Controllable Diffusion-assisted Unsupervised Domain Adaptation for Cross-Weather Semantic Segmentation [14.407346832155042]
  ControlUDA is a diffusion-assisted framework tailored for UDA segmentation under adverse weather conditions. It first leverages target prior from a pre-trained segmentor for tuning the DM, compensating the missing target domain labels. It also contains UDAControlNet, a condition-fused multi-scale and prompt-enhanced network targeted at high-fidelity data generation in adverse weathers.
  arXiv  Detail & Related papers  (2024-02-09T14:48:20Z)
• Learning Robust Precipitation Forecaster by Temporal Frame Interpolation [65.5045412005064]
  We develop a robust precipitation forecasting model that demonstrates resilience against spatial-temporal discrepancies. Our approach has led to significant improvements in forecasting precision, culminating in our model securing textit1st place in the transfer learning leaderboard of the textitWeather4cast'23 competition.
  arXiv  Detail & Related papers  (2023-11-30T08:22:08Z)
• Learning Real-World Image De-Weathering with Imperfect Supervision [57.748585821252824]
  Existing real-world de-weathering datasets often exhibit inconsistent illumination, position, and textures between the ground-truth images and the input degraded images. We develop a Consistent Label Constructor (CLC) to generate a pseudo-label as consistent as possible with the input degraded image. We combine the original imperfect labels and pseudo-labels to jointly supervise the de-weathering model by the proposed Information Allocation Strategy.
  arXiv  Detail & Related papers  (2023-10-23T14:02:57Z)
• Energy-based Detection of Adverse Weather Effects in LiDAR Data [7.924836086640871]
  We propose a novel approach for detecting adverse weather effects in LiDAR data. Our method learns to associate low energy scores with inlier points and high energy scores with outliers. To help expand the research field of LiDAR perception in adverse weather, we release the SemanticSpray dataset.
  arXiv  Detail & Related papers  (2023-05-25T15:03:36Z)
• Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather [25.964194141706923]
  This paper proposes a novel domain adaptive object detection framework for autonomous driving under foggy weather. Our method leverages both image-level and object-level adaptation to diminish the domain discrepancy in image style and object appearance. Experimental results on public benchmarks show the effectiveness and accuracy of the proposed method.
  arXiv  Detail & Related papers  (2022-10-27T05:09:10Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.