Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions
- URL: http://arxiv.org/abs/2605.13158v1
- Date: Wed, 13 May 2026 08:22:23 GMT
- Title: Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions
- Abstract summary: Weather-related artifacts vary with the particle's distance to the camera according to the established scene visibility analysis.<n>Existing methods fail to consider this weather-specific physical visual process.<n>We present a unified imaging model that considers the individually visible particles and fog-like aggregate scattering effects.
- Score: 61.27301865260939
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Image restoration under multiple adverse weather conditions aims to develop a single model to recover the underlying scene with high visibility. Weather-related artifacts vary with the particle's distance to the camera according to the established scene visibility analysis, where close and faraway regions are more affected by falling drops and fog effects, respectively. Existing methods fail to consider this weather-specific physical visual process; thus, the restoration performance is limited. In this work, we analyze the common visual factors in adverse weather conditions and present a unified imaging model that considers the individually visible particles and fog-like aggregate scattering effects. Further, we design a novel weather-prior-based network, which leverages the weather-related prior information to help recover the scene by enhancing the features using the estimated occlusion and transmission. Experimental results in multiple adverse scenarios show the superiority of our method against state-of-the-art methods.
Related papers
- WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression [5.713746691096994]
We introduce the WeatherRemover model, designed to enhance the restoration of images affected by various weather conditions.<n>Our model adopts a UNet-like structure with a gating mechanism and a multi-scale pyramid vision Transformer.<n>Our lightweight model achieves an optimal balance between restoration quality, parameter efficiency, computational overhead, and memory usage.
arXiv Detail & Related papers (2026-04-08T03:02:37Z) - RoSe: Robust Self-supervised Stereo Matching under Adverse Weather Conditions [58.37558408672509]
We propose a robust self-supervised training paradigm, consisting of two key steps: robust self-supervised scene correspondence learning and adverse weather distillation.<n>Experiments demonstrate the effectiveness and versatility of our proposed solution, which outperforms existing state-of-the-art self-supervised methods.
arXiv Detail & Related papers (2025-09-23T15:41:40Z) - WeatherPrompt: Multi-modality Representation Learning for All-Weather Drone Visual Geo-Localization [22.01591564940522]
We present WeatherPrompt, a multi-modality learning paradigm that establishes weather-invariant representations through fusing the image embedding with the text context.<n>Our framework achieves competitive recall rates compared to state-of-the-art drone geo-localization methods.
arXiv Detail & Related papers (2025-08-13T07:28:41Z) - UniDet-D: A Unified Dynamic Spectral Attention Model for Object Detection under Adverse Weathers [44.00242927775847]
We propose UniDet-D, a unified framework that tackles the challenge of object detection under various adverse weather conditions.<n>Specifically, the proposed UniDet-D incorporates a dynamic spectral attention mechanism that adaptively emphasizes informative spectral components while suppressing irrelevant ones.<n>Extensive experiments show that UniDet-D achieves superior detection accuracy across different types of adverse-weather degradation.
arXiv Detail & Related papers (2025-06-14T03:23:29Z) - Multiple weather images restoration using the task transformer and adaptive mixup strategy [14.986500375481546]
We introduce a novel multi-task severe weather removal model that can effectively handle complex weather conditions in an adaptive manner.
Our model incorporates a weather task sequence generator, enabling the self-attention mechanism to selectively focus on features specific to different weather types.
Our proposed model has achieved state-of-the-art performance on the publicly available dataset.
arXiv Detail & Related papers (2024-09-05T04:55:40Z) - Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for
Video Adverse Weather Removal [53.15046196592023]
We introduce test-time adaptation into adverse weather removal in videos.
We propose the first framework that integrates test-time adaptation into the iterative diffusion reverse process.
arXiv Detail & Related papers (2024-03-12T14:21:30Z) - Always Clear Days: Degradation Type and Severity Aware All-In-One
Adverse Weather Removal [8.58670633761819]
All-in-one adverse weather removal is an emerging topic on image restoration, which aims to restore multiple weather degradations in an unified model.
We propose a degradation type and severity aware model, called UtilityIR, for blind all-in-one bad weather image restoration.
arXiv Detail & Related papers (2023-10-27T17:29:55Z) - MetaWeather: Few-Shot Weather-Degraded Image Restoration [17.63266150036311]
We introduce MetaWeather, a universal approach that can handle diverse and novel weather conditions with a single unified model.
We show that MetaWeather can adapt to unseen weather conditions, significantly outperforming state-of-the-art multi-weather image restoration methods.
arXiv Detail & Related papers (2023-08-28T06:25:40Z) - Exploring the Application of Large-scale Pre-trained Models on Adverse
Weather Removal [97.53040662243768]
We propose a CLIP embedding module to make the network handle different weather conditions adaptively.
This module integrates the sample specific weather prior extracted by CLIP image encoder together with the distribution specific information learned by a set of parameters.
arXiv Detail & Related papers (2023-06-15T10:06:13Z) - ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural
Rendering [83.75284107397003]
We introduce ScatterNeRF, a neural rendering method which renders scenes and decomposes the fog-free background.
We propose a disentangled representation for the scattering volume and the scene objects, and learn the scene reconstruction with physics-inspired losses.
We validate our method by capturing multi-view In-the-Wild data and controlled captures in a large-scale fog chamber.
arXiv Detail & Related papers (2023-05-03T13:24:06Z) - Thermal to Visible Image Synthesis under Atmospheric Turbulence [67.99407460140263]
In biometrics and surveillance, thermal imagining modalities are often used to capture images in low-light and nighttime conditions.
Such imaging systems often suffer from atmospheric turbulence, which introduces severe blur and deformation artifacts to the captured images.
An end-to-end reconstruction method is proposed which can directly transform thermal images into visible-spectrum images.
arXiv Detail & Related papers (2022-04-06T19:47:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.