Cross-Scenario Deraining Adaptation with Unpaired Data: Superpixel Structural Priors and Multi-Stage Pseudo-Rain Synthesis
- URL: http://arxiv.org/abs/2603.21661v1
- Date: Mon, 23 Mar 2026 07:38:55 GMT
- Title: Cross-Scenario Deraining Adaptation with Unpaired Data: Superpixel Structural Priors and Multi-Stage Pseudo-Rain Synthesis
- Abstract summary: Image deraining plays a pivotal role in low-level computer vision.<n>Deep learning paradigms often suffer from severe performance degradation when generalized to unseen Out-of-Distribution scenarios.<n>This paper proposes a pioneering cross-scenario deraining adaptation framework.
- Score: 48.809049043865905
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Image deraining plays a pivotal role in low-level computer vision, serving as a prerequisite for robust outdoor surveillance and autonomous driving systems. While deep learning paradigms have achieved remarkable success in firmly aligned settings, they often suffer from severe performance degradation when generalized to unseen Out-of-Distribution (OOD) scenarios. This failure stems primarily from the significant domain discrepancy between synthetic training datasets and the complex physical dynamics of real-world rain. To address these challenges, this paper proposes a pioneering cross-scenario deraining adaptation framework. Diverging from conventional approaches, our method obviates the requirements for paired rainy observations in the target domain, leveraging exclusively rain-free background images. We design a Superpixel Generation (Sup-Gen) module to extract stable structural priors from the source domain using Simple Linear Iterative Clustering. Subsequently, a Resolution-adaptive Fusion strategy is introduced to align these source structures with target backgrounds through texture similarity, ensuring the synthesis of diverse and realistic pseudo-data. Finally, we implement a pseudo-label re-Synthesize mechanism that employs multi-stage noise generation to simulate realistic rain streaks. This framework functions as a versatile plug-and-play module capable of seamless integration into arbitrary deraining architectures. Extensive experiments on state-of-the-art models demonstrate that our approach yields remarkable PSNR gains of up to 32% to 59% in OOD domains while significantly accelerating training convergence.
Related papers
- Prompt-Driven Simulation with Feature Perturbation for Cross-Domain Few-Shot Object Detection [8.13477193884434]
PSP-FSOD is a principled framework that integrates prompt-driven domain simulation with feature perturbation regularization.<n> PSP-FSOD produces high-quality domain-diverse supervision and learns domain-invariant representations.
arXiv Detail & Related papers (2026-08-02T16:11:16Z) - Disentangling Generation and Regression in Stochastic Interpolants for Controllable Image Restoration [30.480465453951982]
DiSI is a unified framework that Disentangles the Interpolant process into independent generation and regression components.<n>We show that DiSI efficiently achieves competitive results on various Image Restoration tasks, while uniquely offering the inference-time flexibility to control the distortion-perception trade-off within a single model.
arXiv Detail & Related papers (2026-05-20T16:41:32Z) - OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation [100.36917520403227]
We present a unified text-conditioned diffusion framework that generates LiDAR scans in a shared range-image representation across eight representative domains.<n>In the absence of a public consolidated benchmark, we construct an 8-domain dataset by combining real-world scans with physically based weather simulation and systematic beam reduction.
arXiv Detail & Related papers (2026-05-13T17:42:20Z) - Derain-Agent: A Plug-and-Play Agent Framework for Rainy Image Restoration [33.7820079889815]
We present Derain-Agent, a plug-and-play refinement framework that transitions deraining from static processing to dynamic, agent-based restoration.<n>Derain-Agent equips a base deraining model with two core capabilities: 1) a Planning Network that intelligently schedules an optimal sequence of restoration tools for each instance, and 2) a Strength Modulation mechanism that applies these tools with spatially adaptive intensity.<n>Our method demonstrates strong generalization, consistently boosting the performance of state-of-the-art deraining models on both synthetic and real-world benchmarks.
arXiv Detail & Related papers (2026-03-12T12:38:23Z) - UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization [22.057301683465074]
We propose UniRain, an effective unified image deraining framework capable of restoring images degraded by rain streak and raindrop.<n>To better enhance unified model generalization, we construct an intelligent retrieval augmented generation (RAG)-based dataset distillation pipeline.<n>Our framework performs favorably against the state-of-the-art models on our proposed benchmarks and multiple public datasets.
arXiv Detail & Related papers (2026-03-04T11:58:51Z) - Optimization-Guided Diffusion for Interactive Scene Generation [52.23368750264419]
We present OMEGA, an optimization-guided, training-free framework that enforces structural consistency and interaction awareness during diffusion-based sampling.<n>We show that OMEGA improves generation realism, consistency, and controllability, increasing the ratio of physically and behaviorally valid scenes.<n>Our approach can also generate $5times$ more near-collision frames with a time-to-collision under three seconds.
arXiv Detail & Related papers (2025-12-08T15:56:18Z) - Scaling Up Occupancy-centric Driving Scene Generation: Dataset and Method [54.461213497603154]
Occupancy-centric methods have recently achieved state-of-the-art results by offering consistent conditioning across frames and modalities.<n>Nuplan-Occ is the largest occupancy dataset to date, constructed from the widely used Nuplan benchmark.<n>We develop a unified framework that jointly synthesizes high-quality occupancy, multi-view videos, and LiDAR point clouds.
arXiv Detail & Related papers (2025-10-27T03:52:45Z) - Semi-Supervised State-Space Model with Dynamic Stacking Filter for Real-World Video Deraining [73.5575992346396]
We propose a dual-branch-temporal state-space model to enhance rain streak removal in video sequences.<n>To improve multi-frame feature fusion, we derive a dynamic filter stacking, which adaptively approximates statistical filters for pixel-wise feature refinement.<n>To further explore the capacity of deraining models in supporting other vision-based tasks in rainy environments, we introduce a novel real-world benchmark.
arXiv Detail & Related papers (2025-05-22T15:50:00Z) - ContRail: A Framework for Realistic Railway Image Synthesis using ControlNet [39.58317527488534]
Image Synthesis aims to address the limitation through the design of intelligent models capable of creating original and realistic images.<n>We propose the ContRail framework based on the novel Stable Diffusion model ControlNet.<n>We experiment with the task of synthetic railway image generation, where we improve the performance in rail-specific tasks.
arXiv Detail & Related papers (2024-12-09T18:34:49Z) - From Rain Generation to Rain Removal [67.71728610434698]
We build a full Bayesian generative model for rainy image where the rain layer is parameterized as a generator.
We employ the variational inference framework to approximate the expected statistical distribution of rainy image.
Comprehensive experiments substantiate that the proposed model can faithfully extract the complex rain distribution.
arXiv Detail & Related papers (2020-08-08T18:56:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.