PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- URL: http://arxiv.org/abs/2605.14045v1
- Date: Wed, 13 May 2026 19:07:14 GMT
- Title: PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- Abstract summary: We propose a unified framework that integrates zero-shot soft weather perceptions with velocity-constrained rectified-flow refinement.<n>PVRF improves both fidelity and perceptual quality over state-of-the-art baselines.
- Score: 69.40969296005794
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Adverse weather removal (AWR) in real-world images remains challenging due to heterogeneous and unseen degradations, while distortion-driven training often yields overly smooth results. We propose PVRF, a unified framework that integrates zero-shot soft weather perceptions with velocity-constrained rectified-flow refinement. PVRF introduces an AWR-specific question answering module (AWR-QA) that uses frozen vision--language models (VLMs) to estimate soft probabilities of weather types and low-level attribute scores. These perceptions condition restoration networks via attribute-modulated normalization (AMN) and weather-weighted adapters (WWA), producing an anchor estimate for refinement. We then learn a terminal-consistent residual rectified flow with perception-adaptive source perturbation and a terminal-consistent velocity parameterization to stabilize learning near the terminal regime. Extensive experiments show that PVRF improves both fidelity and perceptual quality over state-of-the-art baselines, with strong cross-dataset generalization on single and combined degradations. Code will be released at https://github.com/dongw22/PVRF.
Related papers
- Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring [55.57242007016976]
Continuous emotion control in text-to-image generation requires a model to improve affective alignment without changing the objects, layout, or scene described by the prompt.<n>Existing supervised emotion-injection methods often optimize feature-space proxies and may therefore exhibit emotion-semantic drift.<n>We address this problem with a flow-matching image-generation framework that combines continuous valence-arousal conditioning, Group Relative Policy Optimization, and a neutral semantic anchor.
arXiv Detail & Related papers (2026-09-11T13:24:35Z) - TTSD-FAR: Test-Time Self-Distillation with Fisher-Anchored Restoration for Missing-Modality Emotion Recognition in LVLMs [83.78708832901194]
Large video-language models (LVLMs) have shown remarkable performance on multimodal tasks like multimodal emotion recognition (ER) in the wild.<n>However, real-world deployment remains challenging: modalities may be missing or noisy at test time.<n>We propose a solution in which a frozen teacher guides an adaptive low-rank student via self-distillation.<n>Experiments on MELD, DFEW, and BAH under 0%-50% missing modalities show that this unified adaptation-restoration design consistently outperforms entropy-based adaptation, RAG, and perplexity-based generation.
arXiv Detail & Related papers (2026-08-18T23:40:28Z) - Local Margin Restoration for Test-Time Adaptation of Vision-Language Models [15.097704252897818]
Vision-language models (VLMs) such as CLIP exhibit remarkable zero-shot capabilities, yet their performance frequently degrades sharply under unexpected test-time distribution shifts.<n>We propose Local Margin Restoration (LMR), a lightweight, one-step Test-Time Adaptation framework.<n>Experiments on CIFAR-C, ImageNet-C, and ImageNet variants demonstrate that LMR consistently outperforms state-of-the-art TTA baselines.
arXiv Detail & Related papers (2026-08-03T13:38:11Z) - Where to Refine, When to Stop: Rethinking Redundancy via Latent Discrepancy for Efficient Visual Autoregressive Generation [50.139984798361375]
We propose a training-free framework that removes redundancy via latent discrepancy.<n> LD-Pruning substantially reduces inference while maintaining high generation quality, achieving up to 2.35x speedup on Infinity-8B.
arXiv Detail & Related papers (2026-05-29T19:34:39Z) - Learned Memory Attenuation in Sage-Husa Kalman Filters for Robust UAV State Estimation [0.0]
Unmanned Aerial Vehicles in dynamic environments face telemetry outages, structural vibrations, and regime-dependent noise.<n>We introduce the N-Deep Recurrent Sage-Husa Filter (NDR-SHKF), which replaces the scalar parameter with a vector-valued memory attenuation policy.<n>A bifurcated architecture routes shallow recurrent states to capture instantaneous sensor anomalies and deep states to encode sustained dynamic trends.
arXiv Detail & Related papers (2026-05-18T17:38:13Z) - WindINR: Latent-State INR for Fast Local Wind Query and Correction in Complex Terrain [47.92351540935845]
WindINR is a latent-state implicit neural representation framework for continuous high-resolution local wind query and sparse-observation correction.<n>WindINR maps static terrain descriptors, a low-resolution background field, and continuous query coordinates to a high-resolution wind state.<n>WindINR improves local high-resolution wind estimates by updating only a compact latent state rather than the full network.
arXiv Detail & Related papers (2026-05-10T12:44:38Z) - Sparsely-Supervised Data Assimilation via Physics-Informed Schrödinger Bridge [22.765803648152357]
Full-grid low-grid (LF) simulations provide informative priors in multi-fidelity settings.<n>Amortized reconstruction using generative models has been proposed; however, such approaches rely on full-field HF supervision during training.<n>We propose the Physics-In Conditional Schrdinger Bridge (PICSB), which transports an informative LF prior toward an observation an-conditioned HF without any additional inference-time guidance.
arXiv Detail & Related papers (2026-03-20T10:05:55Z) - Distributed physics-informed neural networks via domain decomposition for fast flow reconstruction [8.614942690565782]
PINs offer a powerful paradigm for flow reconstruction, seamlessly integrating velocity measurements with the governing Navier-N equations to recover complete velocity and latent pressure fields.<n>A critical challenge in such distributed PINs is pressure indeterminacy, where independent sub-networks drift into inconsistent local pressure baselines.<n>By enforcing a unidirectional flow from designated master ranks, our approach eliminates uniqueness and guarantees global pressure while preserving temporal continuity.
arXiv Detail & Related papers (2026-02-05T16:41:55Z) - Self-Reinforced Deep Priors for Reparameterized Full Waveform Inversion [3.930876721046067]
We propose a self-reinforced DIP-FWI framework, in which a steering algorithm alternately updates both the network parameters and the input at each iteration.<n>SRDIP-FWI achieves superior resolution, improved accuracy and greater depth penetration compared to multiscale FWI.
arXiv Detail & Related papers (2025-12-09T06:30:39Z) - FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolution [6.767948729335409]
Real-image super-resolution (Real-ISR) seeks to recover HR images from LR inputs with mixed, unknown degradations.<n>We introduce FRAMER, a plug-and-play training scheme that exploits diffusion priors without changing the backbone or inference.
arXiv Detail & Related papers (2025-12-01T08:09:05Z) - Solving Inverse Problems with FLAIR [68.87167940623318]
We present FLAIR, a training-free variational framework that leverages flow-based generative models as prior for inverse problems.<n>Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion- and flow-based methods in terms of reconstruction quality and sample diversity.
arXiv Detail & Related papers (2025-06-03T09:29:47Z) - FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systems [51.15230303652732]
FLEX (F Low EXpert) is a backbone architecture for generative modeling of-temporal physical systems.<n>It reduces the variance of the velocity field in the diffusion model, which helps stabilize training.<n>It achieves accurate predictions for super-resolution and forecasting tasks using as few features as two reverse diffusion steps.
arXiv Detail & Related papers (2025-05-23T00:07:59Z) - Few-shot NeRF by Adaptive Rendering Loss Regularization [78.50710219013301]
Novel view synthesis with sparse inputs poses great challenges to Neural Radiance Field (NeRF)
Recent works demonstrate that the frequency regularization of Positional rendering can achieve promising results for few-shot NeRF.
We propose Adaptive Rendering loss regularization for few-shot NeRF, dubbed AR-NeRF.
arXiv Detail & Related papers (2024-10-23T13:05:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.