Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restoration
- URL: http://arxiv.org/abs/2601.21592v1
- Date: Thu, 29 Jan 2026 12:02:42 GMT
- Title: Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restoration
- Abstract summary: We propose an Uncertainty-Aware Diffusion Bridge Model (UDBM) for image restoration.<n>UDBM reformulates AiOIR as a transport problem steered by pixel-wise uncertainty.<n>It achieves state-of-the-art performance across diverse restoration tasks within a single inference step.
- Score: 39.5698877093219
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: All-in-One Image Restoration (AiOIR) faces the fundamental challenge in reconciling conflicting optimization objectives across heterogeneous degradations. Existing methods are often constrained by coarse-grained control mechanisms or fixed mapping schedules, yielding suboptimal adaptation. To address this, we propose an Uncertainty-Aware Diffusion Bridge Model (UDBM), which innovatively reformulates AiOIR as a stochastic transport problem steered by pixel-wise uncertainty. By introducing a relaxed diffusion bridge formulation which replaces the strict terminal constraint with a relaxed constraint, we model the uncertainty of degradations while theoretically resolving the drift singularity inherent in standard diffusion bridges. Furthermore, we devise a dual modulation strategy: the noise schedule aligns diverse degradations into a shared high-entropy latent space, while the path schedule adaptively regulates the transport trajectory motivated by the viscous dynamics of entropy regularization. By effectively rectifying the transport geometry and dynamics, UDBM achieves state-of-the-art performance across diverse restoration tasks within a single inference step.
Related papers
- SE-UNet: Singular Equivariant Imaging for Real-World Constrained Generation [0.0]
SE-UNet is a framework designed to solve ill-posed imaging tasks without extensive pre-training.<n>Our method surpasses Deep Image Prior (DIP) baselines by over 4 dB in PSNR.
arXiv Detail & Related papers (2026-07-02T13:24:53Z) - Self-supervised Dynamic Heterogeneous Degradation Modeling for Unified Zero-Shot Image Restoration [36.68260793473452]
Zero-shot image restoration provides a flexible way to handle diverse degradations without task-specific training.<n>We propose a unified physical zero-shot image restoration framework that explicitly models heterogeneous degradations into a homogeneous all-in-one distribution.<n>Our method achieves state-of-the-art performance across both single and mixed degradations.
arXiv Detail & Related papers (2026-05-23T14:08:23Z) - ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Models [52.648413887350195]
We propose Stage-Aware RoPE Remapping to suppress global repetition, local repetition, and detail degradation.<n>We also propose Entropy-Driven Adaptive Attention, which quantifies dispersion via a resolution-invariant normalized entropy.<n>Our method consistently outperforms prior resolution-extrapolation methods in both structural coherence and fine-detail fidelity.
arXiv Detail & Related papers (2026-05-11T06:14:38Z) - Better with Less: Tackling Heterogeneous Multi-Modal Image Joint Pretraining via Conditioned and Degraded Masked Autoencoder [34.73963627819185]
High-resolution (HR) joint optical and synthetic aperture radar (SAR) pretraining seeks modality synergy to mutually enhance single-source representations.<n>We propose CoDe-MAE, pioneering a textitbetter synergy with less alignment philosophy.<n>CoDe-MAE successfully prevents representation degradation and establishes new state-of-the-art performance across diverse single- and bi-modal downstream tasks.
arXiv Detail & Related papers (2026-04-18T10:23:00Z) - Energy-oriented Diffusion Bridge for Image Restoration with Foundational Diffusion Models [65.20192162889253]
We propose an Energy-oriented diffusion Bridge (E-Bridge) framework to approximate a set of low-cost manifold geodesic trajectories.<n>We achieve this by designing a novel bridge process that evolves over a shorter time horizon and makes the reverse process start from an entropy-regularized point.<n>We show that our E-Bridge achieves state-of-the-art performance across various image restoration tasks while enabling high-quality recovery with a single or fewer sampling steps.
arXiv Detail & Related papers (2026-04-13T04:42:55Z) - Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios [34.660999867031386]
Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks.<n>This paper proposes an efficient degradation aware diffusion framework for image fusion under arbitrary degradation scenarios.
arXiv Detail & Related papers (2026-04-10T03:34:53Z) - Architectural Unification for Polarimetric Imaging Across Multiple Degradations [54.83037963738918]
We propose a unified architectural framework for polarimetric imaging that is structurally shared across multiple degradation scenarios.<n>The model performs single-stage joint image-Stokes processing, avoiding error accumulation and explicitly preserving physical consistency.
arXiv Detail & Related papers (2026-03-06T02:38:57Z) - Robust Posterior Diffusion-based Sampling via Adaptive Guidance Scale [39.27744518020771]
We propose an adaptive likelihood step-size strategy to guide the diffusion process for inverse-problem formulations.<n>The resulting approach, Adaptive Posterior diffusion Sampling (AdaPS), is hyper-free and improves reconstruction quality across diverse imaging tasks.
arXiv Detail & Related papers (2025-11-23T14:37:59Z) - MambaX: Image Super-Resolution with State Predictive Control [48.76194230142064]
Mamba has emerged as a promising approach that can represent the entire reconstruction process as a state sequence with multiple nodes, allowing for intermediate intervention.<n>We created a nonlinear state predictive control model textbfMambaX that maps consecutive spectral bands into a latent state space and generalizes the SR task by dynamically learning the nonlinear state parameters of control equations.<n>Our evaluation demonstrates the superior performance of the dynamic spectrum-state representation model in both single-image SR and multimodal fusion-based SR tasks.
arXiv Detail & Related papers (2025-11-22T11:44:09Z) - Residual Diffusion Bridge Model for Image Restoration [57.31163715170476]
Diffusion bridge models establish probabilistic paths between arbitrary paired distributions.<n>Most existing methods merely treat them as simple variants of interpolants, lacking a unified analytical perspective.<n>We propose the Residual Diffusion Bridge Model (RDBM) to address these challenges.
arXiv Detail & Related papers (2025-10-27T08:35:49Z) - HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking [80.07224739976911]
Event cameras offer exceptional temporal resolution and a range (modal)<n> RGB cameras excel at capturing rich texture with high resolution, whereas event cameras offer exceptional temporal resolution and a range (modal)
arXiv Detail & Related papers (2025-10-22T13:15:13Z) - OSCAR: Orthogonal Stochastic Control for Alignment-Respecting Diversity in Flow Matching [14.664226708184676]
Flow-based text-to-image models follow deterministic trajectories, forcing users to repeatedly sample to discover diverse modes.<n>We present a training-free, inference-time control mechanism that makes the flow itself diversity-aware.
arXiv Detail & Related papers (2025-10-10T07:07:19Z) - Prompt-Guided Dual Latent Steering for Inversion Problems [16.58915166460579]
Inverting corrupted images into the latent space of diffusion models is challenging.<n>Current methods, which encode an image into a single latent vector, struggle to balance structural fidelity with semantic accuracy.<n>We introduce Prompt-Guided Dual Latent Steering (PDLS), a novel framework built upon Rectified Flow models for their stable inversion paths.<n>PDLS decomposes the inversion process into two complementary streams: a structural path to preserve source integrity and a semantic path guided by a prompt.
arXiv Detail & Related papers (2025-09-23T04:11:06Z) - Multi-Agent Path Finding in Continuous Spaces with Projected Diffusion Models [57.45019514036948]
Multi-Agent Path Finding (MAPF) is a fundamental problem in robotics.<n>This work proposes a novel approach that integrates constrained optimization with diffusion models for MAPF in continuous spaces.
arXiv Detail & Related papers (2024-12-23T21:27:19Z) - Convex Latent-Optimized Adversarial Regularizers for Imaging Inverse
Problems [8.33626757808923]
We introduce Convex Latent-d Adrial Regularizers (CLEAR), a novel and interpretable data-driven paradigm.
CLEAR represents a fusion of deep learning (DL) and variational regularization.
Our method consistently outperforms conventional data-driven techniques and traditional regularization approaches.
arXiv Detail & Related papers (2023-09-17T12:06:04Z) - A Variational Perspective on Solving Inverse Problems with Diffusion
Models [101.831766524264]
Inverse tasks can be formulated as inferring a posterior distribution over data.
This is however challenging in diffusion models since the nonlinear and iterative nature of the diffusion process renders the posterior intractable.
We propose a variational approach that by design seeks to approximate the true posterior distribution.
arXiv Detail & Related papers (2023-05-07T23:00:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.