Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios

• URL: http://arxiv.org/abs/2604.08922v1
• Date: Fri, 10 Apr 2026 03:34:53 GMT
• Title: Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios
• Abstract summary: Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks.<n>This paper proposes an efficient degradation aware diffusion framework for image fusion under arbitrary degradation scenarios.
• Score: 34.660999867031386
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally simple to design and highly efficient in inference, but their black-box nature leads to limited interpretability. Diffusion based methods alleviate this to some extent by providing powerful generative priors and a more structured inference process. However, they are trained to learn a single domain target distribution, whereas fusion lacks natural fused data and relies on modeling complementary information from multiple sources, making diffusion hard to apply directly in practice. To address these challenges, this paper proposes an efficient degradation aware diffusion framework for image fusion under arbitrary degradation scenarios. Specifically, instead of explicitly predicting noise as in conventional diffusion models, our method performs implicit denoising by directly regressing the fused image, enabling flexible adaptation to diverse fusion tasks under complex degradations with limited steps. Moreover, we design a joint observation model correction mechanism that simultaneously imposes degradation and fusion constraints during sampling to ensure high reconstruction accuracy. Experiments on diverse fusion tasks and degradation configurations demonstrate the superiority of the proposed method under complex degradation scenarios.

Related papers

• UniDiffFusion: A Unified Diffusion Framework for Multi-Task and Degradation-Robust Image Fusion [14.759665227535173]
  General image fusion aims to integrate complementary information from multiple source images.<n>Existing methods often rely on task-specific models and struggle to maintain robust performance under diverse degradation conditions.<n>We propose UniDiffFusion, a unified diffusion framework for multi-task and degradation-robust image fusion.
  arXiv  Detail & Related papers  (2026-08-22T05:36:59Z)
• ZeroIDIR: Zero-Reference Illumination Degradation Image Restoration with Perturbed Consistency Diffusion Models [72.4683657127516]
  We propose a zero-reference diffusion-based framework, named ZeroIDIR, for illumination image restoration.<n>The framework decouples the restoration process into adaptive illumination correction and diffusion-based reconstruction.<n>Experiments on publicly available benchmarks show that the proposed method outperforms state-of-the-art unsupervised competitors.
  arXiv  Detail & Related papers  (2026-05-12T02:36:49Z)
• Reversible Efficient Diffusion for Image Fusion [66.35113261837469]
  Multi-modal image fusion aims to consolidate complementary information from diverse source images into a unified representation.<n>While diffusion models have demonstrated impressive generative capabilities in image generation, they often suffer from detail loss when applied to image fusion tasks.<n>This issue arises from the accumulation of noise errors inherent in the Markov process, leading to inconsistency and degradation in the fused results.<n>We propose the Reversible Efficient Diffusion (RED) model - an explicitly supervised training framework that inherits the powerful generative capability of diffusion models while avoiding the distribution estimation.
  arXiv  Detail & Related papers  (2026-01-28T05:14:55Z)
• Efficient Rectified Flow for Image Fusion [48.330480065862474]
  We propose RFfusion, an efficient one-step diffusion model for image fusion based on Rectified Flow.<n>We also propose a task-specific variational autoencoder architecture tailored for image fusion.<n>Our method outperforms other state-of-the-art methods in terms of both inference speed and fusion quality.
  arXiv  Detail & Related papers  (2025-09-20T06:21:00Z)
• Harnessing Diffusion-Yielded Score Priors for Image Restoration [29.788482710572307]
  Deep image restoration models aim to learn a mapping from degraded image space to natural image space.<n>Three major classes of methods have emerged, including MSE-based, GAN-based, and diffusion-based methods.<n>We propose a novel method, HYPIR, to address these challenges.
  arXiv  Detail & Related papers  (2025-07-28T07:55:34Z)
• Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration [64.84134880709625]
  We show that it is possible to perform domain adaptation via the noise space using diffusion models.<n>In particular, by leveraging the unique property of how auxiliary conditional inputs influence the multi-step denoising process, we derive a meaningful diffusion loss.<n>We present crucial strategies such as channel-shuffling layer and residual-swapping contrastive learning in the diffusion model.
  arXiv  Detail & Related papers  (2024-06-26T17:40:30Z)
• Decoupled Data Consistency with Diffusion Purification for Image Restoration [14.196657567791592]
  We propose a novel diffusion-based image restoration solver that addresses issues by decoupling the reverse process from the data consistency steps.<n>Our approach demonstrates versatility, making it highly adaptable for efficient problem-solving in latent space.<n>The efficacy of our approach is validated through comprehensive experiments across various image restoration tasks, including image denoising, deblurring, inpainting, and super-resolution.
  arXiv  Detail & Related papers  (2024-03-10T00:47:05Z)
• Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction [75.91471250967703]
  We introduce a novel sampling framework called Steerable Conditional Diffusion.<n>This framework adapts the diffusion model, concurrently with image reconstruction, based solely on the information provided by the available measurement.<n>We achieve substantial enhancements in out-of-distribution performance across diverse imaging modalities.
  arXiv  Detail & Related papers  (2023-08-28T08:47:06Z)
• DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion [144.9653045465908]
  We propose a novel fusion algorithm based on the denoising diffusion probabilistic model (DDPM) Our approach yields promising fusion results in infrared-visible image fusion and medical image fusion.
  arXiv  Detail & Related papers  (2023-03-13T04:06:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.