ZeroIDIR: Zero-Reference Illumination Degradation Image Restoration with Perturbed Consistency Diffusion Models
- URL: http://arxiv.org/abs/2605.11435v1
- Date: Tue, 12 May 2026 02:36:49 GMT
- Title: ZeroIDIR: Zero-Reference Illumination Degradation Image Restoration with Perturbed Consistency Diffusion Models
- Abstract summary: We propose a zero-reference diffusion-based framework, named ZeroIDIR, for illumination image restoration.<n>The framework decouples the restoration process into adaptive illumination correction and diffusion-based reconstruction.<n>Experiments on publicly available benchmarks show that the proposed method outperforms state-of-the-art unsupervised competitors.
- Score: 72.4683657127516
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose a zero-reference diffusion-based framework, named ZeroIDIR, for illumination degradation image restoration, which decouples the restoration process into adaptive illumination correction and diffusion-based reconstruction while being trained solely on low-quality degraded images. Specifically, we design an adaptive gamma correction module that performs spatially varying exposure correction to generate illumination-corrected only representations to mitigate exposure bias and serve as reliable inputs for subsequent diffusion processes, where a histogram-guided illumination correction loss is introduced to regularize the corrected illumination distribution toward that of natural scenes. Subsequently, the illumination-corrected image is treated as an intermediate noisy state for the proposed perturbed consistency diffusion model to reconstruct details and suppress noise. Moreover, a perturbed diffusion consistency loss is proposed to constrain the forward diffusion trajectory of the final restored image to remain consistent with the perturbed state, thus improving restoration fidelity and stability in the absence of supervision. Extensive experiments on publicly available benchmarks show that the proposed method outperforms state-of-the-art unsupervised competitors and is comparable to supervised methods while being more generalizable to various scenes. Code is available at https://github.com/JianghaiSCU/ZeroIDIR.
Related papers
- ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Models [52.648413887350195]
We propose Stage-Aware RoPE Remapping to suppress global repetition, local repetition, and detail degradation.<n>We also propose Entropy-Driven Adaptive Attention, which quantifies dispersion via a resolution-invariant normalized entropy.<n>Our method consistently outperforms prior resolution-extrapolation methods in both structural coherence and fine-detail fidelity.
arXiv Detail & Related papers (2026-05-11T06:14:38Z) - Single-Stage Signal Attenuation Diffusion Model for Low-Light Image Enhancement and Denoising [4.397450561168298]
Diffusion models excel at image restoration via probabilistic modeling of forward noise addition and reverse denoising.<n>Mainstream diffusion based Low-Light Image Enhancement (LLIE) methods either adopt a two-stage pipeline or an auxiliary correction network to refine U-Net outputs.<n>We propose the Signal Attenuation Diffusion Model (SADM), a novel diffusion process that integrates the signal attenuation mechanism into the diffusion pipeline.
arXiv Detail & Related papers (2026-04-07T11:33:04Z) - Your Pre-trained Diffusion Model Secretly Knows Restoration [55.7186754179308]
We show that pre-trained diffusion models inherently possess restoration behavior, which can be unlocked by directly learning prompt embeddings.<n>We introduce our lightweight learned prompts on the pre-trained WAN video model and FLUX image models, converting them into high-performing restoration models.
arXiv Detail & Related papers (2026-04-06T17:59:04Z) - Rethinking Exposure Correction for Spatially Non-uniform Degradation [41.78840354779858]
We propose a new exposure correction paradigm designed for spatial non-uniformity.<n>Specifically, we introduce a Spatial Signal to predict spatially adaptive modulation weights.<n>Our method achieves superior qualitative and quantitative performance compared with state-of-the-art methods.
arXiv Detail & Related papers (2026-04-05T14:41:59Z) - WEC-DG: Multi-Exposure Wavelet Correction Method Guided by Degradation Description [7.873244458995218]
Multi-exposure correction technology is essential for restoring images affected by insufficient or excessive lighting.<n>Current multi-exposure correction methods often encounter challenges in addressing intra-class variability caused by diverse lighting conditions.<n>This paper proposes a Wavelet-based Exposure Correction method with Degradation Guidance (WEC-DG)
arXiv Detail & Related papers (2025-08-13T07:31:44Z) - Degradation-Consistent Learning via Bidirectional Diffusion for Low-Light Image Enhancement [15.619960776528362]
Low-light image enhancement aims to improve the visibility of degraded images to better align with human visual perception.<n>We propose a bidirectional diffusion optimization mechanism that jointly models the degradation processes of both low-light and normal-light images.<n>Our method outperforms state-of-the-art methods in both quantitative and qualitative evaluations.
arXiv Detail & Related papers (2025-07-24T07:21:23Z) - LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models [39.28266945709169]
We propose a diffusion-based unsupervised framework that incorporates physically explainable Retinex theory with diffusion models for low-light image enhancement.
Experiments on publicly available real-world benchmarks show that the proposed LightenDiffusion outperforms state-of-the-art unsupervised competitors.
arXiv Detail & Related papers (2024-07-12T02:54:43Z) - JoReS-Diff: Joint Retinex and Semantic Priors in Diffusion Model for Low-light Image Enhancement [69.6035373784027]
Low-light image enhancement (LLIE) has achieved promising performance by employing conditional diffusion models.
Previous methods may neglect the importance of a sufficient formulation of task-specific condition strategy.
We propose JoReS-Diff, a novel approach that incorporates Retinex- and semantic-based priors as the additional pre-processing condition.
arXiv Detail & Related papers (2023-12-20T08:05:57Z) - Reti-Diff: Illumination Degradation Image Restoration with Retinex-based
Latent Diffusion Model [59.08821399652483]
Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination.
Among these algorithms, diffusion model (DM)-based methods have shown promising performance but are often burdened by heavy computational demands and pixel misalignment issues when predicting the image-level distribution.
We propose to leverage DM within a compact latent space to generate concise guidance priors and introduce a novel solution called Reti-Diff for the IDIR task.
Reti-Diff comprises two key components: the Retinex-based latent DM (RLDM) and the Retinex-guided transformer (RG
arXiv Detail & Related papers (2023-11-20T09:55:06Z) - Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction [75.91471250967703]
We introduce a novel sampling framework called Steerable Conditional Diffusion.<n>This framework adapts the diffusion model, concurrently with image reconstruction, based solely on the information provided by the available measurement.<n>We achieve substantial enhancements in out-of-distribution performance across diverse imaging modalities.
arXiv Detail & Related papers (2023-08-28T08:47:06Z) - Low-Light Image Enhancement with Wavelet-based Diffusion Models [50.632343822790006]
Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration.
We propose a robust and efficient Diffusion-based Low-Light image enhancement approach, dubbed DiffLL.
arXiv Detail & Related papers (2023-06-01T03:08:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.