IG-Diff: Complex Night Scene Restoration with Illumination-Guided Diffusion Model

• URL: http://arxiv.org/abs/2605.14337v1
• Date: Thu, 14 May 2026 04:01:41 GMT
• Title: IG-Diff: Complex Night Scene Restoration with Illumination-Guided Diffusion Model
• Abstract summary: In nighttime circumstances, it is challenging for individuals and machines to perceive their surroundings.<n>We propose an integration of an illumination-guided module embedded in the diffusion model to guide the illumination restoration process.<n>Our model can preserve texture fidelity while contending with the adversities posed by various degradation in low-light scenarios.
• Score: 113.62837263178346
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In nighttime circumstances, it is challenging for individuals and machines to perceive their surroundings. While prevailing image restoration methods adeptly handle singular forms of degradation, they falter when confronted with intricate nocturnal scenes, such as the concurrent presence of weather and low-light conditions. Compounding this challenge, the lack of paired data that encapsulates the coexistence of low-light situations and other forms of degradation hinders the development of a comprehensive end-to-end solution. In this work, we contribute complex nighttime scene datasets that simulate both illumination degradation and other forms of deterioration. To address the complexity of night degradation, we propose an integration of an illumination-guided module embedded in the diffusion model to guide the illumination restoration process. Our model can preserve texture fidelity while contending with the adversities posed by various degradation in low-light scenarios.

Related papers

• LUCID: Learning Unified Control for Image Deflaring and Exposure Mastery in Nighttime Photography [17.65941336487973]
  LUCID is a unified framework that reframes nighttime restoration as a continuous and controllable process.<n>We decompose nighttime restoration into two cooperative components: a flare disentanglement module and a diffusion-driven module.<n> LUCID consistently outperforms state-of-the-art methods across diverse real-world nighttime scenarios.
  arXiv  Detail & Related papers  (2026-06-05T04:34:47Z)
• WeatherCycle: Unpaired Multi-Weather Restoration via Color Space Decoupled Cycle Learning [30.62082910458533]
  Unsupervised image restoration under multi-weather conditions remains a fundamental yet underexplored challenge.<n>We propose textbfWeatherCycle, a unified framework that reformulates weather restoration as a bidirectional degradation-content translation cycle.<n>Our method achieves state-of-the-art performance among unsupervised approaches, with strong generalization to complex weather degradations.
  arXiv  Detail & Related papers  (2025-09-27T06:44:27Z)
• When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration [31.345996524182127]
  We present textit Lumina-Chroma Decomposition Network (LCDN) and textit Lumina-Guided Diffusion Model (LGDM)<n> LCDN processes degraded images in the YCbCr color space, separately handling degradation-related luminance and degradation-invariant chrominance components.<n>LGDM incorporates a textitDynamic Time Step Loss to optimize the denoising network, ensuring a balanced recovery of both low- and high-frequency features in the image.
  arXiv  Detail & Related papers  (2025-09-21T10:39:06Z)
• UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting [85.27994475113056]
  We introduce a general-purpose approach that jointly estimates albedo and synthesizes relit outputs in a single pass.<n>Our model demonstrates strong generalization across diverse domains and surpasses previous methods in both visual fidelity and temporal consistency.
  arXiv  Detail & Related papers  (2025-06-18T17:56:45Z)
• The Devil is in the Darkness: Diffusion-Based Nighttime Dehazing Anchored in Brightness Perception [58.895000127068194]
  We introduce the Diffusion-Based Nighttime Dehazing framework, which excels in both data synthesis and lighting reconstruction.<n>We propose a restoration model that integrates a pre-trained diffusion model guided by a brightness perception network.<n>Experiments validate our dataset's utility and the model's superior performance in joint haze removal and brightness mapping.
  arXiv  Detail & Related papers  (2025-06-03T03:21:13Z)
• Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization [43.02033340663918]
  Comprehensive Relighting is the first all-in-one approach that can both control and harmonize the lighting from an image or video of humans with arbitrary body parts from any scene.<n>In the experiments, Comprehensive Relighting shows a strong generalizability and lighting temporal coherence, outperforming existing image-based human relighting and harmonization methods.
  arXiv  Detail & Related papers  (2025-04-03T20:10:50Z)
• RelightVid: Temporal-Consistent Diffusion Model for Video Relighting [95.10341081549129]
  RelightVid is a flexible framework for video relighting.<n>It can accept background video, text prompts, or environment maps as relighting conditions.<n>It achieves arbitrary video relighting with high temporal consistency without intrinsic decomposition.
  arXiv  Detail & Related papers  (2025-01-27T18:59:57Z)
• Night-to-Day Translation via Illumination Degradation Disentanglement [51.77716565167767]
  Night-to-Day translation aims to achieve day-like vision for nighttime scenes. processing night images with complex degradations remains a significant challenge under unpaired conditions. We propose textbfN2D3 to identify different degradation patterns in nighttime images.
  arXiv  Detail & Related papers  (2024-11-21T08:51:32Z)
• Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Dark [57.85378202032541]
  Rain in the dark poses a significant challenge to deploying real-world applications such as autonomous driving, surveillance systems, and night photography. Existing low-light enhancement or deraining methods struggle to brighten low-light conditions and remove rain simultaneously. We introduce an end-to-end model called L$2$RIRNet, designed to manage both low-light enhancement and deraining in real-world settings.
  arXiv  Detail & Related papers  (2023-05-06T10:17:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.