Clear Nights Ahead: Towards Multi-Weather Nighttime Image Restoration

• URL: http://arxiv.org/abs/2505.16479v1
• Date: Thu, 22 May 2025 10:06:35 GMT
• Title: Clear Nights Ahead: Towards Multi-Weather Nighttime Image Restoration
• Authors: Yuetong Liu, Yunqiu Xu, Yang Wei, Xiuli Bi, Bin Xiao,
• Abstract summary: Restoring nighttime images affected by multiple adverse weather conditions is a practical yet under-explored research problem.<n>This paper first explores the challenging multi-weather nighttime image restoration task, where various types of weather degradations are intertwined with flare effects.<n>We present ClearNight, a unified nighttime image restoration framework, which effectively removes complex degradations in one go.
• Score: 22.722301165946746
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Restoring nighttime images affected by multiple adverse weather conditions is a practical yet under-explored research problem, as multiple weather conditions often coexist in the real world alongside various lighting effects at night. This paper first explores the challenging multi-weather nighttime image restoration task, where various types of weather degradations are intertwined with flare effects. To support the research, we contribute the AllWeatherNight dataset, featuring large-scale high-quality nighttime images with diverse compositional degradations, synthesized using our introduced illumination-aware degradation generation. Moreover, we present ClearNight, a unified nighttime image restoration framework, which effectively removes complex degradations in one go. Specifically, ClearNight extracts Retinex-based dual priors and explicitly guides the network to focus on uneven illumination regions and intrinsic texture contents respectively, thereby enhancing restoration effectiveness in nighttime scenarios. In order to better represent the common and unique characters of multiple weather degradations, we introduce a weather-aware dynamic specific-commonality collaboration method, which identifies weather degradations and adaptively selects optimal candidate units associated with specific weather types. Our ClearNight achieves state-of-the-art performance on both synthetic and real-world images. Comprehensive ablation experiments validate the necessity of AllWeatherNight dataset as well as the effectiveness of ClearNight. Project page: https://henlyta.github.io/ClearNight/mainpage.html

Related papers

• The Devil is in the Darkness: Diffusion-Based Nighttime Dehazing Anchored in Brightness Perception [58.895000127068194]
  We introduce the Diffusion-Based Nighttime Dehazing framework, which excels in both data synthesis and lighting reconstruction.<n>We propose a restoration model that integrates a pre-trained diffusion model guided by a brightness perception network.<n>Experiments validate our dataset's utility and the model's superior performance in joint haze removal and brightness mapping.
  arXiv  Detail & Related papers  (2025-06-03T03:21:13Z)
• Exploring Reliable Matching with Phase Enhancement for Night-time Semantic Segmentation [58.180226179087086]
  We propose a novel end-to-end optimized approach, named NightFormer, tailored for night-time semantic segmentation. Specifically, we design a pixel-level texture enhancement module to acquire texture-aware features hierarchically with phase enhancement and amplified attention. Our proposed method performs favorably against state-of-the-art night-time semantic segmentation methods.
  arXiv  Detail & Related papers  (2024-08-25T13:59:31Z)
• Sun Off, Lights On: Photorealistic Monocular Nighttime Simulation for Robust Semantic Perception [53.631644875171595]
  Nighttime scenes are hard to semantically perceive with learned models and annotate for humans. Our method, named Sun Off, Lights On (SOLO), is the first to perform nighttime simulation on single images in a photorealistic fashion by operating in 3D. Not only is the visual quality and photorealism of our nighttime images superior to competing approaches including diffusion models, but the former images are also proven more beneficial for semantic nighttime segmentation in day-to-night adaptation.
  arXiv  Detail & Related papers  (2024-07-29T18:00:09Z)
• NocPlace: Nocturnal Visual Place Recognition via Generative and Inherited Knowledge Transfer [11.203135595002978]
  NocPlace embeds resilience against dazzling lights and extreme darkness in the global descriptor. NocPlace improves the performance of Eigenplaces by 7.6% on Tokyo 24/7 Night and 16.8% on SVOX Night.
  arXiv  Detail & Related papers  (2024-02-27T02:47:09Z)
• Illumination Distillation Framework for Nighttime Person Re-Identification and A New Benchmark [29.6321130075977]
  This paper proposes an Illumination Distillation Framework (IDF) to address the low illumination challenge in nighttime person Re-ID. IDF consists of a master branch, an illumination enhancement branch, and an illumination distillation module. We build a real-world nighttime person Re-ID dataset, named Night600, which contains 600 identities.
  arXiv  Detail & Related papers  (2023-08-31T06:45:56Z)
• Enhancing Visibility in Nighttime Haze Images Using Guided APSF and Gradient Adaptive Convolution [28.685126418090338]
  Existing nighttime dehazing methods often struggle with handling glow or low-light conditions. In this paper, we enhance the visibility from a single nighttime haze image by suppressing glow and enhancing low-light regions. Our method achieves a PSNR of 30.38dB, outperforming state-of-the-art methods by 13% on GTA5 nighttime haze dataset.
  arXiv  Detail & Related papers  (2023-08-03T12:58:23Z)
• NightHazeFormer: Single Nighttime Haze Removal Using Prior Query Transformer [39.90066556289063]
  We propose an end-to-end transformer-based framework for nighttime haze removal, called NightHazeFormer. Our proposed approach consists of two stages: supervised pre-training and semi-supervised fine-tuning. Experiments on several synthetic and real-world datasets demonstrate the superiority of our NightHazeFormer over state-of-the-art nighttime haze removal methods.
  arXiv  Detail & Related papers  (2023-05-16T15:26:09Z)
• Flare7K: A Phenomenological Nighttime Flare Removal Dataset [83.38205781536578]
  We introduce Flare7K, the first nighttime flare removal dataset. It offers 5,000 scattering and 2,000 reflective flare images, consisting of 25 types of scattering flares and 10 types of reflective flares. With the paired data, we can train deep models to restore flare-corrupted images taken in the real world effectively.
  arXiv  Detail & Related papers  (2022-10-12T20:17:24Z)
• TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions [77.20136060506906]
  We propose TransWeather, a transformer-based end-to-end model with just a single encoder and a decoder. TransWeather achieves significant improvements across multiple test datasets over both All-in-One network. It is validated on real world test images and found to be more effective than previous methods.
  arXiv  Detail & Related papers  (2021-11-29T18:57:09Z)
• Nighttime Dehazing with a Synthetic Benchmark [147.21955799938115]
  We propose a novel synthetic method called 3R to simulate nighttime hazy images from daytime clear images. We generate realistic nighttime hazy images by sampling real-world light colors from a prior empirical distribution. Experiment results demonstrate their superiority over state-of-the-art methods in terms of both image quality and runtime.
  arXiv  Detail & Related papers  (2020-08-10T02:16:46Z)
• Night-time Scene Parsing with a Large Real Dataset [67.11211537439152]
  We aim to address the night-time scene parsing (NTSP) problem, which has two main challenges. To tackle the scarcity of night-time data, we collect a novel labeled dataset, named it NightCity, of 4,297 real night-time images. We also propose an exposure-aware framework to address the NTSP problem through augmenting the segmentation process with explicitly learned exposure features.
  arXiv  Detail & Related papers  (2020-03-15T18:11:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.