Non-aligned supervision for Real Image Dehazing

• URL: http://arxiv.org/abs/2303.04940v4
• Date: Fri, 5 Jan 2024 07:04:09 GMT
• Title: Non-aligned supervision for Real Image Dehazing
• Authors: Junkai Fan, Fei Guo, Jianjun Qian, Xiang Li, Jun Li and Jian Yang
• Abstract summary: We propose an innovative dehazing framework that operates under non-aligned supervision. In particular, we explore a non-alignment scenario that a clear reference image, unaligned with the input hazy image, is utilized to supervise the dehazing network. Our scenario makes it easier to collect hazy/clear image pairs in real-world environments, even under conditions of misalignment and shift views.
• Score: 25.078264991940806
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Removing haze from real-world images is challenging due to unpredictable weather conditions, resulting in the misalignment of hazy and clear image pairs. In this paper, we propose an innovative dehazing framework that operates under non-aligned supervision. This framework is grounded in the atmospheric scattering model, and consists of three interconnected networks: dehazing, airlight, and transmission networks. In particular, we explore a non-alignment scenario that a clear reference image, unaligned with the input hazy image, is utilized to supervise the dehazing network. To implement this, we present a multi-scale reference loss that compares the feature representations between the referred image and the dehazed output. Our scenario makes it easier to collect hazy/clear image pairs in real-world environments, even under conditions of misalignment and shift views. To showcase the effectiveness of our scenario, we have collected a new hazy dataset including 415 image pairs captured by mobile Phone in both rural and urban areas, called "Phone-Hazy". Furthermore, we introduce a self-attention network based on mean and variance for modeling real infinite airlight, using the dark channel prior as positional guidance. Additionally, a channel attention network is employed to estimate the three-channel transmission. Experimental results demonstrate the superior performance of our framework over existing state-of-the-art techniques in the real-world image dehazing task. Phone-Hazy and code will be available at https://fanjunkai1.github.io/projectpage/NSDNet/index.html.

Related papers

• WTCL-Dehaze: Rethinking Real-world Image Dehazing via Wavelet Transform and Contrastive Learning [17.129068060454255]
  Single image dehazing is essential for applications such as autonomous driving and surveillance. We propose an enhanced semi-supervised dehazing network that integrates Contrastive Loss and Discrete Wavelet Transform. Our proposed algorithm achieves superior performance and improved robustness compared to state-of-the-art single image dehazing methods.
  arXiv  Detail & Related papers  (2024-10-07T05:36:11Z)
• NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes [49.92839157944134]
  In nighttime driving scenes, insufficient and uneven lighting shrouds the scenes in darkness, resulting degradation of image quality and visibility. We develop an image de-raining framework tailored for rainy nighttime driving scenes. It aims to remove rain artifacts, enrich scene representation, and restore useful information.
  arXiv  Detail & Related papers  (2024-02-28T09:02:33Z)
• ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Rendering [83.75284107397003]
  We introduce ScatterNeRF, a neural rendering method which renders scenes and decomposes the fog-free background. We propose a disentangled representation for the scattering volume and the scene objects, and learn the scene reconstruction with physics-inspired losses. We validate our method by capturing multi-view In-the-Wild data and controlled captures in a large-scale fog chamber.
  arXiv  Detail & Related papers  (2023-05-03T13:24:06Z)
• SCANet: Self-Paced Semi-Curricular Attention Network for Non-Homogeneous Image Dehazing [56.900964135228435]
  Existing homogeneous dehazing methods struggle to handle the non-uniform distribution of haze in a robust manner. We propose a novel self-paced semi-curricular attention network, called SCANet, for non-homogeneous image dehazing. Our approach consists of an attention generator network and a scene reconstruction network.
  arXiv  Detail & Related papers  (2023-04-17T17:05:29Z)
• UCL-Dehaze: Towards Real-world Image Dehazing via Unsupervised Contrastive Learning [57.40713083410888]
  This paper explores contrastive learning with an adversarial training effort to leverage unpaired real-world hazy and clean images. We propose an effective unsupervised contrastive learning paradigm for image dehazing, dubbed UCL-Dehaze. We conduct comprehensive experiments to evaluate our UCL-Dehaze and demonstrate its superiority over the state-of-the-arts.
  arXiv  Detail & Related papers  (2022-05-04T03:25:13Z)
• From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real Data [58.50411487497146]
  We propose a novel image dehazing framework collaborating with unlabeled real data. First, we develop a disentangled image dehazing network (DID-Net), which disentangles the feature representations into three component maps. Then a disentangled-consistency mean-teacher network (DMT-Net) is employed to collaborate unlabeled real data for boosting single image dehazing.
  arXiv  Detail & Related papers  (2021-08-06T04:00:28Z)
• Contrastive Learning for Compact Single Image Dehazing [41.83007400559068]
  We propose a novel contrastive regularization (CR) built upon contrastive learning to exploit both the information of hazy images and clear images as negative and positive samples. CR ensures that the restored image is pulled to closer to the clear image and pushed to far away from the hazy image in the representation space. Considering trade-off between performance and memory storage, we develop a compact dehazing network based on autoencoder-like framework.
  arXiv  Detail & Related papers  (2021-04-19T14:56:21Z)
• Dehaze-GLCGAN: Unpaired Single Image De-hazing via Adversarial Training [3.5788754401889014]
  We propose a dehazing Global-Local Cycle-consistent Generative Adversarial Network (Dehaze-GLCGAN) for single image de-hazing. Our experiments over three benchmark datasets show that our network outperforms previous work in terms of PSNR and SSIM.
  arXiv  Detail & Related papers  (2020-08-15T02:43:00Z)
• You Only Look Yourself: Unsupervised and Untrained Single Image Dehazing Neural Network [63.2086502120071]
  We study how to make deep learning achieve image dehazing without training on the ground-truth clean image (unsupervised) and a image collection (untrained) An unsupervised neural network will avoid the intensive labor collection of hazy-clean image pairs, and an untrained model is a real'' single image dehazing approach. Motivated by the layer disentanglement idea, we propose a novel method, called you only look yourself (textbfYOLY) which could be one of the first unsupervised and untrained neural networks for image dehazing.
  arXiv  Detail & Related papers  (2020-06-30T14:05:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.