Underwater Image Enhancement via Learning Water Type Desensitized Representations

• URL: http://arxiv.org/abs/2102.00676v1
• Date: Mon, 1 Feb 2021 07:34:54 GMT
• Title: Underwater Image Enhancement via Learning Water Type Desensitized Representations
• Authors: Zhenqi Fu, Xiaopeng Lin, Wu Wang, Yue Huang, and Xinghao Ding
• Abstract summary: We present a novel underwater image enhancement (UIE) framework termed SCNet to address the above issues. SCNet is based on normalization schemes across both spatial and channel dimensions with the key idea of learning water type desensitized features. Experimental results on two real-world UIE datasets show that the proposed approach can successfully enhance images with diverse water types.
• Score: 29.05252230912826
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For underwater applications, the effects of light absorption and scattering result in image degradation. Moreover, the complex and changeable imaging environment makes it difficult to provide a universal enhancement solution to cope with the diversity of water types. In this letter, we present a novel underwater image enhancement (UIE) framework termed SCNet to address the above issues. SCNet is based on normalization schemes across both spatial and channel dimensions with the key idea of learning water type desensitized features. Considering the diversity of degradation is mainly rooted in the strong correlation among pixels, we apply whitening to de-correlates activations across spatial dimensions for each instance in a mini-batch. We also eliminate channel-wise correlation by standardizing and re-injecting the first two moments of the activations across channels. The normalization schemes of spatial and channel dimensions are performed at each scale of the U-Net to obtain multi-scale representations. With such latent encodings, the decoder can easily reconstruct the clean signal, and unaffected by the distortion types caused by the water. Experimental results on two real-world UIE datasets show that the proposed approach can successfully enhance images with diverse water types, and achieves competitive performance in visual quality improvement.

Related papers

• WaterMamba: Visual State Space Model for Underwater Image Enhancement [17.172623370407155]
  Underwater imaging often suffers from low quality due to factors affecting light propagation and absorption in water. To improve image quality, some underwater image enhancement (UIE) methods based on convolutional neural networks (CNN) and Transformer have been proposed. Considering computational complexity and severe underwater image degradation, a state space model (SSM) with linear computational complexity for UIE, named WaterMamba, is proposed.
  arXiv  Detail & Related papers  (2024-05-14T08:26:29Z)
• AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulation [99.57024606542416]
  We propose an adaptive all-in-one image restoration network based on frequency mining and modulation. Our approach is motivated by the observation that different degradation types impact the image content on different frequency subbands. The proposed model achieves adaptive reconstruction by accentuating the informative frequency subbands according to different input degradations.
  arXiv  Detail & Related papers  (2024-03-21T17:58:14Z)
• DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement [77.0360085530701]
  Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
  arXiv  Detail & Related papers  (2023-12-12T06:07:21Z)
• UWFormer: Underwater Image Enhancement via a Semi-Supervised Multi-Scale Transformer [26.15238399758745]
  Underwater images often exhibit poor quality, distorted color balance and low contrast. Current deep learning methods rely on Neural Convolutional Networks (CNNs) that lack the multi-scale enhancement. We propose a Multi-scale Transformer-based Network for enhancing images at multiple frequencies via semi-supervised learning.
  arXiv  Detail & Related papers  (2023-10-31T06:19:09Z)
• PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators [120.06891448820447]
  How to obtain clear and visually pleasant images has become a common concern of people. The task of underwater image enhancement (UIE) has also emerged as the times require. In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN. Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
  arXiv  Detail & Related papers  (2023-06-15T07:41:12Z)
• Unpaired Overwater Image Defogging Using Prior Map Guided CycleGAN [60.257791714663725]
  We propose a Prior map Guided CycleGAN (PG-CycleGAN) for defogging of images with overwater scenes. The proposed method outperforms the state-of-the-art supervised, semi-supervised, and unsupervised defogging approaches.
  arXiv  Detail & Related papers  (2022-12-23T03:00:28Z)
• U-shape Transformer for Underwater Image Enhancement [0.0]
  In this work, we constructed a large-scale underwater image dataset including 5004 image pairs. We reported an U-shape Transformer network where the transformer model is for the first time introduced to the UIE task. In order to further improve the contrast and saturation, a novel loss function combining RGB, LAB and LCH color spaces is designed.
  arXiv  Detail & Related papers  (2021-11-23T13:15:56Z)
• Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
  We present a learning-based solution for restoring images suffering from spatially-varying degradations. We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
  arXiv  Detail & Related papers  (2021-08-19T11:02:25Z)
• Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration [9.378355457555319]
  This paper shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain. As a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions.
  arXiv  Detail & Related papers  (2021-06-15T06:47:51Z)
• Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding [88.46682991985907]
  We present an underwater image enhancement network via medium transmission-guided multi-color space embedding, called Ucolor. Our network can effectively improve the visual quality of underwater images by exploiting multiple color spaces embedding.
  arXiv  Detail & Related papers  (2021-04-27T07:35:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.