Dual High-Order Total Variation Model for Underwater Image Restoration

• URL: http://arxiv.org/abs/2407.14868v1
• Date: Sat, 20 Jul 2024 13:06:37 GMT
• Title: Dual High-Order Total Variation Model for Underwater Image Restoration
• Authors: Yuemei Li, Guojia Hou, Peixian Zhuang, Zhenkuan Pan,
• Abstract summary: Underwater image enhancement and restoration (UIER) is one crucial mode to improve the visual quality of underwater images. We propose an effective variational framework based on an extended underwater image formation model (UIFM) In our proposed framework, the weight factors-based color compensation is combined with the color balance to compensate for the attenuated color channels and remove the color cast.
• Score: 13.789310785350484
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Underwater images are typically characterized by color cast, haze, blurring, and uneven illumination due to the selective absorption and scattering when light propagates through the water, which limits their practical applications. Underwater image enhancement and restoration (UIER) is one crucial mode to improve the visual quality of underwater images. However, most existing UIER methods concentrate on enhancing contrast and dehazing, rarely pay attention to the local illumination differences within the image caused by illumination variations, thus introducing some undesirable artifacts and unnatural color. To address this issue, an effective variational framework is proposed based on an extended underwater image formation model (UIFM). Technically, dual high-order regularizations are successfully integrated into the variational model to acquire smoothed local ambient illuminance and structure-revealed reflectance in a unified manner. In our proposed framework, the weight factors-based color compensation is combined with the color balance to compensate for the attenuated color channels and remove the color cast. In particular, the local ambient illuminance with strong robustness is acquired by performing the local patch brightest pixel estimation and an improved gamma correction. Additionally, we design an iterative optimization algorithm relying on the alternating direction method of multipliers (ADMM) to accelerate the solution of the proposed variational model. Considerable experiments on three real-world underwater image datasets demonstrate that the proposed method outperforms several state-of-the-art methods with regard to visual quality and quantitative assessments. Moreover, the proposed method can also be extended to outdoor image dehazing, low-light image enhancement, and some high-level vision tasks. The code is available at https://github.com/Hou-Guojia/UDHTV.

Related papers

• Diving into Darkness: A Dual-Modulated Framework for High-Fidelity Super-Resolution in Ultra-Dark Environments [51.58771256128329]
  This paper proposes a specialized dual-modulated learning framework that attempts to deeply dissect the nature of the low-light super-resolution task. We develop Illuminance-Semantic Dual Modulation (ISDM) components to enhance feature-level preservation of illumination and color details. Comprehensive experiments showcases the applicability and generalizability of our approach to diverse and challenging ultra-low-light conditions.
  arXiv  Detail & Related papers  (2023-09-11T06:55:32Z)
• WaterFlow: Heuristic Normalizing Flow for Underwater Image Enhancement and Beyond [52.27796682972484]
  Existing underwater image enhancement methods mainly focus on image quality improvement, ignoring the effect on practice. We propose a normalizing flow for detection-driven underwater image enhancement, dubbed WaterFlow. Considering the differentiability and interpretability, we incorporate the prior into the data-driven mapping procedure.
  arXiv  Detail & Related papers  (2023-08-02T04:17:35Z)
• LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancement [118.83316133601319]
  Current deep learning methods for low-light image enhancement (LLIE) typically rely on pixel-wise mapping learned from paired data. We propose a degradation-aware learning scheme for LLIE using diffusion models, which effectively integrates degradation and image priors into the diffusion process.
  arXiv  Detail & Related papers  (2023-07-27T07:22:51Z)
• PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators [120.06891448820447]
  How to obtain clear and visually pleasant images has become a common concern of people. The task of underwater image enhancement (UIE) has also emerged as the times require. In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN. Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
  arXiv  Detail & Related papers  (2023-06-15T07:41:12Z)
• Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding [88.46682991985907]
  We present an underwater image enhancement network via medium transmission-guided multi-color space embedding, called Ucolor. Our network can effectively improve the visual quality of underwater images by exploiting multiple color spaces embedding.
  arXiv  Detail & Related papers  (2021-04-27T07:35:30Z)
• Enhancing Underwater Image via Adaptive Color and Contrast Enhancement, and Denoising [2.298932494750101]
  We propose an adaptive color and contrast enhancement, and denoising (ACCE-D) framework for underwater image enhancement. We derive a numerical solution for ACCE, and adopt a pyramid-based strategy to accelerate the solving procedure. Experimental results demonstrate that our strategy is effective in color correction, visibility improvement, and detail revealing.
  arXiv  Detail & Related papers  (2021-04-02T14:37:20Z)
• Degrade is Upgrade: Learning Degradation for Low-light Image Enhancement [52.49231695707198]
  We investigate the intrinsic degradation and relight the low-light image while refining the details and color in two steps. Inspired by the color image formulation, we first estimate the degradation from low-light inputs to simulate the distortion of environment illumination color, and then refine the content to recover the loss of diffuse illumination color. Our proposed method has surpassed the SOTA by 0.95dB in PSNR on LOL1000 dataset and 3.18% in mAP on ExDark dataset.
  arXiv  Detail & Related papers  (2021-03-19T04:00:27Z)
• Underwater Image Color Correction by Complementary Adaptation [0.0]
  We propose a novel approach for underwater image color correction based on a Tikhonov type optimization model in the CIELAB color space. Understood as a long-term adaptive process, our method effectively removes the underwater color cast and yields a balanced color distribution.
  arXiv  Detail & Related papers  (2020-10-21T03:59:22Z)
• Low-Light Maritime Image Enhancement with Regularized Illumination Optimization and Deep Noise Suppression [5.401654133604235]
  We propose to enhance the low-light images through regularized illumination optimization and deep noise suppression. Comprehensive experiments have been conducted on both synthetic and realistic maritime images to compare our proposed method with several state-of-the-art imaging methods.
  arXiv  Detail & Related papers  (2020-08-09T17:05:23Z)
• Low-light Image Enhancement Using the Cell Vibration Model [12.400040803969501]
  Low light very likely leads to the degradation of an image's quality and even causes visual task failures. We propose a new single low-light image lightness enhancement method. Experimental results show that the proposed algorithm is superior to nine state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-06-03T13:39:10Z)
• Underwater image enhancement with Image Colorfulness Measure [7.292965806774365]
  We propose a novel enhancement model, which is a trainable end-to-end neural model. For better details, contrast and colorfulness, this enhancement network is jointly optimized by the pixel-level and characteristiclevel training criteria.
  arXiv  Detail & Related papers  (2020-04-18T12:44:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.