Domain Adaptation for Underwater Image Enhancement via Content and Style Separation

• URL: http://arxiv.org/abs/2202.08537v1
• Date: Thu, 17 Feb 2022 09:30:29 GMT
• Title: Domain Adaptation for Underwater Image Enhancement via Content and Style Separation
• Authors: Yu-Wei Chen, Soo-Chang Pei
• Abstract summary: Underwater image suffer from color cast, low contrast and hazy effect due to light absorption, refraction and scattering. Recent learning-based methods demonstrate astonishing performance on underwater image enhancement. We propose a domain adaptation framework for underwater image enhancement via content and style separation.
• Score: 7.077978580799124
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Underwater image suffer from color cast, low contrast and hazy effect due to light absorption, refraction and scattering, which degraded the high-level application, e.g, object detection and object tracking. Recent learning-based methods demonstrate astonishing performance on underwater image enhancement, however, most of these works use synthesis pair data for supervised learning and ignore the domain gap to real-world data. In this paper, we propose a domain adaptation framework for underwater image enhancement via content and style separation, we assume image could be disentangled to content and style latent, and image could be clustered to the sub-domain of associated style in latent space, the goal is to build up the mapping between underwater style latent and clean one. Different from prior works of domain adaptation for underwater image enhancement, which target to minimize the latent discrepancy of synthesis and real-world data, we aim to distinguish style latent from different sub-domains. To solve the problem of lacking pair real-world data, we leverage synthesis to real image-to-image translation to obtain pseudo real underwater image pairs for supervised learning, and enhancement can be achieved by input content and clean style latent into generator. Our model provide a user interact interface to adjust different enhanced level by latent manipulation. Experiment on various public real-world underwater benchmarks demonstrate that the proposed framework is capable to perform domain adaptation for underwater image enhancement and outperform various state-of-the-art underwater image enhancement algorithms in quantity and quality. The model and source code are available at https://github.com/fordevoted/UIESS

Related papers

• DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement [77.0360085530701]
  Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
  arXiv  Detail & Related papers  (2023-12-12T06:07:21Z)
• PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators [120.06891448820447]
  How to obtain clear and visually pleasant images has become a common concern of people. The task of underwater image enhancement (UIE) has also emerged as the times require. In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN. Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
  arXiv  Detail & Related papers  (2023-06-15T07:41:12Z)
• MetaUE: Model-based Meta-learning for Underwater Image Enhancement [25.174894007563374]
  This paper proposes a model-based deep learning method for restoring clean images under various underwater scenarios. The meta-learning strategy is used to obtain a pre-trained model on the synthetic underwater dataset. The model is then fine-tuned on real underwater datasets to obtain a reliable underwater image enhancement model, called MetaUE.
  arXiv  Detail & Related papers  (2023-03-12T02:38:50Z)
• SyreaNet: A Physically Guided Underwater Image Enhancement Framework Integrating Synthetic and Real Images [17.471353846746474]
  Underwater image enhancement (UIE) is vital for high-level vision-related underwater tasks. We propose a framework textitSyreaNet for UIE that integrates both synthetic and real data.
  arXiv  Detail & Related papers  (2023-02-16T12:57:52Z)
• Adaptive Uncertainty Distribution in Deep Learning for Unsupervised Underwater Image Enhancement [1.9249287163937976]
  One of the main challenges in deep learning-based underwater image enhancement is the limited availability of high-quality training data. We propose a novel unsupervised underwater image enhancement framework that employs a conditional variational autoencoder (cVAE) to train a deep learning model. We show that our proposed framework yields competitive performance compared to other state-of-the-art approaches in quantitative as well as qualitative metrics.
  arXiv  Detail & Related papers  (2022-12-18T01:07:20Z)
• Semantic-aware Texture-Structure Feature Collaboration for Underwater Image Enhancement [58.075720488942125]
  Underwater image enhancement has become an attractive topic as a significant technology in marine engineering and aquatic robotics. We develop an efficient and compact enhancement network in collaboration with a high-level semantic-aware pretrained model. We also apply the proposed algorithm to the underwater salient object detection task to reveal the favorable semantic-aware ability for high-level vision tasks.
  arXiv  Detail & Related papers  (2022-11-19T07:50:34Z)
• Domain Adaptation for Underwater Image Enhancement [51.71570701102219]
  We propose a novel Two-phase Underwater Domain Adaptation network (TUDA) to minimize the inter-domain and intra-domain gap. In the first phase, a new dual-alignment network is designed, including a translation part for enhancing realism of input images, followed by an enhancement part. In the second phase, we perform an easy-hard classification of real data according to the assessed quality of enhanced images, where a rank-based underwater quality assessment method is embedded.
  arXiv  Detail & Related papers  (2021-08-22T06:38:19Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization [72.65828901909708]
  Controllable person image generation aims to produce realistic human images with desirable attributes. We introduce a novel Spatially-Adaptive Warped Normalization (SAWN), which integrates a learned flow-field to warp modulation parameters. We propose a novel self-training part replacement strategy to refine the pretrained model for the texture-transfer task.
  arXiv  Detail & Related papers  (2021-05-31T07:07:44Z)
• Domain Adaptive Adversarial Learning Based on Physics Model Feedback for Underwater Image Enhancement [10.143025577499039]
  We propose a new robust adversarial learning framework via physics model based feedback control and domain adaptation mechanism for enhancing underwater images. A new method for simulating underwater-like training dataset from RGB-D data by underwater image formation model is proposed. Final enhanced results on synthetic and real underwater images demonstrate the superiority of the proposed method.
  arXiv  Detail & Related papers  (2020-02-20T07:50:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.