UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesis

• URL: http://arxiv.org/abs/2503.11893v1
• Date: Fri, 14 Mar 2025 21:49:40 GMT
• Title: UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesis
• Abstract summary: This paper introduces UStyle, the first data-driven learning framework for transferring waterbody styles across underwater images.<n>We propose a novel depth-aware whitening and coloring transform (DA-WCT) mechanism that integrates physics-based waterbody synthesis.<n>We also introduce the UF7D dataset, a curated collection of high-resolution underwater images spanning seven distinct waterbody styles.
• Score: 3.5436187733613087
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The concept of waterbody style transfer remains largely unexplored in the underwater imaging and vision literature. Traditional image style transfer (STx) methods primarily focus on artistic and photorealistic blending, often failing to preserve object and scene geometry in images captured in high-scattering mediums such as underwater. The wavelength-dependent nonlinear attenuation and depth-dependent backscattering artifacts further complicate learning underwater image STx from unpaired data. This paper introduces UStyle, the first data-driven learning framework for transferring waterbody styles across underwater images without requiring prior reference images or scene information. We propose a novel depth-aware whitening and coloring transform (DA-WCT) mechanism that integrates physics-based waterbody synthesis to ensure perceptually consistent stylization while preserving scene structure. To enhance style transfer quality, we incorporate carefully designed loss functions that guide UStyle to maintain colorfulness, lightness, structural integrity, and frequency-domain characteristics, as well as high-level content in VGG and CLIP (contrastive language-image pretraining) feature spaces. By addressing domain-specific challenges, UStyle provides a robust framework for no-reference underwater image STx, surpassing state-of-the-art (SOTA) methods that rely solely on end-to-end reconstruction loss. Furthermore, we introduce the UF7D dataset, a curated collection of high-resolution underwater images spanning seven distinct waterbody styles, establishing a benchmark to support future research in underwater image STx. The UStyle inference pipeline and UF7D dataset are released at: https://github.com/uf-robopi/UStyle.

Related papers

• Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement [11.996160498403427]
  We propose a transfer learning-based UIE that does not require underwater images to have paired noisy or true labels for learning.<n>A novel UIE is available via transfer learning, and the physics-aligned UIE decomposition provides theoretical soundness.
  arXiv  Detail & Related papers  (2026-06-14T07:39:32Z)
• A Generative Data Framework with Authentic Supervision for Underwater Image Restoration and Enhancement [51.382274157144714]
  We develop a generative data framework based on unpaired image-to-image translation.<n>The framework constructs synthetic datasets with precise ground-truth labels.<n>Experiments show that models trained on our synthetic data achieve comparable or superior color restoration and generalization performance to those trained on existing benchmarks.
  arXiv  Detail & Related papers  (2025-11-18T14:20:17Z)
• Learning Deblurring Texture Prior from Unpaired Data with Diffusion Model [92.61216319417208]
  We propose a novel diffusion model (DM)-based framework, dubbed ours, for image deblurring.<n>ours performs DM to generate the prior knowledge that aids in recovering the textures of blurry images.<n>To fully exploit the generated texture priors, we present the Texture Transfer Transformer layer (TTformer)
  arXiv  Detail & Related papers  (2025-07-18T01:50:31Z)
• Single-Step Latent Diffusion for Underwater Image Restoration [25.229678050715496]
  Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater.<n>They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology.<n>Slurpp is over 200X faster than existing diffusion-based methods while offering 3 dB improvement in PSNR on synthetic benchmarks.
  arXiv  Detail & Related papers  (2025-07-10T16:02:07Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images. This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• HUPE: Heuristic Underwater Perceptual Enhancement with Semantic Collaborative Learning [62.264673293638175]
  Existing underwater image enhancement methods primarily focus on improving visual quality while overlooking practical implications.<n>We propose a invertible network for underwater perception enhancement, dubbed H, which enhances visual quality and demonstrates flexibility in handling other downstream tasks.
  arXiv  Detail & Related papers  (2024-11-27T12:37:03Z)
• Enhancing Underwater Imaging with 4-D Light Fields: Dataset and Method [77.80712860663886]
  4-D light fields (LFs) enhance underwater imaging plagued by light absorption, scattering, and other challenges. We propose a progressive framework for underwater 4-D LF image enhancement and depth estimation. We construct the first 4-D LF-based underwater image dataset for quantitative evaluation and supervised training of learning-based methods.
  arXiv  Detail & Related papers  (2024-08-30T15:06:45Z)
• Physics-Inspired Synthesized Underwater Image Dataset [9.117162374919715]
  PHISWID is a dataset tailored for enhancing underwater image processing through physics-inspired image synthesis.<n>Our dataset contributes to the development in underwater image processing.
  arXiv  Detail & Related papers  (2024-04-05T10:23:10Z)
• Atlantis: Enabling Underwater Depth Estimation with Stable Diffusion [30.122666238416716]
  We propose a novel pipeline for generating underwater images using accurate terrestrial depth data. This approach facilitates the training of supervised models for underwater depth estimation. We introduce a unique Depth2Underwater ControlNet, trained on specially prepared Underwater, Depth, Text data triplets.
  arXiv  Detail & Related papers  (2023-12-19T08:56:33Z)
• DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methods [0.0]
  DeepSeeColor is a novel algorithm that combines a state-of-the-art underwater image formation model with the efficiency of deep learning frameworks. We show that DeepSeeColor offers comparable performance to the popular "Sea-Thru" algorithm while being able to rapidly process images at up to 60Hz.
  arXiv  Detail & Related papers  (2023-03-07T16:38:50Z)
• Unpaired Overwater Image Defogging Using Prior Map Guided CycleGAN [60.257791714663725]
  We propose a Prior map Guided CycleGAN (PG-CycleGAN) for defogging of images with overwater scenes. The proposed method outperforms the state-of-the-art supervised, semi-supervised, and unsupervised defogging approaches.
  arXiv  Detail & Related papers  (2022-12-23T03:00:28Z)
• Depth-aware Neural Style Transfer using Instance Normalization [1.5567685129899715]
  We develop a deep residual convolutional network with instance normalization layers to integrate depth preservation as an additional loss function to content and style. Our system is capable of preserving the structure of the stylized results while exhibiting style-capture capabilities and aesthetic qualities comparable or superior to state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-17T11:11:46Z)
• Domain Adaptation for Underwater Image Enhancement via Content and Style Separation [7.077978580799124]
  Underwater image suffer from color cast, low contrast and hazy effect due to light absorption, refraction and scattering. Recent learning-based methods demonstrate astonishing performance on underwater image enhancement. We propose a domain adaptation framework for underwater image enhancement via content and style separation.
  arXiv  Detail & Related papers  (2022-02-17T09:30:29Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration [9.378355457555319]
  This paper shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain. As a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions.
  arXiv  Detail & Related papers  (2021-06-15T06:47:51Z)
• Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization [72.65828901909708]
  Controllable person image generation aims to produce realistic human images with desirable attributes. We introduce a novel Spatially-Adaptive Warped Normalization (SAWN), which integrates a learned flow-field to warp modulation parameters. We propose a novel self-training part replacement strategy to refine the pretrained model for the texture-transfer task.
  arXiv  Detail & Related papers  (2021-05-31T07:07:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.