WaterGen: Decoupling Scene and Medium in Underwater Image Generation

• URL: http://arxiv.org/abs/2606.31147v1
• Date: Tue, 30 Jun 2026 05:19:38 GMT
• Title: WaterGen: Decoupling Scene and Medium in Underwater Image Generation
• Abstract summary: We introduce WaterGen, a method for generating large-scale, realistic, and diverse underwater images.<n>Our approach treats underwater image generation as the decoupled control of two factors: realistic and diverse scene content and accurate and controllable water medium effects.<n>We leverage WaterGen to build large-scale synthetic underwater datasets that are diverse in scene structures and accurate in water effects and pseudo-labels.
• Score: 21.984874882126288
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Underwater computer vision tasks, such as detection, restoration, and segmentation, are limited by the scarcity of large-scale and diverse training data. We introduce WaterGen, a method for generating large-scale, realistic, and diverse underwater images that provides independent control of the scene and water medium conditions. Our approach treats underwater image generation as the decoupled control of two factors: realistic and diverse scene content (what is in the image), and accurate and controllable water medium effects (what the water does to the image). Existing methods generally achieve only part of this objective: they either provide controllability with limited realism or diversity, or generate realistic scenes without accurately and independently modeling water-medium effects. Our key insight, that allows us to avoid this compromise, is that scene generation and medium modeling can be decoupled within a latent diffusion framework, enabling diverse scene generation together with accurate and controllable underwater appearance. To do this, we decompose underwater image synthesis into two stages. First, we fine-tune the latent diffusion U-Net using degradation-free underwater images so that it learns to generate diverse and realistic latent embeddings of underwater scene content without medium-induced degradation. Second, we formulate the physically accurate medium degradation synthesis as a conditional decoding process applied to these latent embeddings. This decoupled design allows our model to generate diverse scenes with full control of underwater appearance. We leverage WaterGen to build large-scale synthetic underwater datasets that are diverse in scene structures and accurate in water effects and pseudo-labels. We demonstrate that our synthetic data consistently improve downstream performance in underwater restoration and semantic segmentation.

Related papers

• 3D-USE: From Image-Level to Scene-Level Underwater Enhancement [54.11922584483346]
  Underwater Scene-level Enhancement (USE)<n>Uses a reliable scene representation for enhancement and a consistent enhancement target without paired enhanced 3D data.<n> Experiments on real underwater scenes show improved visibility and cross-view consistency while preserving reconstruction quality.
  arXiv  Detail & Related papers  (2026-08-28T07:34:13Z)
• Ocean4D: Generative Underwater 4D Reconstruction via Medium-Aware Video Diffusion [53.39217286144327]
  We propose a generative framework for underwater 4D reconstruction, named Ocean4D.<n>4D-GCC constructs 4D geometrically consistent conditioning with improved cross-frame coverage.<n>The Medium-Aware Block performs implicit medium-aware denoising in the latent diffusion process to stabilize underwater appearance.
  arXiv  Detail & Related papers  (2026-06-22T13:10:26Z)
• A Generative Data Framework with Authentic Supervision for Underwater Image Restoration and Enhancement [51.382274157144714]
  We develop a generative data framework based on unpaired image-to-image translation.<n>The framework constructs synthetic datasets with precise ground-truth labels.<n>Experiments show that models trained on our synthetic data achieve comparable or superior color restoration and generalization performance to those trained on existing benchmarks.
  arXiv  Detail & Related papers  (2025-11-18T14:20:17Z)
• Optical Ocean Recipes: Creating Realistic Datasets to Facilitate Underwater Vision Research [0.0]
  We introduce a framework for creating realistic datasets under controlled underwater conditions.<n>Unlike synthetic or open-water data, these recipes, using calibrated color and scattering additives, enable repeatable and controlled testing of the impact of water composition on image appearance.<n>The controlled environment enables the creation of ground-truth data for a range of vision tasks, including water parameter estimation, image restoration, segmentation, visual SLAM, and underwater image synthesis.
  arXiv  Detail & Related papers  (2025-09-24T14:36:35Z)
• Single-Step Latent Diffusion for Underwater Image Restoration [25.229678050715496]
  Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater.<n>They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology.<n>Slurpp is over 200X faster than existing diffusion-based methods while offering 3 dB improvement in PSNR on synthetic benchmarks.
  arXiv  Detail & Related papers  (2025-07-10T16:02:07Z)
• Learning Underwater Active Perception in Simulation [51.205673783866146]
  Turbidity can jeopardise the whole mission as it may prevent correct visual documentation of the inspected structures.<n>Previous works have introduced methods to adapt to turbidity and backscattering.<n>We propose a simple yet efficient approach to enable high-quality image acquisition of assets in a broad range of water conditions.
  arXiv  Detail & Related papers  (2025-04-23T06:48:38Z)
• AquaFuse: Waterbody Fusion for Physics Guided View Synthesis of Underwater Scenes [6.535472265307327]
  We introduce the idea of AquaFuse, a physics-based method for synthesizing waterbody properties in underwater imagery.<n>We find that the AquaFused images preserve over 94% depth consistency and 90-95% structural similarity of the input scenes.
  arXiv  Detail & Related papers  (2024-11-02T03:20:06Z)
• Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering [56.68286440268329]
  correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials. We propose using a personalized large diffusion model as guidance to a physically based inverse rendering process. Our method recovers scene lighting and tone-mapping parameters, allowing the photorealistic composition of arbitrary virtual objects in single frames or videos of indoor or outdoor scenes.
  arXiv  Detail & Related papers  (2024-08-19T05:15:45Z)
• PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators [120.06891448820447]
  How to obtain clear and visually pleasant images has become a common concern of people. The task of underwater image enhancement (UIE) has also emerged as the times require. In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN. Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
  arXiv  Detail & Related papers  (2023-06-15T07:41:12Z)
• MetaUE: Model-based Meta-learning for Underwater Image Enhancement [25.174894007563374]
  This paper proposes a model-based deep learning method for restoring clean images under various underwater scenarios. The meta-learning strategy is used to obtain a pre-trained model on the synthetic underwater dataset. The model is then fine-tuned on real underwater datasets to obtain a reliable underwater image enhancement model, called MetaUE.
  arXiv  Detail & Related papers  (2023-03-12T02:38:50Z)
• Domain Adaptation for Underwater Image Enhancement via Content and Style Separation [7.077978580799124]
  Underwater image suffer from color cast, low contrast and hazy effect due to light absorption, refraction and scattering. Recent learning-based methods demonstrate astonishing performance on underwater image enhancement. We propose a domain adaptation framework for underwater image enhancement via content and style separation.
  arXiv  Detail & Related papers  (2022-02-17T09:30:29Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.