Sea-ing Through Scattered Rays: Revisiting the Image Formation Model for Realistic Underwater Image Generation

• URL: http://arxiv.org/abs/2509.15011v2
• Date: Fri, 19 Sep 2025 07:43:40 GMT
• Title: Sea-ing Through Scattered Rays: Revisiting the Image Formation Model for Realistic Underwater Image Generation
• Authors: Vasiliki Ismiroglou, Malte Pedersen, Stefan H. Bengtson, Andreas Aakerberg, Thomas B. Moeslund,
• Abstract summary: In this work, we propose an improved synthetic data generation pipeline that includes the commonly omitted forward scattering term.<n>We also collected the BUCKET dataset under controlled turbidity conditions to acquire real turbid footage with the corresponding reference images.<n>Our results demonstrate qualitative improvements over the reference model, particularly under increasing turbidity, with a selection rate of 82.5% by survey participants.
• Score: 17.03002065875237
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In recent years, the underwater image formation model has found extensive use in the generation of synthetic underwater data. Although many approaches focus on scenes primarily affected by discoloration, they often overlook the model's ability to capture the complex, distance-dependent visibility loss present in highly turbid environments. In this work, we propose an improved synthetic data generation pipeline that includes the commonly omitted forward scattering term, while also considering a nonuniform medium. Additionally, we collected the BUCKET dataset under controlled turbidity conditions to acquire real turbid footage with the corresponding reference images. Our results demonstrate qualitative improvements over the reference model, particularly under increasing turbidity, with a selection rate of 82.5% by survey participants. Data and code can be accessed on the project page: vap.aau.dk/sea-ing-through-scattered-rays.

Related papers

• A Generative Data Framework with Authentic Supervision for Underwater Image Restoration and Enhancement [51.382274157144714]
  We develop a generative data framework based on unpaired image-to-image translation.<n>The framework constructs synthetic datasets with precise ground-truth labels.<n>Experiments show that models trained on our synthetic data achieve comparable or superior color restoration and generalization performance to those trained on existing benchmarks.
  arXiv  Detail & Related papers  (2025-11-18T14:20:17Z)
• Single-Step Latent Diffusion for Underwater Image Restoration [25.229678050715496]
  Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater.<n>They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology.<n>Slurpp is over 200X faster than existing diffusion-based methods while offering 3 dB improvement in PSNR on synthetic benchmarks.
  arXiv  Detail & Related papers  (2025-07-10T16:02:07Z)
• Underwater Diffusion Attention Network with Contrastive Language-Image Joint Learning for Underwater Image Enhancement [0.8747606955991707]
  UDAN-CLIP is an image-to-image diffusion framework pre-trained on synthetic underwater datasets.<n>It is enhanced with a customized classifier based on vision-language model, a spatial attention module, and a novel CLIP-Diffusion loss.<n>The proposed contributions empower our UDAN-CLIP model to perform more effective underwater image enhancement.
  arXiv  Detail & Related papers  (2025-05-26T12:24:56Z)
• Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis [55.959002385347645]
  Latent Drifting enables diffusion models to be conditioned for medical images fitted for the complex task of counterfactual image generation.<n>We evaluate our method on three public longitudinal benchmark datasets of brain MRI and chest X-rays for counterfactual image generation.
  arXiv  Detail & Related papers  (2024-12-30T01:59:34Z)
• GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration [26.434359848151978]
  We introduce GenDeg, a conditional diffusion model capable of producing diverse degradation patterns on clean images.<n>We synthesize over 550k samples across six degradation types: haze, rain, snow, motion blur, low-light, and raindrops.<n>Our experiments reveal that image restoration models trained on the GenDS dataset exhibit significant improvements in out-of-distribution performance.
  arXiv  Detail & Related papers  (2024-11-26T18:55:49Z)
• Separated Attention: An Improved Cycle GAN Based Under Water Image Enhancement Method [0.0]
  We have utilized the cycle consistent learning technique of the state-of-the-art Cycle GAN model with modification in the loss function. We trained the Cycle GAN model with the modified loss functions on the benchmarked Enhancing Underwater Visual Perception dataset. The upgraded images provide better results from conventional models and further for under water navigation, pose estimation, saliency prediction, object detection and tracking.
  arXiv  Detail & Related papers  (2024-04-11T11:12:06Z)
• PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators [120.06891448820447]
  How to obtain clear and visually pleasant images has become a common concern of people. The task of underwater image enhancement (UIE) has also emerged as the times require. In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN. Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
  arXiv  Detail & Related papers  (2023-06-15T07:41:12Z)
• MetaUE: Model-based Meta-learning for Underwater Image Enhancement [25.174894007563374]
  This paper proposes a model-based deep learning method for restoring clean images under various underwater scenarios. The meta-learning strategy is used to obtain a pre-trained model on the synthetic underwater dataset. The model is then fine-tuned on real underwater datasets to obtain a reliable underwater image enhancement model, called MetaUE.
  arXiv  Detail & Related papers  (2023-03-12T02:38:50Z)
• AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models [64.24948495708337]
  Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
  arXiv  Detail & Related papers  (2022-08-24T03:13:04Z)
• Towards Generating Large Synthetic Phytoplankton Datasets for Efficient Monitoring of Harmful Algal Blooms [77.25251419910205]
  Harmful algal blooms (HABs) cause significant fish deaths in aquaculture farms. Currently, the standard method to enumerate harmful algae and other phytoplankton is to manually observe and count them under a microscope. We employ Generative Adversarial Networks (GANs) to generate synthetic images.
  arXiv  Detail & Related papers  (2022-08-03T20:15:55Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• Generating Physically-Consistent Satellite Imagery for Climate Visualizations [53.61991820941501]
  We train a generative adversarial network to create synthetic satellite imagery of future flooding and reforestation events. A pure deep learning-based model can generate flood visualizations but hallucinates floods at locations that were not susceptible to flooding. We publish our code and dataset for segmentation guided image-to-image translation in Earth observation.
  arXiv  Detail & Related papers  (2021-04-10T15:00:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.