NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Images

• URL: http://arxiv.org/abs/2412.15890v2
• Date: Sat, 11 Jan 2025 08:09:56 GMT
• Title: NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Images
• Authors: Yue Guo, Haoxiang Liao, Haibin Ling, Bingyao Huang,
• Abstract summary: Underwater image restoration aims to remove geometric and color distortions due to water refraction, absorption and scattering. We propose NeuroPump, a self-supervised method to simultaneously optimize and rectify underwater geometry and color as if water were pumped out.
• Score: 52.863935209616635
• License:
• Abstract: Underwater image restoration aims to remove geometric and color distortions due to water refraction, absorption and scattering. Previous studies focus on restoring either color or the geometry, but to our best knowledge, not both. However, in practice it may be cumbersome to address the two rectifications one-by-one. In this paper, we propose NeuroPump, a self-supervised method to simultaneously optimize and rectify underwater geometry and color as if water were pumped out. The key idea is to explicitly model refraction, absorption and scattering in Neural Radiance Field (NeRF) pipeline, such that it not only performs simultaneous geometric and color rectification, but also enables to synthesize novel views and optical effects by controlling the decoupled parameters. In addition, to address issue of lack of real paired ground truth images, we propose an underwater 360 benchmark dataset that has real paired (i.e., with and without water) images. Our method clearly outperforms other baselines both quantitatively and qualitatively. Our project page is available at: https://ygswu.github.io/NeuroPump.github.io/.

Related papers

• U2NeRF: Unsupervised Underwater Image Restoration and Neural Radiance Fields [20.30434798359958]
  We present Unsupervised Underwater Neural Radiance Field U2NeRF, a transformer-based architecture that learns to render and restore novel views conditioned on multi-view geometry simultaneously. We release an Underwater View Synthesis UVS dataset consisting of 12 underwater scenes, containing both synthetically-generated and real-world data.
  arXiv  Detail & Related papers  (2024-11-25T08:02:28Z)
• Physics Informed and Data Driven Simulation of Underwater Images via Residual Learning [5.095097384893417]
  In general, underwater images suffer from color distortion and low contrast, because light is attenuated and backscattered as it propagates through water. An existing simple degradation model (similar to atmospheric image "hazing" effects) is not sufficient to properly represent the underwater image degradation. We propose a deep learning-based architecture to automatically simulate the underwater effects.
  arXiv  Detail & Related papers  (2024-02-07T21:53:28Z)
• Beyond NeRF Underwater: Learning Neural Reflectance Fields for True Color Correction of Marine Imagery [16.16700041031569]
  Underwater imagery often exhibits distorted coloration as a result of light-water interactions. We propose an algorithm to restore the true color (albedo) in underwater imagery by jointly learning the effects of the medium and neural scene representations.
  arXiv  Detail & Related papers  (2023-04-06T21:29:34Z)
• Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container [61.50401406132946]
  Transparent enclosures pose challenges of multiple light reflections and refractions at the interface between different propagation media. We use an existing neural reconstruction method (NeuS) that implicitly represents the geometry and appearance of the inner subspace. In order to account for complex light interactions, we develop a hybrid rendering strategy that combines volume rendering with ray tracing.
  arXiv  Detail & Related papers  (2023-03-24T04:58:27Z)
• GECCO: Geometrically-Conditioned Point Diffusion Models [60.28388617034254]
  Diffusion models generating images conditionally on text have recently made a splash far beyond the computer vision community. Here, we tackle the related problem of generating point clouds, both unconditionally, and conditionally with images. For the latter, we introduce a novel geometrically-motivated conditioning scheme based on projecting sparse image features into the point cloud.
  arXiv  Detail & Related papers  (2023-03-10T13:45:44Z)
• DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methods [0.0]
  DeepSeeColor is a novel algorithm that combines a state-of-the-art underwater image formation model with the efficiency of deep learning frameworks. We show that DeepSeeColor offers comparable performance to the popular "Sea-Thru" algorithm while being able to rapidly process images at up to 60Hz.
  arXiv  Detail & Related papers  (2023-03-07T16:38:50Z)
• Seafloor-Invariant Caustics Removal from Underwater Imagery [0.0]
  Caustics are complex physical phenomena resulting from the projection of light rays being refracted by the wavy surface. In this work, we propose a novel method for correcting the effects of caustics on shallow underwater imagery. In particular, the developed method employs deep learning architectures in order to classify image pixels to "non-caustics" and "caustics"
  arXiv  Detail & Related papers  (2022-12-20T11:11:02Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• ShaRF: Shape-conditioned Radiance Fields from a Single View [54.39347002226309]
  We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object. We demonstrate in several experiments the effectiveness of our approach in both synthetic and real images.
  arXiv  Detail & Related papers  (2021-02-17T16:40:28Z)
• Learning to Restore a Single Face Image Degraded by Atmospheric Turbulence using CNNs [93.72048616001064]
  Images captured under such condition suffer from a combination of geometric deformation and space varying blur. We present a deep learning-based solution to the problem of restoring a turbulence-degraded face image.
  arXiv  Detail & Related papers  (2020-07-16T15:25:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.