Semihierarchical Reconstruction and Weak-area Revisiting for Robotic Visual Seafloor Mapping

• URL: http://arxiv.org/abs/2308.06147v2
• Date: Fri, 28 Jun 2024 20:37:38 GMT
• Title: Semihierarchical Reconstruction and Weak-area Revisiting for Robotic Visual Seafloor Mapping
• Abstract summary: We present a navigation-aided hierarchical reconstruction approach to facilitate the automated robotic 3D reconstruction of hectares of seafloor. Our hierarchical approach combines the advantages of SLAM and global SfM that is much more efficient than incremental SfM. This is achieved through identifying and revisiting problematic or weakly reconstructed areas, avoiding to omit images and making better use of limited dive time.
• Score: 9.994094186256442
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite impressive results achieved by many on-land visual mapping algorithms in the recent decades, transferring these methods from land to the deep sea remains a challenge due to harsh environmental conditions. Images captured by autonomous underwater vehicles (AUVs), equipped with high-resolution cameras and artificial illumination systems, often suffer from heterogeneous illumination and quality degradation caused by attenuation and scattering, on top of refraction of light rays. These challenges often result in the failure of on-land SLAM approaches when applied underwater or cause SfM approaches to exhibit drifting or omit challenging images. Consequently, this leads to gaps, jumps, or weakly reconstructed areas. In this work, we present a navigation-aided hierarchical reconstruction approach to facilitate the automated robotic 3D reconstruction of hectares of seafloor. Our hierarchical approach combines the advantages of SLAM and global SfM that is much more efficient than incremental SfM, while ensuring the completeness and consistency of the global map. This is achieved through identifying and revisiting problematic or weakly reconstructed areas, avoiding to omit images and making better use of limited dive time. The proposed system has been extensively tested and evaluated during several research cruises, demonstrating its robustness and practicality in real-world conditions.

Related papers

• Robust Image Processing Techniques for Construction Environment Monitoring Using Underwater Robots [3.430139395525602]
  This paper proposes a robust image processing framework for underwater robot-based construction environment monitoring.<n>We introduce a staged processing pipeline that sequentially models background degradation via depth-aware forward scattering and foreground degradation.<n>Experiments on real underwater datasets collected in Korean coastal environments demonstrate consistent improvements in visual quality and UIQM scores.
  arXiv  Detail & Related papers  (2026-07-02T09:12:45Z)
• Rethinking Conditional Generation for Underwater Salient Object Detection [69.38806804258452]
  A Conditional Generation Network (DCGNet) is designed to construct reliable conditional features for underwater saliency generation.<n>DCGNet significantly outperforms existing state-of-the-art methods, verifying its potential for complex underwater visual applications.
  arXiv  Detail & Related papers  (2026-07-02T07:48:06Z)
• Unified Restoration-Perception Learning: Maritime Infrared-Visible Image Fusion and Segmentation [26.524834042246408]
  Fog and strong reflections in maritime environments cause severe image degradation.<n>Fog and strong reflections in maritime environments cause severe image degradation.<n>The Infrared-Visible Maritime Ship dataset is proposed to cover various maritime scenarios under diverse weather and illumination conditions.<n>The framework includes a Frequency-Spatial Enhancement Complementary (FSEC) module for degradation suppression and structural enhancement, a Semantic-Visual Consistency Attention (SVCA) module for semantic-consistent guidance, and a cross-modality guided attention mechanism for selective fusion.
  arXiv  Detail & Related papers  (2026-03-30T13:26:05Z)
• InpaintHuman: Reconstructing Occluded Humans with Multi-Scale UV Mapping and Identity-Preserving Diffusion Inpainting [64.42884719282323]
  InpaintHuman is a novel method for generating high-fidelity, complete, and animatable avatars from occluded monocular videos.<n>Our approach employs direct pixel-level supervision to ensure identity fidelity.
  arXiv  Detail & Related papers  (2026-01-05T13:26:02Z)
• SonarSweep: Fusing Sonar and Vision for Robust 3D Reconstruction via Plane Sweeping [6.826863809223021]
  Single-modality approaches to 3D reconstruction fail due to poor visibility and geometric constraints.<n>Prior fusion technique relies on flawed geometrics, leading to significant artifacts and an inability to model complex scenes.<n>In this paper, we introduce SonarSweep, a novel, end-to-end deep learning framework that overcomes these limitations.
  arXiv  Detail & Related papers  (2025-11-01T04:12:27Z)
• APGNet: Adaptive Prior-Guided for Underwater Camouflaged Object Detection [22.097955383220143]
  We propose an Adaptive Prior-Guided Network (APGNet) to detect camouflaged objects in underwater environments.<n>APGNet integrates a Siamese architecture with a novel prior-guided mechanism to enhance robustness and detection accuracy.<n>Our proposed method APGNet outperforms 15 state-of-art methods under widely used evaluation metrics.
  arXiv  Detail & Related papers  (2025-10-14T01:51:44Z)
• Cutting-edge 3D reconstruction solutions for underwater coral reef images: A review and comparison [19.711398917623438]
  Photogrammetry-based approaches stand out among existing solutions. There remains a lack of systematic reviews of cutting-edge solutions specifically applied to underwater coral reef images. This paper focuses on the two critical stages of these approaches: camera pose estimation and dense surface reconstruction.
  arXiv  Detail & Related papers  (2025-02-27T14:53:15Z)
• UniUIR: Considering Underwater Image Restoration as An All-in-One Learner [49.35128836844725]
  We propose a Universal Underwater Image Restoration method, termed as UniUIR. To decouple degradation-specific issues and explore the inter-correlations among various degradations in UIR task, we designed the Mamba Mixture-of-Experts module. This module extracts degradation prior information in both spatial and frequency domains, and adaptively selects the most appropriate task-specific prompts.
  arXiv  Detail & Related papers  (2025-01-22T16:10:42Z)
• Advanced Underwater Image Quality Enhancement via Hybrid Super-Resolution Convolutional Neural Networks and Multi-Scale Retinex-Based Defogging Techniques [0.0]
  The research conducts extensive experiments on real-world underwater datasets to further illustrate the efficacy of the suggested approach. In real-time underwater applications like marine exploration, underwater robotics, and autonomous underwater vehicles, the combination of deep learning and conventional image processing techniques offers a computationally efficient framework with superior results.
  arXiv  Detail & Related papers  (2024-10-18T08:40:26Z)
• UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images [63.32490897641344]
  We propose a framework for reconstructing target objects from multi-view underwater images based on neural SDF. We introduce hybrid geometric priors to optimize the reconstruction process, markedly enhancing the quality and efficiency of neural SDF reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T16:33:56Z)
• Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions [48.529493393948435]
  The visible-light camera has emerged as an essential imaging sensor for marine surface vessels in intelligent waterborne transportation systems. The visual imaging quality inevitably suffers from several kinds of degradations under complex weather conditions. We develop a general-purpose multi-scene visibility enhancement method to restore degraded images captured under different weather conditions.
  arXiv  Detail & Related papers  (2024-09-02T23:46:27Z)
• An Efficient Detection and Control System for Underwater Docking using Machine Learning and Realistic Simulation: A Comprehensive Approach [5.039813366558306]
  This work compares different deep-learning architectures to perform underwater docking detection and classification. A Generative Adversarial Network (GAN) is used to do image-to-image translation, converting the Gazebo simulation image into an underwater-looking image. Results show an improvement of 20% in the high turbidity scenarios regardless of the underwater currents.
  arXiv  Detail & Related papers  (2023-11-02T18:10:20Z)
• Unpaired Overwater Image Defogging Using Prior Map Guided CycleGAN [60.257791714663725]
  We propose a Prior map Guided CycleGAN (PG-CycleGAN) for defogging of images with overwater scenes. The proposed method outperforms the state-of-the-art supervised, semi-supervised, and unsupervised defogging approaches.
  arXiv  Detail & Related papers  (2022-12-23T03:00:28Z)
• Seafloor-Invariant Caustics Removal from Underwater Imagery [0.0]
  Caustics are complex physical phenomena resulting from the projection of light rays being refracted by the wavy surface. In this work, we propose a novel method for correcting the effects of caustics on shallow underwater imagery. In particular, the developed method employs deep learning architectures in order to classify image pixels to "non-caustics" and "caustics"
  arXiv  Detail & Related papers  (2022-12-20T11:11:02Z)
• AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models [64.24948495708337]
  Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
  arXiv  Detail & Related papers  (2022-08-24T03:13:04Z)
• 6D Camera Relocalization in Visually Ambiguous Extreme Environments [79.68352435957266]
  We propose a novel method to reliably estimate the pose of a camera given a sequence of images acquired in extreme environments such as deep seas or extraterrestrial terrains. Our method achieves comparable performance with state-of-the-art methods on the indoor benchmark (7-Scenes dataset) using only 20% training data.
  arXiv  Detail & Related papers  (2022-07-13T16:40:02Z)
• HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration [18.690940762032568]
  We propose a data- and physics-driven unsupervised architecture that learns underwater vision restoration from unpaired underwater-terrestrial images. We employ the Jaffe-McGlamery degradation theory to design the generation models, and use neural networks to describe the process of underwater degradation. Our experimental results show that the proposed method is able to perform high-quality restoration for unconstrained underwater images without any supervision.
  arXiv  Detail & Related papers  (2021-07-06T15:00:30Z)
• Deep Sea Robotic Imaging Simulator [6.2122699483618]
  The largest portion of the ocean - the deep sea - still remains mostly unexplored. Deep sea images are very different from the images taken in shallow waters and this area did not get much attention from the community. This paper presents a physical model-based image simulation solution, which uses an in-air texture and depth information as inputs.
  arXiv  Detail & Related papers  (2020-06-27T16:18:32Z)
• HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagery [55.253395881190436]
  Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem. This is important for satellite monitoring of human impact on the planet. We present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion.
  arXiv  Detail & Related papers  (2020-02-15T22:17:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.