Real-Time Dense 3D Mapping of Underwater Environments

• URL: http://arxiv.org/abs/2304.02704v1
• Date: Wed, 5 Apr 2023 18:57:35 GMT
• Title: Real-Time Dense 3D Mapping of Underwater Environments
• Abstract summary: This paper addresses real-time dense 3D reconstruction for a resource-constrained Autonomous Underwater Vehicle (AUV) Underwater vision-guided operations are among the most challenging as they combine 3D motion in the presence of external forces, limited visibility, and absence of global positioning. Our pipeline produces comparable reconstruction with that of COLMAP, the state-of-the-art offline 3D reconstruction method, at high frame rates on a single CPU.
• Score: 8.264747090866754
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper addresses real-time dense 3D reconstruction for a resource-constrained Autonomous Underwater Vehicle (AUV). Underwater vision-guided operations are among the most challenging as they combine 3D motion in the presence of external forces, limited visibility, and absence of global positioning. Obstacle avoidance and effective path planning require online dense reconstructions of the environment. Autonomous operation is central to environmental monitoring, marine archaeology, resource utilization, and underwater cave exploration. To address this problem, we propose to use SVIn2, a robust VIO method, together with a real-time 3D reconstruction pipeline. We provide extensive evaluation on four challenging underwater datasets. Our pipeline produces comparable reconstruction with that of COLMAP, the state-of-the-art offline 3D reconstruction method, at high frame rates on a single CPU.

Related papers

• DA-NBV: A Direction-Aware Next-Best-View Planner for Efficient 3D Reconstruction of Ships at Sea [33.705943749594304]
  We propose DA-NBV, a direction-aware NBV policy that augments the conventional occupancy state with directional observation statistics.<n> Experiments show that DA-NBV improves reconstruction completeness by approximately 3 percentage points and reduces Chamfer distance by 43% while achieving higher path efficiency.
  arXiv  Detail & Related papers  (2026-08-08T09:19:31Z)
• A Vision-based Control Framework for Real-time Autonomous UUV Operations [1.293050392312921]
  This paper presents a vision-based framework for real-time and robust localization, autonomous navigation, and mapping for unmanned underwater vehicles (UUVs)<n>The proposed pipeline enables both net-relative and global localization while generating continuous 3D maps of the surroundings in real-time.<n>Results demonstrate real-time performance and enhanced robustness, supporting vision-driven autonomous navigation.
  arXiv  Detail & Related papers  (2026-08-05T11:43:30Z)
• WAT3R: Feedforward Underwater 3D Reconstruction [33.441820956688396]
  WAT3R is a feed-forward framework for reconstructing 3D scenes directly from underwater images.<n>By leveraging adaptation as a geometry-constrained process, WAT3R integrates a lightweight neural adaptation module.<n>We show that WAT3R consistently outperforms state-of-the-art approaches on 3D reconstruction tasks.
  arXiv  Detail & Related papers  (2026-07-23T08:07:43Z)
• Wat3R: Underwater 3D Geometry Learning without Annotations [58.91163632674025]
  Estimating 3D geometry in underwater environments presents unique challenges due to light attenuation, scattering, and the absence of large-scale, high-quality 3D annotations.<n>We propose Wat3R, a cross-domain semi-supervised learning framework designed to adapt feed-forward 3D reconstruction models from air to underwater scenes.
  arXiv  Detail & Related papers  (2026-07-09T17:59:58Z)
• Towards 3D karst underwater scene reconstruction from rotating sonar data [4.98552535993062]
  We present a pipeline for reconstructing underwater karst conduits from a sonar profiler.<n>We combine a continuous-time SLAM approach to correct trajectory drift with a novel two-stage deep learning method for surface reconstruction.
  arXiv  Detail & Related papers  (2026-06-18T15:02:00Z)
• Synthetic-to-Real Domain Bridging for Single-View 3D Reconstruction of Ships for Maritime Monitoring [2.159596344261645]
  Three-dimensional (3D) reconstruction of ships is an important part of maritime monitoring.<n>Most state-ofthe-art 3D reconstruction methods require multi-view supervision, annotated 3D ground truth, or are computationally intensive.<n>We present an efficient pipeline for single-view 3D reconstruction of real ships by training entirely on synthetic data.
  arXiv  Detail & Related papers  (2026-01-29T14:34:01Z)
• Plenodium: UnderWater 3D Scene Reconstruction with Plenoptic Medium Representation [31.47797579690604]
  We present Plenodium, a 3D representation framework capable of jointly modeling both objects and participating media.<n>In contrast to existing medium representations that rely solely on view-dependent modeling, our novel plenoptic medium representation incorporates both directional and positional information.<n>Experiments on real-world underwater datasets demonstrate that our method achieves significant improvements in 3D reconstruction.
  arXiv  Detail & Related papers  (2025-05-27T14:37:58Z)
• Visual enhancement and 3D representation for underwater scenes: a review [13.809193345785388]
  Underwater visual enhancement (UVE) and underwater 3D reconstruction pose significant challenges in computer vision and AI-based tasks.<n>To advance research in these areas, we present an in-depth review from multiple perspectives.
  arXiv  Detail & Related papers  (2025-05-03T17:20:24Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images. This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• Vision-in-the-loop Simulation for Deep Monocular Pose Estimation of UAV in Ocean Environment [0.21427777919040414]
  This paper proposes a vision-in-the-loop simulation environment for deep monocular pose estimation of a UAV operating in an ocean environment. We present a photo-realistic 3D virtual environment leveraging recent advancements in Gaussian splatting. The resulting simulation enables the indoor testing of flight maneuvers while verifying all aspects of flight software, hardware, and the deep monocular pose estimation scheme.
  arXiv  Detail & Related papers  (2025-02-08T02:19:42Z)
• Aquatic-GS: A Hybrid 3D Representation for Underwater Scenes [6.549998173302729]
  We propose Aquatic-GS, a hybrid 3D representation approach for underwater scenes that effectively represents both the objects and the water medium. Specifically, we construct a Neural Water Field (NWF) to implicitly model the water parameters, while extending the latest 3D Gaussian Splatting (3DGS) to model the objects explicitly. Both components are integrated through a physics-based underwater image formation model to represent complex underwater scenes.
  arXiv  Detail & Related papers  (2024-10-31T22:24:56Z)
• UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images [63.32490897641344]
  We propose a framework for reconstructing target objects from multi-view underwater images based on neural SDF. We introduce hybrid geometric priors to optimize the reconstruction process, markedly enhancing the quality and efficiency of neural SDF reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T16:33:56Z)
• WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild [53.288327629960364]
  We present a data-driven pipeline for efficient multi-hand reconstruction in the wild. The proposed pipeline is composed of two components: a real-time fully convolutional hand localization and a high-fidelity transformer-based 3D hand reconstruction model. Our approach outperforms previous methods in both efficiency and accuracy on popular 2D and 3D benchmarks.
  arXiv  Detail & Related papers  (2024-09-18T18:46:51Z)
• GEOcc: Geometrically Enhanced 3D Occupancy Network with Implicit-Explicit Depth Fusion and Contextual Self-Supervision [49.839374549646884]
  This paper presents GEOcc, a Geometric-Enhanced Occupancy network tailored for vision-only surround-view perception. Our approach achieves State-Of-The-Art performance on the Occ3D-nuScenes dataset with the least image resolution needed and the most weightless image backbone.
  arXiv  Detail & Related papers  (2024-05-17T07:31:20Z)
• R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Cameras [106.52409577316389]
  R3D3 is a multi-camera system for dense 3D reconstruction and ego-motion estimation. Our approach exploits spatial-temporal information from multiple cameras, and monocular depth refinement. We show that this design enables a dense, consistent 3D reconstruction of challenging, dynamic outdoor environments.
  arXiv  Detail & Related papers  (2023-08-28T17:13:49Z)
• Mesh Reconstruction from Aerial Images for Outdoor Terrain Mapping Using Joint 2D-3D Learning [12.741811850885309]
  This paper addresses outdoor terrain mapping using overhead images obtained from an unmanned aerial vehicle. Dense depth estimation from aerial images during flight is challenging. We develop a joint 2D-3D learning approach to reconstruct local meshes at each camera, which can be assembled into a global environment model.
  arXiv  Detail & Related papers  (2021-01-06T02:09:03Z)
• Where to Explore Next? ExHistCNN for History-aware Autonomous 3D Exploration [39.376150974078364]
  We address the problem of autonomous 3D exploration of an unknown indoor environment using a depth camera. We cast the problem as the estimation of the Next Best View (NBV) that maximises the coverage of the unknown area. We propose a novel learning-based metric that encodes both, the current 3D observation (a depth frame) and the history of the ongoing reconstruction.
  arXiv  Detail & Related papers  (2020-11-30T10:29:29Z)
• Occupancy Anticipation for Efficient Exploration and Navigation [97.17517060585875]
  We propose occupancy anticipation, where the agent uses its egocentric RGB-D observations to infer the occupancy state beyond the visible regions. By exploiting context in both the egocentric views and top-down maps our model successfully anticipates a broader map of the environment. Our approach is the winning entry in the 2020 Habitat PointNav Challenge.
  arXiv  Detail & Related papers  (2020-08-21T03:16:51Z)
• OmniSLAM: Omnidirectional Localization and Dense Mapping for Wide-baseline Multi-camera Systems [88.41004332322788]
  We present an omnidirectional localization and dense mapping system for a wide-baseline multiview stereo setup with ultra-wide field-of-view (FOV) fisheye cameras. For more practical and accurate reconstruction, we first introduce improved and light-weighted deep neural networks for the omnidirectional depth estimation. We integrate our omnidirectional depth estimates into the visual odometry (VO) and add a loop closing module for global consistency.
  arXiv  Detail & Related papers  (2020-03-18T05:52:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.