CaveSeg: Deep Semantic Segmentation and Scene Parsing for Autonomous Underwater Cave Exploration

• URL: http://arxiv.org/abs/2309.11038v6
• Date: Fri, 10 May 2024 17:09:40 GMT
• Title: CaveSeg: Deep Semantic Segmentation and Scene Parsing for Autonomous Underwater Cave Exploration
• Abstract summary: We present CaveSeg - the first visual learning pipeline for semantic segmentation and scene parsing for AUV navigation inside underwater caves. It contains pixel annotations for important navigation markers (e.g. caveline, arrows), obstacles (e.g. ground plane and overhead layers), scuba divers, and open areas for servoing.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we present CaveSeg - the first visual learning pipeline for semantic segmentation and scene parsing for AUV navigation inside underwater caves. We address the problem of scarce annotated training data by preparing a comprehensive dataset for semantic segmentation of underwater cave scenes. It contains pixel annotations for important navigation markers (e.g. caveline, arrows), obstacles (e.g. ground plane and overhead layers), scuba divers, and open areas for servoing. Through comprehensive benchmark analyses on cave systems in USA, Mexico, and Spain locations, we demonstrate that robust deep visual models can be developed based on CaveSeg for fast semantic scene parsing of underwater cave environments. In particular, we formulate a novel transformer-based model that is computationally light and offers near real-time execution in addition to achieving state-of-the-art performance. Finally, we explore the design choices and implications of semantic segmentation for visual servoing by AUVs inside underwater caves. The proposed model and benchmark dataset open up promising opportunities for future research in autonomous underwater cave exploration and mapping.

Related papers

• CAVE-NAV: VLM-Based Autonomous 3D Navigation in Underwater Cave Environments [11.084602981881767]
  We propose a vision-language model (VLM) with Chain-of-Thought (CoT) reasoning to infer navigable directions from environmental cues.<n>High-fidelity simulations across multiple cave topologies demonstrate that the proposed framework completes all evaluations without collisions.
  arXiv  Detail & Related papers  (2026-08-28T00:16:09Z)
• Exploring the Underwater World Segmentation without Extra Training [55.291219073365546]
  We introduce textbfAquaOV255, the first large-scale and fine-grained underwater segmentation dataset.<n>We also present textbfEarth2Ocean, a training-free OV segmentation framework.
  arXiv  Detail & Related papers  (2025-11-11T07:22:56Z)
• NAUTILUS: A Large Multimodal Model for Underwater Scene Understanding [60.76337064425815]
  We study the underwater scene understanding methods, which aim to achieve automated underwater exploration.<n>NautData is a dataset containing 1.45 M image-text pairs supporting eight underwater scene understanding tasks.<n>We propose a plug-and-play vision feature enhancement (VFE) module, which explicitly restores clear underwater information.
  arXiv  Detail & Related papers  (2025-10-31T14:00:35Z)
• A Unified Image-Dense Annotation Generation Model for Underwater Scenes [48.34534171882895]
  This paper proposes a unified Text-to-Image and DEnse annotation generation method (TIDE) for underwater scenes. It relies solely on text as input to simultaneously generate realistic underwater images and multiple highly consistent dense annotations. We synthesize a large-scale underwater dataset using TIDE to validate the effectiveness of our method in underwater dense prediction tasks.
  arXiv  Detail & Related papers  (2025-03-27T17:59:43Z)
• Co-SemDepth: Fast Joint Semantic Segmentation and Depth Estimation on Aerial Images [0.9883261192383611]
  In this paper, we leverage monocular cameras on aerial robots to predict depth and semantic maps in unstructured environments. We propose a joint deep-learning architecture that can perform the two tasks accurately and rapidly.
  arXiv  Detail & Related papers  (2025-03-23T08:25:07Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images. This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis [40.27548815196493]
  We introduce AquaticCLIP, a novel contrastive language-image pre-training model tailored for aquatic scene understanding. AquaticCLIP presents a new unsupervised learning framework that aligns images and texts in aquatic environments. Our model sets a new benchmark for vision-language applications in underwater environments.
  arXiv  Detail & Related papers  (2025-02-03T19:56:16Z)
• Diving into Underwater: Segment Anything Model Guided Underwater Salient Instance Segmentation and A Large-scale Dataset [60.14089302022989]
  Underwater vision tasks often suffer from low segmentation accuracy due to the complex underwater circumstances. We construct the first large-scale underwater salient instance segmentation dataset (USIS10K) We propose an Underwater Salient Instance architecture based on Segment Anything Model (USIS-SAM) specifically for the underwater domain.
  arXiv  Detail & Related papers  (2024-06-10T06:17:33Z)
• Underwater Variable Zoom: Depth-Guided Perception Network for Underwater Image Enhancement [9.967324345793378]
  We present a novel depth-guided perception UIE framework, dubbed underwater variable zoom (UVZ) UVZ parses near-far scenarios by harnessing the predicted depth maps, enabling local and non-local perceiving in different regions. Experiments on five benchmark datasets demonstrate that UVZ achieves superior visual gain and delivers promising quantitative metrics.
  arXiv  Detail & Related papers  (2024-04-27T12:42:26Z)
• GaussNav: Gaussian Splatting for Visual Navigation [92.13664084464514]
  Instance ImageGoal Navigation (IIN) requires an agent to locate a specific object depicted in a goal image within an unexplored environment. Our framework constructs a novel map representation based on 3D Gaussian Splatting (3DGS) Our framework demonstrates a significant leap in performance, evidenced by an increase in Success weighted by Path Length (SPL) from 0.252 to 0.578 on the challenging Habitat-Matterport 3D (HM3D) dataset.
  arXiv  Detail & Related papers  (2024-03-18T09:56:48Z)
• A Landmark-Aware Visual Navigation Dataset [6.1190419149081245]
  We present a Landmark-Aware Visual Navigation dataset to allow for supervised learning of human-centric exploration policies and map building. We collect RGBD observation and human point-click pairs as a human annotator explores virtual and real-world environments. Our dataset covers a wide spectrum of scenes, including rooms in indoor environments, as well as walkways outdoors.
  arXiv  Detail & Related papers  (2024-02-22T04:43:20Z)
• Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robots [0.0]
  We formulate a deep learning model that fuses sparse depth measurements from triangulated features to improve the depth predictions. The network is trained in a supervised fashion on the forward-looking underwater dataset, FLSea. The method achieves real-time performance, running at 160 FPS on a laptop GPU and 7 FPS on a single CPU core.
  arXiv  Detail & Related papers  (2023-10-25T16:32:31Z)
• Improving Underwater Visual Tracking With a Large Scale Dataset and Image Enhancement [70.2429155741593]
  This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT) It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles. We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality. The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
  arXiv  Detail & Related papers  (2023-08-30T07:41:26Z)
• UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robots [4.157415305926584]
  We present a fast monocular depth estimation method for enabling 3D perception capabilities of low-cost underwater robots. We formulate a novel end-to-end deep visual learning pipeline named UDepth, which incorporates domain knowledge of image formation characteristics of natural underwater scenes.
  arXiv  Detail & Related papers  (2022-09-26T01:08:36Z)
• Polyline Based Generative Navigable Space Segmentation for Autonomous Visual Navigation [57.3062528453841]
  We propose a representation-learning-based framework to enable robots to learn the navigable space segmentation in an unsupervised manner. We show that the proposed PSV-Nets can learn the visual navigable space with high accuracy, even without any single label.
  arXiv  Detail & Related papers  (2021-10-29T19:50:48Z)
• FathomNet: A global underwater image training set for enabling artificial intelligence in the ocean [0.0]
  Ocean-going platforms are integrating high-resolution camera feeds for observation and navigation, producing a deluge of visual data. Recent advances in machine learning enable fast, sophisticated analysis of visual data, but have had limited success in the oceanographic world. We will demonstrate how machine learning models trained on FathomNet data can be applied across different institutional video data.
  arXiv  Detail & Related papers  (2021-09-29T18:08:42Z)
• SOON: Scenario Oriented Object Navigation with Graph-based Exploration [102.74649829684617]
  The ability to navigate like a human towards a language-guided target from anywhere in a 3D embodied environment is one of the 'holy grail' goals of intelligent robots. Most visual navigation benchmarks focus on navigating toward a target from a fixed starting point, guided by an elaborate set of instructions that depicts step-by-step. This approach deviates from real-world problems in which human-only describes what the object and its surrounding look like and asks the robot to start navigation from anywhere.
  arXiv  Detail & Related papers  (2021-03-31T15:01:04Z)
• Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completion [56.85837052421469]
  Estimating scene geometry from data obtained with cost-effective sensors is key for robots and self-driving cars. In this paper, we study the problem of predicting dense depth from a single RGB image with optional sparse measurements from low-cost active depth sensors. We introduce Sparse Networks (SANs), a new module enabling monodepth networks to perform both the tasks of depth prediction and completion.
  arXiv  Detail & Related papers  (2021-03-30T21:22:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.