Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments

• URL: http://arxiv.org/abs/2503.04096v1
• Date: Thu, 06 Mar 2025 05:13:19 GMT
• Title: Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments
• Authors: Beverley Gorry, Tobias Fischer, Michael Milford, Alejandro Fontan,
• Abstract summary: We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images.<n>This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
• Score: 57.59857784298534
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Effective monitoring of underwater ecosystems is crucial for tracking environmental changes, guiding conservation efforts, and ensuring long-term ecosystem health. However, automating underwater ecosystem management with robotic platforms remains challenging due to the complexities of underwater imagery, which pose significant difficulties for traditional visual localization methods. We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images. This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes. Furthermore, we introduce the SQUIDLE+ VPR Benchmark-the first large-scale underwater VPR benchmark designed to leverage an extensive collection of unstructured data from multiple robotic platforms, spanning time intervals from days to years. The dataset encompasses diverse trajectories, arbitrary overlap and diverse seafloor types captured under varying environmental conditions, including differences in depth, lighting, and turbidity. Our code is available at: https://github.com/bev-gorry/underloc

Related papers

• Harmonizing the Deep: A Unified Information Pipeline for Robust Marine Biodiversity Assessment Across Heterogeneous Domains [0.769971486557519]
  This work establishes the foundational detection layer for a multi-year invasive species monitoring initiative targeting Arctic and Atlantic marine ecosystems.<n>We develop a Unified Information Pipeline that standardises heterogeneous datasets into a comparable information flow.<n>We find that structural factors, such as scene composition, object density, and contextual redundancy, explain cross-domain performance loss.
  arXiv  Detail & Related papers  (2026-01-20T13:51:55Z)
• Exploring the Underwater World Segmentation without Extra Training [55.291219073365546]
  We introduce textbfAquaOV255, the first large-scale and fine-grained underwater segmentation dataset.<n>We also present textbfEarth2Ocean, a training-free OV segmentation framework.
  arXiv  Detail & Related papers  (2025-11-11T07:22:56Z)
• UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding [54.16709436340606]
  Large vision-language models (VLMs) have achieved remarkable success in natural scene understanding.<n>Underwater imagery presents unique challenges including severe light attenuation, color distortion, and suspended particle scattering.<n>We introduce UWBench, a benchmark specifically designed for underwater vision-language understanding.
  arXiv  Detail & Related papers  (2025-10-21T03:32:15Z)
• Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Dataset [76.92197418745822]
  camouflaged instance segmentation (CIS) faces greater challenges in accurately segmenting objects that blend closely with their surroundings.<n>Traditional camouflaged instance segmentation methods, trained on terrestrial-dominated datasets with limited underwater samples, may exhibit inadequate performance in underwater scenes.<n>We introduce the first underwater camouflaged instance segmentation dataset, UCIS4K, which comprises 3,953 images of camouflaged marine organisms with instance-level annotations.
  arXiv  Detail & Related papers  (2025-10-20T14:34:51Z)
• DEEP-SEA: Deep-Learning Enhancement for Environmental Perception in Submerged Aquatics [5.543187582839764]
  Continuous and reliable underwater monitoring is essential for assessing marine biodiversity, detecting ecological changes and autonomous exploration.<n>Underwater environments present significant challenges due to light scattering, absorption and turbidity, which degrade image clarity and distort colour information.<n>We propose DEEP-SEA, a novel deep learning-based underwater image restoration model to enhance both low- and high-frequency information while preserving spatial structures.
  arXiv  Detail & Related papers  (2025-08-18T11:07:26Z)
• Automated Detection of Antarctic Benthic Organisms in High-Resolution In Situ Imagery to Aid Biodiversity Monitoring [0.0]
  We present a tailored object detection framework for Antarctic benthic organisms in high-resolution towed camera imagery.<n>We show strong performance in detecting medium and large organisms across 25 fine-grained morphotypes.<n>Our framework provides a scalable foundation for future machine-assisted in situ benthic biodiversity monitoring research.
  arXiv  Detail & Related papers  (2025-07-29T10:22:29Z)
• PacGDC: Label-Efficient Generalizable Depth Completion with Projection Ambiguity and Consistency [63.74016242995453]
  PacGDC is a label-efficient technique that enhances data diversity with minimal annotation effort for generalizable depth completion.<n>We propose a new data synthesis pipeline that uses multiple depth foundation models as scale manipulators.<n>Experiments show that PacGDC achieves remarkable generalizability across multiple benchmarks.
  arXiv  Detail & Related papers  (2025-07-10T01:56:30Z)
• VRS-UIE: Value-Driven Reordering Scanning for Underwater Image Enhancement [104.78586859995333]
  State Space Models (SSMs) have emerged as a promising backbone for vision tasks due to their linear complexity and global receptive field.<n>The predominance of large-portion, homogeneous but useless oceanic backgrounds can dilute the feature representation responses of sparse yet valuable targets.<n>We propose a novel Value-Driven Reordering Scanning framework for Underwater Image Enhancement (UIE)<n>Our framework sets a new state-of-the-art, delivering superior enhancement performance (surpassing WMamba by 0.89 dB on average) by effectively suppressing water bias and preserving structural and color fidelity.
  arXiv  Detail & Related papers  (2025-05-02T12:21:44Z)
• Learning Underwater Active Perception in Simulation [51.205673783866146]
  Turbidity can jeopardise the whole mission as it may prevent correct visual documentation of the inspected structures. Previous works have introduced methods to adapt to turbidity and backscattering. We propose a simple yet efficient approach to enable high-quality image acquisition of assets in a broad range of water conditions.
  arXiv  Detail & Related papers  (2025-04-23T06:48:38Z)
• Real-time Seafloor Segmentation and Mapping [0.0]
  Posidonia oceanica meadows are a species of seagrass highly dependent on rocks for their survival and conservation. Deep learning-based semantic segmentation and visual automated monitoring systems have shown promise in a variety of applications. This paper introduces a framework that combines machine learning and computer vision techniques to enable an autonomous underwater vehicle (AUV) to inspect the boundaries of Posidonia oceanica meadows autonomously.
  arXiv  Detail & Related papers  (2025-04-14T22:49:08Z)
• Inland Waterway Object Detection in Multi-environment: Dataset and Approach [12.00732943849236]
  This paper introduces the Multi-environment Inland Waterway Vessel dataset (MEIWVD) MEIWVD comprises 32,478 high-quality images from diverse scenarios, including sunny, rainy, foggy, and artificial lighting conditions. This paper proposes a scene-guided image enhancement module to improve water surface images based on environmental conditions adaptively.
  arXiv  Detail & Related papers  (2025-04-07T08:45:00Z)
• AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis [40.27548815196493]
  We introduce AquaticCLIP, a novel contrastive language-image pre-training model tailored for aquatic scene understanding.<n> AquaticCLIP presents a new unsupervised learning framework that aligns images and texts in aquatic environments.<n>Our model sets a new benchmark for vision-language applications in underwater environments.
  arXiv  Detail & Related papers  (2025-02-03T19:56:16Z)
• UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images [63.32490897641344]
  We propose a framework for reconstructing target objects from multi-view underwater images based on neural SDF. We introduce hybrid geometric priors to optimize the reconstruction process, markedly enhancing the quality and efficiency of neural SDF reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T16:33:56Z)
• On Vision Transformers for Classification Tasks in Side-Scan Sonar Imagery [0.0]
  Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor. This paper rigorously compares the performance of ViT models alongside commonly used CNN architectures for binary classification tasks in SSS imagery. ViT-based models exhibit superior classification performance across f1-score, precision, recall, and accuracy metrics.
  arXiv  Detail & Related papers  (2024-09-18T14:36:50Z)
• ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics [14.935296890629795]
  Oysters are a vital keystone species in coastal ecosystems, providing significant economic, environmental, and cultural benefits.<n>Current monitoring strategies often rely on destructive methods.<n>We propose a novel pipeline using stable diffusion to augment a collected real dataset with realistic synthetic data.
  arXiv  Detail & Related papers  (2024-09-11T04:31:09Z)
• Diving into Underwater: Segment Anything Model Guided Underwater Salient Instance Segmentation and A Large-scale Dataset [60.14089302022989]
  Underwater vision tasks often suffer from low segmentation accuracy due to the complex underwater circumstances. We construct the first large-scale underwater salient instance segmentation dataset (USIS10K) We propose an Underwater Salient Instance architecture based on Segment Anything Model (USIS-SAM) specifically for the underwater domain.
  arXiv  Detail & Related papers  (2024-06-10T06:17:33Z)
• Automatic Coral Detection with YOLO: A Deep Learning Approach for Efficient and Accurate Coral Reef Monitoring [0.0]
  Coral reefs are vital ecosystems that are under increasing threat due to local human impacts and climate change. In this paper, we present an automatic coral detection system utilizing the You Only Look Once deep learning model.
  arXiv  Detail & Related papers  (2024-04-03T08:00:46Z)
• Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
  This paper seeks transferable prior knowledge from detector-friendly images. It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps. Our method with higher speeds and less parameters still performs better than transformer-based detectors.
  arXiv  Detail & Related papers  (2023-08-24T12:32:46Z)
• DeepAqua: Self-Supervised Semantic Segmentation of Wetland Surface Water Extent with SAR Images using Knowledge Distillation [44.99833362998488]
  We present DeepAqua, a self-supervised deep learning model that eliminates the need for manual annotations during the training phase. We exploit cases where optical- and radar-based water masks coincide, enabling the detection of both open and vegetated water surfaces. Experimental results show that DeepAqua outperforms other unsupervised methods by improving accuracy by 7%, Intersection Over Union by 27%, and F1 score by 14%.
  arXiv  Detail & Related papers  (2023-05-02T18:06:21Z)
• FLSea: Underwater Visual-Inertial and Stereo-Vision Forward-Looking Datasets [8.830479021890575]
  We have collected underwater forward-looking stereo-vision and visual-inertial image sets in the Mediterranean and Red Sea. These datasets are critical for the development of several underwater applications, including obstacle avoidance, visual odometry, 3D tracking, Simultaneous localization and Mapping (SLAM) and depth estimation.
  arXiv  Detail & Related papers  (2023-02-24T17:39:53Z)
• OmniSLAM: Omnidirectional Localization and Dense Mapping for Wide-baseline Multi-camera Systems [88.41004332322788]
  We present an omnidirectional localization and dense mapping system for a wide-baseline multiview stereo setup with ultra-wide field-of-view (FOV) fisheye cameras. For more practical and accurate reconstruction, we first introduce improved and light-weighted deep neural networks for the omnidirectional depth estimation. We integrate our omnidirectional depth estimates into the visual odometry (VO) and add a loop closing module for global consistency.
  arXiv  Detail & Related papers  (2020-03-18T05:52:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.