CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

• URL: http://arxiv.org/abs/2609.12826v1
• Date: Fri, 11 Sep 2026 13:23:11 GMT
• Title: CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs
• Abstract summary: CoralscapesV2 is an extension of the Coralscapes dataset for general-purpose visual scene understanding in reefs.<n>It provides 65k exhaustive fish instance mask annotations, meticulously annotated to completeness by using the video.<n>It is the first dataset for panoptic segmentation in coral reefs, capturing a wide range of scenarios in the wild.
• Score: 9.002911991534415
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In order to design conservation and restoration strategies to counter the global decline of coral reefs, ecological monitoring of reefs needs to be scaled up dramatically. Computer vision methods are increasingly used to tackle the vast amount of data: as the paradigm of data collection in reefs shifts from highly standardized and constrained survey images to unconstrained imagery on scalable platforms, it is necessary to design machine learning methods that help to get a fine-grained understanding of reefs from general-purpose reef imagery. This paper provides CoralscapesV2, an extension of the Coralscapes dataset for general-purpose visual scene understanding in reefs. CoralscapesV2 increases the dataset size, scope, label completeness and quality for semantic segmentation, and extends the number of classes from 39 to 95 fine-grained visual categories. Furthermore, CoralscapesV2 provides 65k exhaustive fish instance mask annotations, meticulously annotated to completeness by using the video, revealing that annotation of fish based on only static images is insufficient. CoralscapesV2 is the first dataset for panoptic segmentation in coral reefs, capturing a wide range of scenarios in the wild, posing a challenging benchmark for contemporary semantic segmentation and instance segmentation models. CoralscapesV2 is an important step towards general-purpose panoptic segmentation in coral reefs, which has substantial implications for scaling up coral reef monitoring, as it can be employed in a wide range of applications from benthic cover mapping from robot or handheld videos to designing methods for automated quantification and understanding of fish behavior and fish-reef interactions.

Related papers

• Exploring the Underwater World Segmentation without Extra Training [55.291219073365546]
  We introduce textbfAquaOV255, the first large-scale and fine-grained underwater segmentation dataset.<n>We also present textbfEarth2Ocean, a training-free OV segmentation framework.
  arXiv  Detail & Related papers  (2025-11-11T07:22:56Z)
• UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding [54.16709436340606]
  Large vision-language models (VLMs) have achieved remarkable success in natural scene understanding.<n>Underwater imagery presents unique challenges including severe light attenuation, color distortion, and suspended particle scattering.<n>We introduce UWBench, a benchmark specifically designed for underwater vision-language understanding.
  arXiv  Detail & Related papers  (2025-10-21T03:32:15Z)
• Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Dataset [76.92197418745822]
  camouflaged instance segmentation (CIS) faces greater challenges in accurately segmenting objects that blend closely with their surroundings.<n>Traditional camouflaged instance segmentation methods, trained on terrestrial-dominated datasets with limited underwater samples, may exhibit inadequate performance in underwater scenes.<n>We introduce the first underwater camouflaged instance segmentation dataset, UCIS4K, which comprises 3,953 images of camouflaged marine organisms with instance-level annotations.
  arXiv  Detail & Related papers  (2025-10-20T14:34:51Z)
• No Mesh, No Problem: Estimating Coral Volume and Surface from Sparse Multi-View Images [45.20850219249498]
  Effective reef monitoring requires the quantification of coral growth via accurate volumetric and surface area estimates.<n>We propose a novel, lightweight, and scalable learning framework that addresses this challenge by predicting the 3D volume and surface area of coral-like objects from 2D multi-view RGB images.<n>This framework paves the way for efficient and scalable coral geometry estimation directly from a sparse set of images, with potential applications in coral growth analysis and reef monitoring.
  arXiv  Detail & Related papers  (2025-09-14T08:52:01Z)
• The point is the mask: scaling coral reef segmentation with weak supervision [1.4286124121075066]
  Drone-based aerial imagery offers broad spatial coverage, its limited resolution makes it difficult to reliably distinguish fine-scale classes, such as coral morphotypes.<n>We present a multi-scale weakly supervised semantic segmentation framework that addresses this challenge by transferring fine-scale ecological information from underwater imagery to aerial data.<n>This study presents a scalable, cost-effective methodology for high-resolution reef monitoring, combining low-cost data collection, weakly supervised deep learning and multi-scale remote sensing.
  arXiv  Detail & Related papers  (2025-08-26T11:58:50Z)
• CoralVQA: A Large-Scale Visual Question Answering Dataset for Coral Reef Image Understanding [15.528677269203046]
  CoralVQA is the first large-scale dataset for coral reef analysis.<n>It contains 12,805 real-world coral images from 67 coral genera collected from 3 oceans.<n>It provides a benchmark for studying vision-language reasoning in the context of coral reef images.
  arXiv  Detail & Related papers  (2025-07-14T16:29:10Z)
• The Coralscapes Dataset: Semantic Scene Understanding in Coral Reefs [12.535323016915122]
  We release the first general-purpose dense semantic segmentation dataset for coral reefs, covering 2075 images, 39 benthic classes, and 174k segmentation masks annotated by experts.<n>We benchmark a wide range of semantic segmentation models, and find that transfer learning from Coralscapes to existing smaller datasets consistently leads to state-of-the-art performance.<n>Coralscapes will catalyze research on efficient, scalable, and standardized coral reef surveying methods based on computer vision, and holds the potential to streamline the development of underwater ecological robotics.
  arXiv  Detail & Related papers  (2025-03-25T18:33:59Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images.<n>This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• CoralSCOP-LAT: Labeling and Analyzing Tool for Coral Reef Images with Dense Mask [20.267378309290116]
  CoralSCOP-LAT is a coral reef image analysis and labeling tool that automatically segments and analyzes coral regions.<n>Our evaluations demonstrate that CoralSCOP-LAT surpasses existing coral reef analysis tools in terms of time efficiency, accuracy, precision, and flexibility.
  arXiv  Detail & Related papers  (2024-10-27T13:26:44Z)
• Scalable Semantic 3D Mapping of Coral Reefs with Deep Learning [4.8902950939676675]
  This paper presents a new paradigm for mapping underwater environments from ego-motion video. We show high-precision 3D semantic mapping at unprecedented scale with significantly reduced required labor costs. Our approach significantly scales up coral reef monitoring by taking a leap towards fully automatic analysis of video transects.
  arXiv  Detail & Related papers  (2023-09-22T11:35:10Z)
• Towards Generating Large Synthetic Phytoplankton Datasets for Efficient Monitoring of Harmful Algal Blooms [77.25251419910205]
  Harmful algal blooms (HABs) cause significant fish deaths in aquaculture farms. Currently, the standard method to enumerate harmful algae and other phytoplankton is to manually observe and count them under a microscope. We employ Generative Adversarial Networks (GANs) to generate synthetic images.
  arXiv  Detail & Related papers  (2022-08-03T20:15:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.