Seg the HAB: Language-Guided Geospatial Algae Bloom Reasoning and Segmentation

• URL: http://arxiv.org/abs/2510.18751v2
• Date: Wed, 05 Nov 2025 22:17:59 GMT
• Title: Seg the HAB: Language-Guided Geospatial Algae Bloom Reasoning and Segmentation
• Authors: Patterson Hsieh, Jerry Yeh, Mao-Chi He, Wen-Han Hsieh, Elvis Hsieh,
• Abstract summary: Harmful algal bloom (HAB) threatens aquatic ecosystems and human health through oxygen depletion, toxin release, and disruption of marine biodiversity.<n>Traditional monitoring approaches, such as manual water sampling, remain labor-intensive and limited in quantifying and temporal coverage.<n>Recent advances in vision-language models (VLMs) for remote sensing have shown potential for AI-driven solutions, yet challenges remain in reasoning over imagery and bloom severity.<n>In this work, we introduce ALGae Observation andtunes (ALGOS), a segmentation-and-reasoning system for HAB monitoring that combines remote sensing image understanding with severity estimation.
• Score: 0.250940779021804
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Climate change is intensifying the occurrence of harmful algal bloom (HAB), particularly cyanobacteria, which threaten aquatic ecosystems and human health through oxygen depletion, toxin release, and disruption of marine biodiversity. Traditional monitoring approaches, such as manual water sampling, remain labor-intensive and limited in spatial and temporal coverage. Recent advances in vision-language models (VLMs) for remote sensing have shown potential for scalable AI-driven solutions, yet challenges remain in reasoning over imagery and quantifying bloom severity. In this work, we introduce ALGae Observation and Segmentation (ALGOS), a segmentation-and-reasoning system for HAB monitoring that combines remote sensing image understanding with severity estimation. Our approach integrates GeoSAM-assisted human evaluation for high-quality segmentation mask curation and fine-tunes vision language model on severity prediction using the Cyanobacteria Aggregated Manual Labels (CAML) from NASA. Experiments demonstrate that ALGOS achieves robust performance on both segmentation and severity-level estimation, paving the way toward practical and automated cyanobacterial monitoring systems.

Related papers

• Harmonizing the Deep: A Unified Information Pipeline for Robust Marine Biodiversity Assessment Across Heterogeneous Domains [0.769971486557519]
  This work establishes the foundational detection layer for a multi-year invasive species monitoring initiative targeting Arctic and Atlantic marine ecosystems.<n>We develop a Unified Information Pipeline that standardises heterogeneous datasets into a comparable information flow.<n>We find that structural factors, such as scene composition, object density, and contextual redundancy, explain cross-domain performance loss.
  arXiv  Detail & Related papers  (2026-01-20T13:51:55Z)
• Fusing Multi- and Hyperspectral Satellite Data for Harmful Algal Bloom Monitoring with Self-Supervised and Hierarchical Deep Learning [0.0]
  We present a self-supervised machine learning framework for detecting and mapping harmful algal bloom severity and speciation.<n>By fusing reflectance data from operational instruments with TROPOMI solar-induced fluorescence (SIF), our framework, called SIT-FUSE, generates HAB severity and speciation products without requiring per-instrument labeled datasets.<n>The framework employs self-supervised representation learning, hierarchical deep clustering to segment phytoplankton concentrations and speciations into interpretable classes, validated against in-situ data from the Gulf of Mexico and Southern California.
  arXiv  Detail & Related papers  (2025-10-03T06:51:19Z)
• DEEP-SEA: Deep-Learning Enhancement for Environmental Perception in Submerged Aquatics [5.543187582839764]
  Continuous and reliable underwater monitoring is essential for assessing marine biodiversity, detecting ecological changes and autonomous exploration.<n>Underwater environments present significant challenges due to light scattering, absorption and turbidity, which degrade image clarity and distort colour information.<n>We propose DEEP-SEA, a novel deep learning-based underwater image restoration model to enhance both low- and high-frequency information while preserving spatial structures.
  arXiv  Detail & Related papers  (2025-08-18T11:07:26Z)
• Hierarchical Reinforcement Learning Framework for Adaptive Walking Control Using General Value Functions of Lower-Limb Sensor Signals [0.40498500266986387]
  We explore the use of Hierarchical Reinforcement Learning to develop adaptive control strategies for lower-limb exoskeletons.<n>Our approach breaks down the complex task of exoskeleton control adaptation into a higher-level framework for terrain strategy adaptation and a lower-level framework for providing predictive information.<n>We investigated two methods for incorporating actual and predicted sensor signals into a policy network with the intent to improve the decision-making capacity of the control system.
  arXiv  Detail & Related papers  (2025-07-22T19:47:04Z)
• Data Augmentation and Resolution Enhancement using GANs and Diffusion Models for Tree Segmentation [49.13393683126712]
  Urban forests play a key role in enhancing environmental quality and supporting biodiversity in cities.<n> accurately detecting trees is challenging due to complex landscapes and the variability in image resolution caused by different satellite sensors or UAV flight altitudes.<n>We propose a novel pipeline that integrates domain adaptation with GANs and Diffusion models to enhance the quality of low-resolution aerial images.
  arXiv  Detail & Related papers  (2025-05-21T03:57:10Z)
• Monitoring digestate application on agricultural crops using Sentinel-2 Satellite imagery [1.2670268797931266]
  This study evaluates optical Sentinel-2 satellite imagery for detecting digestate application, a practice that enhances soil fertility but poses environmental risks.<n>In the first instance, Sentinel-2 satellite image time series (SITS) analysis of specific indices (EOMI, NDVI, EVI) was used to characterize EOM's spectral behavior.<n>Machine Learning (ML) models were used to investigate digestate presence detection, achieving F1-scores up to 0.85.
  arXiv  Detail & Related papers  (2025-04-28T17:16:40Z)
• Marine Saliency Segmenter: Object-Focused Conditional Diffusion with Region-Level Semantic Knowledge Distillation [44.50637633194709]
  Marine Saliency (MSS) plays a pivotal role in various vision-based marine exploration tasks.<n>We propose DiffMSS, a novel marine saliency segmenter based on the diffusion model.<n>We develop the dedicated deterministic consensus sampling to suppress overconfident missegmentations.
  arXiv  Detail & Related papers  (2025-04-03T08:31:36Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images.<n>This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation [41.94295877935867]
  We propose a resilient, scalable solution for image and video analysis in marine applications.<n>We validate this approach through a preliminary application in classifying fish from video onboard fishing vessels.
  arXiv  Detail & Related papers  (2024-12-03T08:34:42Z)
• Evaluation of the potential of Near Infrared Hyperspectral Imaging for monitoring the invasive brown marmorated stink bug [53.682955739083056]
  The brown marmorated stink bug (BMSB), Halyomorpha halys, is an invasive insect pest of global importance that damages several crops. The present study consists in a preliminary evaluation at the laboratory level of Near Infrared Hyperspectral Imaging (NIR-HSI) as a possible technology to detect BMSB specimens.
  arXiv  Detail & Related papers  (2023-01-19T11:37:20Z)
• Unsupervised deep learning techniques for powdery mildew recognition based on multispectral imaging [63.62764375279861]
  This paper presents a deep learning approach to automatically recognize powdery mildew on cucumber leaves. We focus on unsupervised deep learning techniques applied to multispectral imaging data. We propose the use of autoencoder architectures to investigate two strategies for disease detection.
  arXiv  Detail & Related papers  (2021-12-20T13:29:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.