Automated high-frequency quantification of fish communities and biomass using computer vision

• URL: http://arxiv.org/abs/2605.10449v1
• Date: Mon, 11 May 2026 12:20:37 GMT
• Title: Automated high-frequency quantification of fish communities and biomass using computer vision
• Abstract summary: We develop an automated framework for quantifying fish communities from underwater video using computer vision.<n>Using videos acquired with a custom-made stereo camera system, the framework integrates deep learning-based fish identification, multi-object tracking, and 3D reconstruction.<n>We apply the approach to a reef fish community over a 20-day period with hourly daytime observations, revealing dynamic fluctuations in species richness, abundance, and biomass associated with changes in species composition.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Quantifying fish community structure is essential for understanding biodiversity and ecosystem responses in a changing environment, yet existing survey methods provide limited high-frequency, quantitative observations. Conventional approaches, including catch-based methods, underwater visual censuses, and environmental DNA metabarcoding, either require intensive labor or lack reliable estimates of abundance and biomass. Here, we develop an automated framework for quantifying fish communities from underwater video using computer vision. Using videos acquired with a custom-made stereo camera system, the framework integrates deep learning-based fish identification, multi-object tracking, and 3D reconstruction to estimate species-level abundance and biomass. We applied the approach to a reef fish community over a 20-day period with hourly daytime observations, revealing dynamic fluctuations in species richness, abundance, and biomass associated with changes in species composition. By comparing fish communities estimated from visual census and environmental DNA surveys, we demonstrate that our method provides complementary strengths for continuous, non-invasive, and quantitative monitoring of consistently observed species. This approach provides a scalable foundation for long-term monitoring and advances the capacity to resolve fine-scale temporal dynamics in fish communities.

Related papers

• LakeFM: Toward a Foundation Model for Aquatic Ecosystems Using Irregular Multivariate Multi-depth Time Series Data [8.269068577570511]
  textscLakeFM is a foundation model for aquatic systems pre-trained on large-scale ecological datasets.<n>We show that textscLakeFM learns meaningful representations spanning broader lake-level characteristics.<n>It produces physically plausible predictions consistent with real-world lake dynamics.
  arXiv  Detail & Related papers  (2026-06-09T05:30:53Z)
• A Novel Computer Vision Approach for Assessing Fish Responses to Intrusive Objects in Aquaculture [2.099922236065961]
  The aquaculture industry needs to address several challenges to secure sustainable seafood production that can serve an increasing global demand.<n>One major challenge is to ensure good fish health and acceptable welfare during production since the improvement of fish welfare is of vital importance in current and future production systems.<n>A novel approach for detecting, tracking, and estimating the 3D position of individual fish has thus been developed.
  arXiv  Detail & Related papers  (2026-05-28T14:46:51Z)
• UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding [54.16709436340606]
  Large vision-language models (VLMs) have achieved remarkable success in natural scene understanding.<n>Underwater imagery presents unique challenges including severe light attenuation, color distortion, and suspended particle scattering.<n>We introduce UWBench, a benchmark specifically designed for underwater vision-language understanding.
  arXiv  Detail & Related papers  (2025-10-21T03:32:15Z)
• DEEP-SEA: Deep-Learning Enhancement for Environmental Perception in Submerged Aquatics [5.543187582839764]
  Continuous and reliable underwater monitoring is essential for assessing marine biodiversity, detecting ecological changes and autonomous exploration.<n>Underwater environments present significant challenges due to light scattering, absorption and turbidity, which degrade image clarity and distort colour information.<n>We propose DEEP-SEA, a novel deep learning-based underwater image restoration model to enhance both low- and high-frequency information while preserving spatial structures.
  arXiv  Detail & Related papers  (2025-08-18T11:07:26Z)
• A computer vision method to estimate ventilation rate of Atlantic salmon in sea fish farms [0.18807755325664796]
  We have developed a computer vision method for monitoring ventilation rates of Atlantic salmon (Salmo salar)<n>Our approach uses a fish head detection model, which classifies the mouth state as either open or closed using a convolutional neural network.<n>By accurately identifying pens where fish exhibit signs of respiratory distress, our method offers broad applicability and the potential to transform fish health and welfare monitoring in finfish aquaculture.
  arXiv  Detail & Related papers  (2025-04-28T12:13:57Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images.<n>This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems [56.0640340392818]
  We introduce a framework, FREE, that enables the use of varying features and available information to train a universal model.<n>The core idea is to map available environmental data into a text space and then convert the traditional predictive modeling task in environmental science to a semantic recognition problem.<n>Our evaluation on two societally important real-world applications, stream water temperature prediction and crop yield prediction, demonstrates the superiority of FREE over multiple baselines.
  arXiv  Detail & Related papers  (2023-11-17T00:53:09Z)
• Experiential-Informed Data Reconstruction for Fishery Sustainability and Policies in the Azores [3.2873782624127834]
  We focus on a unique data set from the Azores' fishing data collection programs between 2010 and 2017. We leverage domain knowledge and machine learning methods to retrieve or associate metier-related information to each fish landing.
  arXiv  Detail & Related papers  (2023-09-17T17:17:38Z)
• Predicting the long-term collective behaviour of fish pairs with deep learning [52.83927369492564]
  This study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach to experiments and to the results of a state-of-the-art analytical model. We demonstrate that machine learning models social interactions can directly compete with their analytical counterparts in subtle experimental observables.
  arXiv  Detail & Related papers  (2023-02-14T05:25:03Z)
• How to Track and Segment Fish without Human Annotations: A Self-Supervised Deep Learning Approach [3.0516727053033392]
  Training deep neural networks (DNNs) for fish tracking and segmentation requires high-quality labels.<n>We propose an unsupervised approach that relies on spatial and temporal variations in video data to generate noisy pseudo-ground-truth labels.<n>Our framework consists of three stages: (1) an optical flow model generates the pseudo labels using spatial and temporal consistency between frames, (2) a self-supervised model refines the pseudo-labels incrementally, and (3) a segmentation network uses the refined labels for training.
  arXiv  Detail & Related papers  (2022-08-23T01:01:27Z)
• Movement Tracks for the Automatic Detection of Fish Behavior in Videos [63.85815474157357]
  We offer a dataset of sablefish (Anoplopoma fimbria) startle behaviors in underwater videos, and investigate the use of deep learning (DL) methods for behavior detection on it. Our proposed detection system identifies fish instances using DL-based frameworks, determines trajectory tracks, derives novel behavior-specific features, and employs Long Short-Term Memory (LSTM) networks to identify startle behavior in sablefish.
  arXiv  Detail & Related papers  (2020-11-28T05:51:19Z)
• Automatic image-based identification and biomass estimation of invertebrates [70.08255822611812]
  Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed. We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology. We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
  arXiv  Detail & Related papers  (2020-02-05T21:38:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.