MPT: A Large-scale Multi-Phytoplankton Tracking Benchmark

• URL: http://arxiv.org/abs/2410.16695v1
• Date: Tue, 22 Oct 2024 04:57:28 GMT
• Title: MPT: A Large-scale Multi-Phytoplankton Tracking Benchmark
• Abstract summary: We propose a benchmark dataset, Multiple Phytoplankton Tracking (MPT), which covers diverse background information and variations in motion during observation. The dataset includes 27 species of phytoplankton and zooplankton, 14 different backgrounds to simulate diverse and complex underwater environments, and a total of 140 videos. We introduce an additional feature extractor to predict the residuals of the standard feature extractor's output, and compute multi-scale frame-to-frame similarity based on features from different layers of the extractor.
• Score: 36.37530623015916
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Phytoplankton are a crucial component of aquatic ecosystems, and effective monitoring of them can provide valuable insights into ocean environments and ecosystem changes. Traditional phytoplankton monitoring methods are often complex and lack timely analysis. Therefore, deep learning algorithms offer a promising approach for automated phytoplankton monitoring. However, the lack of large-scale, high-quality training samples has become a major bottleneck in advancing phytoplankton tracking. In this paper, we propose a challenging benchmark dataset, Multiple Phytoplankton Tracking (MPT), which covers diverse background information and variations in motion during observation. The dataset includes 27 species of phytoplankton and zooplankton, 14 different backgrounds to simulate diverse and complex underwater environments, and a total of 140 videos. To enable accurate real-time observation of phytoplankton, we introduce a multi-object tracking method, Deviation-Corrected Multi-Scale Feature Fusion Tracker(DSFT), which addresses issues such as focus shifts during tracking and the loss of small target information when computing frame-to-frame similarity. Specifically, we introduce an additional feature extractor to predict the residuals of the standard feature extractor's output, and compute multi-scale frame-to-frame similarity based on features from different layers of the extractor. Extensive experiments on the MPT have demonstrated the validity of the dataset and the superiority of DSFT in tracking phytoplankton, providing an effective solution for phytoplankton monitoring.

Related papers

• FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales [65.4821703903285]
  FLORO is a multimodal foundation model designed to learn transferable representations from a small but highly diverse remote sensing corpus.<n> FLORO is pretrained using masked autoencoding on a heterogeneous combination of Sentinel-1, Sentinel-2, SkySAT imagery, elevation, and UAV-derived data.<n>We evaluated FLORO on the PANGAEA benchmark under a frozen-encoder protocol across scene classification, segmentation, and regression tasks.
  arXiv  Detail & Related papers  (2026-05-27T08:55:54Z)
• Planktonzilla: Multimodal dataset and models for understanding plankton ecosystems [0.602842844173992]
  Existing classification models perform well on individual collections but fail to generalize across instruments and environments.<n>We introduce Planktonzilla-17M, a unified dataset consolidating publicly available plankton image collections spanning thirteen imaging systems.<n>It comprises 17.4 million images with standardized taxonomy and geo-environmental metadata, including 3.74 million plankton images spanning over 602 taxonomic classes.
  arXiv  Detail & Related papers  (2026-05-22T13:54:57Z)
• PlankFormer: Robust Plankton Instance Segmentation via MAE-Pretrained Vision Transformers and Pseudo Community Image Generation [1.2314765641075438]
  Plankton is essential for assessing aquatic ecosystems but is limited by the labor-intensive nature of microscopic analysis.<n>The segmentation of plankton from crowded images is crucial, however, it faces two major challenges.<n>We propose PlankFormer, a novel framework for plankton instance segmentation.
  arXiv  Detail & Related papers  (2026-04-20T06:09:32Z)
• When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Tracking [3.5294997953439426]
  Multiple Fish Tracking dataset 2025 (MFT25) is the first comprehensive dataset specifically designed for underwater multiple fish tracking.<n>Our dataset captures various underwater environments, fish species, and challenging conditions including occlusions, similar appearances, and erratic motion patterns.<n>We introduce Scale-aware and Unscented Tracker (SU-T), a specialized tracking framework featuring an Unscented Kalman Filter (UKF) optimized for non-linear fish swimming patterns.
  arXiv  Detail & Related papers  (2025-07-08T21:08:12Z)
• Open-Set Plankton Recognition [0.10324748405849929]
  Modern automatic plankton imaging devices enable the collection of large-scale plankton image datasets. Plankton species recognition can be seen as an image classification task and is typically solved using deep learning-based image recognition models. This paper considers open-set recognition (OSR) of plankton images.
  arXiv  Detail & Related papers  (2025-03-14T11:35:36Z)
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
  We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images. This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
  arXiv  Detail & Related papers  (2025-03-06T05:13:19Z)
• PhyTracker: An Online Tracker for Phytoplankton [36.37513641359679]
  PhyTracker is an in situ tracking framework designed for automatic tracking of phytoplankton. Our method incorporates three innovative modules: a Texture-enhanced Feature Extraction (TFE) module, an Attention-enhanced Temporal Association (ATA) module, and a Flow-agnostic Movement Refinement (FMR) module.
  arXiv  Detail & Related papers  (2024-06-29T07:53:47Z)
• Deep-learning-powered data analysis in plankton ecology [31.874825130479174]
  The implementation of deep learning algorithms has brought new perspectives to plankton ecology. Deep learning offers objective schemes to investigate plankton organisms in diverse environments.
  arXiv  Detail & Related papers  (2023-09-15T16:04:11Z)
• Improving Underwater Visual Tracking With a Large Scale Dataset and Image Enhancement [70.2429155741593]
  This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT) It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles. We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality. The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
  arXiv  Detail & Related papers  (2023-08-30T07:41:26Z)
• Towards Phytoplankton Parasite Detection Using Autoencoders [0.06234523779509325]
  We propose an unsupervised anomaly detection system based on the similarity of the original and autoencoder-reconstructed samples. We were able to reach an overall F1 score of 0.75 in nine phytoplankton species.
  arXiv  Detail & Related papers  (2023-03-15T16:35:58Z)
• Plankton-FL: Exploration of Federated Learning for Privacy-Preserving Training of Deep Neural Networks for Phytoplankton Classification [81.04987357598802]
  In this study, we explore the feasibility of leveraging federated learning for privacy-preserving training of deep neural networks for phytoplankton classification. We simulate two different federated learning frameworks, federated learning (FL) and mutually exclusive FL (ME-FL) Experimental results from this study demonstrate the feasibility and potential of federated learning for phytoplankton monitoring.
  arXiv  Detail & Related papers  (2022-12-18T02:11:03Z)
• Efficient Unsupervised Learning for Plankton Images [12.447149371717]
  Monitoring plankton populations in situ is fundamental to preserve the aquatic ecosystem. The adoption of machine learning algorithms to classify such data may be affected by the significant cost of manual annotation. We propose an efficient unsupervised learning pipeline to provide accurate classification of plankton microorganisms.
  arXiv  Detail & Related papers  (2022-09-14T15:33:16Z)
• Towards Generating Large Synthetic Phytoplankton Datasets for Efficient Monitoring of Harmful Algal Blooms [77.25251419910205]
  Harmful algal blooms (HABs) cause significant fish deaths in aquaculture farms. Currently, the standard method to enumerate harmful algae and other phytoplankton is to manually observe and count them under a microscope. We employ Generative Adversarial Networks (GANs) to generate synthetic images.
  arXiv  Detail & Related papers  (2022-08-03T20:15:55Z)
• Deep Learning Classification of Lake Zooplankton [0.0]
  We present a set of deep learning models developed for the identification of lake plankton. To this aim, we annotated into 35 classes over 17900 images of zooplankton and large phytoplankton colonies. Our best models were based on transfer learning and ensembling, which classified plankton images with 98% accuracy and 93% F1 score.
  arXiv  Detail & Related papers  (2021-08-11T14:57:43Z)
• Movement Tracks for the Automatic Detection of Fish Behavior in Videos [63.85815474157357]
  We offer a dataset of sablefish (Anoplopoma fimbria) startle behaviors in underwater videos, and investigate the use of deep learning (DL) methods for behavior detection on it. Our proposed detection system identifies fish instances using DL-based frameworks, determines trajectory tracks, derives novel behavior-specific features, and employs Long Short-Term Memory (LSTM) networks to identify startle behavior in sablefish.
  arXiv  Detail & Related papers  (2020-11-28T05:51:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.