A Multi-purpose Tracking Framework for Salmon Welfare Monitoring in Challenging Environments

• URL: http://arxiv.org/abs/2509.25969v1
• Date: Tue, 30 Sep 2025 09:05:07 GMT
• Title: A Multi-purpose Tracking Framework for Salmon Welfare Monitoring in Challenging Environments
• Authors: Espen Uri Høgstedt, Christian Schellewald, Annette Stahl, Rudolf Mester,
• Abstract summary: We propose a flexible tracking framework that uses a pose estimation network to extract bounding boxes around salmon and their corresponding body parts.<n>We construct two novel datasets assessing two salmon tracking challenges.<n>Our method outperforms the current state-of-the-art pedestrian tracker, BoostTrack, for both salmon tracking challenges.
• Score: 1.1879560078316007
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Computer Vision (CV)-based continuous, automated and precise salmon welfare monitoring is a key step toward reduced salmon mortality and improved salmon welfare in industrial aquaculture net pens. Available CV methods for determining welfare indicators focus on single indicators and rely on object detectors and trackers from other application areas to aid their welfare indicator calculation algorithm. This comes with a high resource demand for real-world applications, since each indicator must be calculated separately. In addition, the methods are vulnerable to difficulties in underwater salmon scenes, such as object occlusion, similar object appearance, and similar object motion. To address these challenges, we propose a flexible tracking framework that uses a pose estimation network to extract bounding boxes around salmon and their corresponding body parts, and exploits information about the body parts, through specialized modules, to tackle challenges specific to underwater salmon scenes. Subsequently, the high-detail body part tracks are employed to calculate welfare indicators. We construct two novel datasets assessing two salmon tracking challenges: salmon ID transfers in crowded scenes and salmon ID switches during turning. Our method outperforms the current state-of-the-art pedestrian tracker, BoostTrack, for both salmon tracking challenges. Additionally, we create a dataset for calculating salmon tail beat wavelength, demonstrating that our body part tracking method is well-suited for automated welfare monitoring based on tail beat analysis. Datasets and code are available at https://github.com/espenbh/BoostCompTrack.

Related papers

• Learning to Track Any Points from Human Motion [55.831218129679144]
  We propose an automated pipeline to generate pseudo-labeled training data for point tracking.<n>A point tracking model trained on AnthroTAP achieves annotated state-of-the-art performance on the TAP-Vid benchmark.
  arXiv  Detail & Related papers  (2025-07-08T17:59:58Z)
• Counting Fish with Temporal Representations of Sonar Video [15.713015426791221]
  We propose an alternative lightweight computer vision method for fish counting based on analyzing echograms.<n>We achieve a count error of 23% on representative data from the Kenai River in Alaska, demonstrating the feasibility of our approach.
  arXiv  Detail & Related papers  (2025-02-07T18:02:28Z)
• Underwater Camouflaged Object Tracking Meets Vision-Language SAM2 [60.47622353256502]
  We propose the first large-scale multi-modal underwater camouflaged object tracking dataset, namely UW-COT220.<n>Based on the proposed dataset, this work first evaluates current advanced visual object tracking methods, including SAM- and SAM2-based trackers, in challenging underwater environments.<n>Our findings highlight the improvements of SAM2 over SAM, demonstrating its enhanced ability to handle the complexities of underwater camouflaged objects.
  arXiv  Detail & Related papers  (2024-09-25T13:10:03Z)
• Multi-Object Tracking by Iteratively Associating Detections with Uniform Appearance for Trawl-Based Fishing Bycatch Monitoring [22.228127377617028]
  The aim of in-trawl catch monitoring for use in fishing operations is to detect, track and classify fish targets in real-time from video footage. We propose a novel MOT method, built upon an existing observation-centric tracking algorithm, by adopting a new iterative association step. Our method offers improved performance in tracking targets with uniform appearance and outperforms state-of-the-art techniques on our underwater fish datasets as well as the MOT17 dataset.
  arXiv  Detail & Related papers  (2023-04-10T18:55:10Z)
• Unsupervised Learning of Accurate Siamese Tracking [68.58171095173056]
  We present a novel unsupervised tracking framework, in which we can learn temporal correspondence both on the classification branch and regression branch. Our tracker outperforms preceding unsupervised methods by a substantial margin, performing on par with supervised methods on large-scale datasets such as TrackingNet and LaSOT.
  arXiv  Detail & Related papers  (2022-04-04T13:39:43Z)
• A Survey of Fish Tracking Techniques Based on Computer Vision [11.994865945394139]
  This paper presents a review of the advancements of fish tracking technologies over the past seven years-2023. It explores diverse fish tracking techniques with an emphasis on fundamental localization and tracking methods. It also summarizes open-source datasets, evaluation metrics, challenges, and applications in fish tracking research.
  arXiv  Detail & Related papers  (2021-10-06T07:46:35Z)
• FishNet: A Unified Embedding for Salmon Recognition [0.37798600249187286]
  We propose FishNet, based on a deep learning technique that has been successfully used for identifying humans. Our experiments show that this architecture learns a useful representation based on images of salmon heads. FishNet achieves a false positive rate of 1% and a true positive rate of 96%.
  arXiv  Detail & Related papers  (2020-10-20T17:35:01Z)
• A Realistic Fish-Habitat Dataset to Evaluate Algorithms for Underwater Visual Analysis [2.6476746128312194]
  We present DeepFish as a benchmark suite with a large-scale dataset to train and test methods for several computer vision tasks. The dataset consists of approximately 40 thousand images collected underwater from 20 greenhabitats in the marine-environments of tropical Australia. Our experiments provide an in-depth analysis of the dataset characteristics, and the performance evaluation of several state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-08-28T12:20:59Z)
• Self-supervised Object Tracking with Cycle-consistent Siamese Networks [55.040249900677225]
  We exploit an end-to-end Siamese network in a cycle-consistent self-supervised framework for object tracking. We propose to integrate a Siamese region proposal and mask regression network in our tracking framework so that a fast and more accurate tracker can be learned without the annotation of each frame.
  arXiv  Detail & Related papers  (2020-08-03T04:10:38Z)
• Unsupervised Deep Representation Learning for Real-Time Tracking [137.69689503237893]
  We propose an unsupervised learning method for visual tracking. The motivation of our unsupervised learning is that a robust tracker should be effective in bidirectional tracking. We build our framework on a Siamese correlation filter network, and propose a multi-frame validation scheme and a cost-sensitive loss to facilitate unsupervised learning.
  arXiv  Detail & Related papers  (2020-07-22T08:23:12Z)
• Object Tracking through Residual and Dense LSTMs [67.98948222599849]
  Deep learning-based trackers based on LSTMs (Long Short-Term Memory) recurrent neural networks have emerged as a powerful alternative. DenseLSTMs outperform Residual and regular LSTM, and offer a higher resilience to nuisances. Our case study supports the adoption of residual-based RNNs for enhancing the robustness of other trackers.
  arXiv  Detail & Related papers  (2020-06-22T08:20:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.