Movement Tracks for the Automatic Detection of Fish Behavior in Videos
- URL: http://arxiv.org/abs/2011.14070v1
- Date: Sat, 28 Nov 2020 05:51:19 GMT
- Title: Movement Tracks for the Automatic Detection of Fish Behavior in Videos
- Authors: Declan McIntosh, Tunai Porto Marques, Alexandra Branzan Albu, Rodney
Rountree, Fabio De Leo
- Abstract summary: We offer a dataset of sablefish (Anoplopoma fimbria) startle behaviors in underwater videos, and investigate the use of deep learning (DL) methods for behavior detection on it.
Our proposed detection system identifies fish instances using DL-based frameworks, determines trajectory tracks, derives novel behavior-specific features, and employs Long Short-Term Memory (LSTM) networks to identify startle behavior in sablefish.
- Score: 63.85815474157357
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Global warming is predicted to profoundly impact ocean ecosystems. Fish
behavior is an important indicator of changes in such marine environments.
Thus, the automatic identification of key fish behavior in videos represents a
much needed tool for marine researchers, enabling them to study climate
change-related phenomena. We offer a dataset of sablefish (Anoplopoma fimbria)
startle behaviors in underwater videos, and investigate the use of deep
learning (DL) methods for behavior detection on it. Our proposed detection
system identifies fish instances using DL-based frameworks, determines
trajectory tracks, derives novel behavior-specific features, and employs Long
Short-Term Memory (LSTM) networks to identify startle behavior in sablefish.
Its performance is studied by comparing it with a state-of-the-art DL-based
video event detector.
Related papers
- A Bionic Data-driven Approach for Long-distance Underwater Navigation with Anomaly Resistance [59.21686775951903]
Various animals exhibit accurate navigation using environment cues.
Inspired by animal navigation, this work proposes a bionic and data-driven approach for long-distance underwater navigation.
The proposed approach uses measured geomagnetic data for the navigation, and requires no GPS systems or geographical maps.
arXiv Detail & Related papers (2024-02-06T13:20:56Z) - FishMOT: A Simple and Effective Method for Fish Tracking Based on IoU
Matching [11.39414015803651]
FishMOT is a novel fish tracking approach combining object detection and objectoU matching.
The method exhibits excellent robustness and generalizability for varying environments and fish numbers.
arXiv Detail & Related papers (2023-09-06T13:16:41Z) - Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
This paper seeks transferable prior knowledge from detector-friendly images.
It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps.
Our method with higher speeds and less parameters still performs better than transformer-based detectors.
arXiv Detail & Related papers (2023-08-24T12:32:46Z) - TempNet: Temporal Attention Towards the Detection of Animal Behaviour in
Videos [63.85815474157357]
We propose an efficient computer vision- and deep learning-based method for the detection of biological behaviours in videos.
TempNet uses an encoder bridge and residual blocks to maintain model performance with a two-staged, spatial, then temporal, encoder.
We demonstrate its application to the detection of sablefish (Anoplopoma fimbria) startle events.
arXiv Detail & Related papers (2022-11-17T23:55:12Z) - Watermarking for Out-of-distribution Detection [76.20630986010114]
Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models.
We propose a general methodology named watermarking in this paper.
We learn a unified pattern that is superimposed onto features of original data, and the model's detection capability is largely boosted after watermarking.
arXiv Detail & Related papers (2022-10-27T06:12:32Z) - Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and
Survey [1.9249287163937976]
Deep learning (DL) is a cutting-edge AI technology that has demonstrated unprecedented performance in analysing visual data.
In this paper, we provide a tutorial that covers the key concepts of DL, which help the reader grasp a high-level understanding of how DL works.
The tutorial also explains a step-by-step procedure on how DL algorithms should be developed for challenging applications such as underwater fish monitoring.
arXiv Detail & Related papers (2022-06-11T01:59:54Z) - Computer Vision and Deep Learning for Fish Classification in Underwater
Habitats: A Survey [2.363388546004777]
Marine scientists use remote underwater video recording to survey fish species in their natural habitats.
The enormous volume of collected videos makes extracting useful information a daunting and time-consuming task for a human.
Deep Learning technology can help marine scientists parse large volumes of video promptly and efficiently.
arXiv Detail & Related papers (2022-03-14T09:32:25Z) - Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation [78.17108227614928]
We propose a benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation.
We consider a value-based and policy-gradient Deep Reinforcement Learning (DRL)
We also propose a verification strategy that checks the behavior of the trained models over a set of desired properties.
arXiv Detail & Related papers (2021-12-16T16:53:56Z) - A Survey of Fish Tracking Techniques Based on Computer Vision [11.994865945394139]
This paper presents a review of the advancements of fish tracking technologies over the past seven years-2023.
It explores diverse fish tracking techniques with an emphasis on fundamental localization and tracking methods.
It also summarizes open-source datasets, evaluation metrics, challenges, and applications in fish tracking research.
arXiv Detail & Related papers (2021-10-06T07:46:35Z) - Automated Stitching of Coral Reef Images and Extraction of Features for
Damselfish Shoaling Behavior Analysis [0.0]
In marine ethology, the investigation of behavioral patterns in schooling species can provide supplemental information in the planning and management of marine resources.
Currently, damselfish species, although prevalent in tropical waters, have no adequate established base behavior information.
Visual marine data captured in the wild are scarce and prone to multiple scene variations, primarily caused by motion and changes in the natural environment.
arXiv Detail & Related papers (2020-06-28T00:56:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.