Fish sounds: towards the evaluation of marine acoustic biodiversity
through data-driven audio source separation
- URL: http://arxiv.org/abs/2201.05013v2
- Date: Fri, 14 Jan 2022 10:51:08 GMT
- Title: Fish sounds: towards the evaluation of marine acoustic biodiversity
through data-driven audio source separation
- Authors: Michele Mancusi, Nicola Zonca, Emanuele Rodol\`a, Silvia Zuffi
- Abstract summary: The marine ecosystem is changing at an alarming rate, exhibiting biodiversity loss and the migration of tropical species to temperate basins.
One of the most popular and effective methods for monitoring marine biodiversity is passive acoustics monitoring (PAM)
In this work, we show that the same techniques can be successfully used to automatically extract fish vocalizations in PAM recordings.
- Score: 1.9116784879310027
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: The marine ecosystem is changing at an alarming rate, exhibiting biodiversity
loss and the migration of tropical species to temperate basins. Monitoring the
underwater environments and their inhabitants is of fundamental importance to
understand the evolution of these systems and implement safeguard policies.
However, assessing and tracking biodiversity is often a complex task,
especially in large and uncontrolled environments, such as the oceans. One of
the most popular and effective methods for monitoring marine biodiversity is
passive acoustics monitoring (PAM), which employs hydrophones to capture
underwater sound. Many aquatic animals produce sounds characteristic of their
own species; these signals travel efficiently underwater and can be detected
even at great distances. Furthermore, modern technologies are becoming more and
more convenient and precise, allowing for very accurate and careful data
acquisition. To date, audio captured with PAM devices is frequently manually
processed by marine biologists and interpreted with traditional signal
processing techniques for the detection of animal vocalizations. This is a
challenging task, as PAM recordings are often over long periods of time.
Moreover, one of the causes of biodiversity loss is sound pollution; in data
obtained from regions with loud anthropic noise, it is hard to separate the
artificial from the fish sound manually. Nowadays, machine learning and, in
particular, deep learning represents the state of the art for processing audio
signals. Specifically, sound separation networks are able to identify and
separate human voices and musical instruments. In this work, we show that the
same techniques can be successfully used to automatically extract fish
vocalizations in PAM recordings, opening up the possibility for biodiversity
monitoring at a large scale.
Related papers
- Generalization in birdsong classification: impact of transfer learning methods and dataset characteristics [2.6740633963478095]
We explore the effectiveness of transfer learning in large-scale bird sound classification.
Our experiments demonstrate that both fine-tuning and knowledge distillation yield strong performance.
We advocate for more comprehensive labeling practices within the animal sound community.
arXiv Detail & Related papers (2024-09-21T11:33:12Z) - WhaleNet: a Novel Deep Learning Architecture for Marine Mammals Vocalizations on Watkins Marine Mammal Sound Database [49.1574468325115]
We introduce textbfWhaleNet (Wavelet Highly Adaptive Learning Ensemble Network), a sophisticated deep ensemble architecture for the classification of marine mammal vocalizations.
We achieve an improvement in classification accuracy by $8-10%$ over existing architectures, corresponding to a classification accuracy of $97.61%$.
arXiv Detail & Related papers (2024-02-20T11:36:23Z) - Automated Detection of Dolphin Whistles with Convolutional Networks and
Transfer Learning [7.52108936537426]
We show that convolutional neural networks can significantly outperform traditional automatic methods in a challenging detection task.
The proposed system can detect signals even in the presence of ambient noise, at the same time consistently reducing the likelihood of producing false positives and false negatives.
arXiv Detail & Related papers (2022-11-28T15:06:46Z) - LudVision -- Remote Detection of Exotic Invasive Aquatic Floral Species
using Drone-Mounted Multispectral Data [0.34998703934432673]
Ludwigia peploides is considered by the European Union as an aquatic invasive species.
Our goal was to develop a method to identify the presence of the species.
To identify the targeted species on the collected images, we propose a new method for detecting Ludwigia p.
arXiv Detail & Related papers (2022-07-12T15:43:21Z) - Seeing biodiversity: perspectives in machine learning for wildlife
conservation [49.15793025634011]
We argue that machine learning can meet this analytic challenge to enhance our understanding, monitoring capacity, and conservation of wildlife species.
In essence, by combining new machine learning approaches with ecological domain knowledge, animal ecologists can capitalize on the abundance of data generated by modern sensor technologies.
arXiv Detail & Related papers (2021-10-25T13:40:36Z) - Cetacean Translation Initiative: a roadmap to deciphering the
communication of sperm whales [97.41394631426678]
Recent research showed the promise of machine learning tools for analyzing acoustic communication in nonhuman species.
We outline the key elements required for the collection and processing of massive bioacoustic data of sperm whales.
The technological capabilities developed are likely to yield cross-applications and advancements in broader communities investigating non-human communication and animal behavioral research.
arXiv Detail & Related papers (2021-04-17T18:39:22Z) - Discriminative Singular Spectrum Classifier with Applications on
Bioacoustic Signal Recognition [67.4171845020675]
We present a bioacoustic signal classifier equipped with a discriminative mechanism to extract useful features for analysis and classification efficiently.
Unlike current bioacoustic recognition methods, which are task-oriented, the proposed model relies on transforming the input signals into vector subspaces.
The validity of the proposed method is verified using three challenging bioacoustic datasets containing anuran, bee, and mosquito species.
arXiv Detail & Related papers (2021-03-18T11:01:21Z) - Modelling Animal Biodiversity Using Acoustic Monitoring and Deep
Learning [0.0]
This paper outlines an approach for achieving this using state of the art in machine learning to automatically extract features from time-series audio signals.
The acquired bird songs are processed using mel-frequency cepstrum (MFC) to extract features which are later classified using a multilayer perceptron (MLP)
Our proposed method achieved promising results with 0.74 sensitivity, 0.92 specificity and an accuracy of 0.74.
arXiv Detail & Related papers (2021-03-12T13:50:31Z) - Movement Tracks for the Automatic Detection of Fish Behavior in Videos [63.85815474157357]
We offer a dataset of sablefish (Anoplopoma fimbria) startle behaviors in underwater videos, and investigate the use of deep learning (DL) methods for behavior detection on it.
Our proposed detection system identifies fish instances using DL-based frameworks, determines trajectory tracks, derives novel behavior-specific features, and employs Long Short-Term Memory (LSTM) networks to identify startle behavior in sablefish.
arXiv Detail & Related papers (2020-11-28T05:51:19Z) - Automated Stitching of Coral Reef Images and Extraction of Features for
Damselfish Shoaling Behavior Analysis [0.0]
In marine ethology, the investigation of behavioral patterns in schooling species can provide supplemental information in the planning and management of marine resources.
Currently, damselfish species, although prevalent in tropical waters, have no adequate established base behavior information.
Visual marine data captured in the wild are scarce and prone to multiple scene variations, primarily caused by motion and changes in the natural environment.
arXiv Detail & Related papers (2020-06-28T00:56:51Z) - Automatic image-based identification and biomass estimation of
invertebrates [70.08255822611812]
Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed.
We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology.
We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
arXiv Detail & Related papers (2020-02-05T21:38:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.