Time-frequency localization of bird calls in dense soundscapes

• URL: http://arxiv.org/abs/2606.10407v1
• Date: Tue, 09 Jun 2026 04:31:30 GMT
• Title: Time-frequency localization of bird calls in dense soundscapes
• Abstract summary: We formulate bird vocalization detection as an object detection task on spectrograms.<n>We train YOLO11 models to localize bird calls in dense tropical soundscapes from Singapore.<n>These results suggest that object detection frameworks are a promising approach to time-frequency localization of animal vocalizations in complex soundscapes.
• Score: 0.34797121357690153
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Passive acoustic monitoring enables large-scale observation of wildlife, but most bioacoustic classifiers only predict species presence in a time window without localizing vocalizations precisely in time or frequency, limiting downstream analyses. We formulate bird vocalization detection as an object detection task on spectrograms and train YOLO11 models to localize bird calls in dense tropical soundscapes from Singapore. We additionally introduce an open-source browser-based annotation tool and propose Intersection over Minimum (IoMin), an evaluation metric that better handles ambiguous acoustic boundaries than standard IoU and is better suited to the problem at hand. The best YOLO model nearly doubles baseline performance on in-distribution soundscapes from Singapore (81.8% vs. 42.1% IoMin@50 F1-score) while still outperforming the baseline on unseen out-of-distribution recordings from Hawaii (58.6% vs. 48.6%). These results suggest that object detection frameworks are a promising approach to time-frequency localization of animal vocalizations in complex soundscapes.

Related papers

• MAST: Label-Efficient, Robust, and Generalizable Sound Detection for Biodiversity Monitoring via Masked Audio Pretraining and Self-Training [7.983925207958734]
  Time-frequency annotation of animal vocalizations is expensive, site-specific, and difficult to sustain at scale.<n>We present a label-efficient sound detection framework that combines masked audio pretraining with a lightweight detector on mel spectrograms.<n>We evaluate the performance on two ecologically distinct domains: tropical rainforest soundscapes (Indonesia) and bird vocalizations in Mediterranean habitats (Spain)
  arXiv  Detail & Related papers  (2026-09-14T08:41:23Z)
• Aionoscope: Debugging Latent-State Accessibility in Time-Series Representations [59.34593956287438]
  Aionoscope is a diagnostic tool for inspecting latent-state accessibility in frozen time-series representations.<n>Aionoscope separates process generation from observation rendering, producing seeded synthetic streams with exact categorical and dense labels.
  arXiv  Detail & Related papers  (2026-07-01T13:54:20Z)
• WoW-Bench: Evaluating Fine-Grained Acoustic Perception in Audio-Language Models via Marine Mammal Vocalizations [67.6147632074449]
  We introduce the World-of-Whale benchmark (WoW-Bench) to evaluate low-level auditory perception and cognition using marine mammal vocalizations.<n>WoW-Bench is composed of a Perception benchmark for categorizing novel sounds and a Cognition benchmark, inspired by Bloom's taxonomy, to assess the abilities to remember, understand, apply, and analyze sound events.<n>Experiments with state-of-the-art LALMs show performance far below human levels, indicating a need for stronger auditory grounding in LALMs.
  arXiv  Detail & Related papers  (2025-08-28T16:29:46Z)
• Learning Robust Spatial Representations from Binaural Audio through Feature Distillation [64.36563387033921]
  We investigate the use of a pretraining stage based on feature distillation to learn a robust spatial representation of speech without the need for data labels.<n>Our experiments demonstrate that the pretrained models show improved performance in noisy and reverberant environments.
  arXiv  Detail & Related papers  (2025-08-28T15:43:15Z)
• Time Is a Feature: Exploiting Temporal Dynamics in Diffusion Language Models [57.474294329887236]
  Diffusion large language models (dLLMs) generate text through iterative denoising.<n>Current decoding strategies discard rich intermediate predictions in favor of the final output.<n>We introduce two complementary methods that exploit temporal consistency.
  arXiv  Detail & Related papers  (2025-08-12T17:59:57Z)
• A Bird Song Detector for improving bird identification through Deep Learning: a case study from Doñana [2.7924253850013416]
  A key challenge in bird species identification is that many recordings lack target species or contain overlapping vocalizations.<n>We developed a multi-stage pipeline for automatic bird vocalization identification in Donana National Park (SW Spain)<n>We first applied a Bird Song Detector to isolate bird vocalizations using spectrogram-based image processing. Then, species were classified using custom models trained at the local scale.
  arXiv  Detail & Related papers  (2025-03-19T13:19:06Z)
• Semi-supervised classification of bird vocalizations [0.0]
  Changes in bird populations can indicate broader changes in ecosystems.<n>We propose a semi-supervised acoustic bird detector to allow the detection of time-overlapping calls.<n>It achieves a mean F0.5 score of 0.701 across 315 classes from 110 bird species on a hold-out test set.
  arXiv  Detail & Related papers  (2025-02-19T05:31:13Z)
• NBM: an Open Dataset for the Acoustic Monitoring of Nocturnal Migratory Birds in Europe [0.0]
  This work presents the Nocturnal Bird Migration dataset, a collection of 13,359 annotated vocalizations from 117 species of the Western Palearctic.<n>The dataset includes precise time and frequency annotations, gathered by dozens of bird enthusiasts across France.<n>In particular, we prove the utility of this database by training an original two-stage deep object detection model tailored for the processing of audio data.
  arXiv  Detail & Related papers  (2024-12-04T18:55:45Z)
• AudioProtoPNet: An interpretable deep learning model for bird sound classification [1.49199020343864]
  This study introduces AudioProtoPNet, an adaptation of the Prototypical Part Network (ProtoPNet) for multi-label bird sound classification. It is an inherently interpretable model that uses a ConvNeXt backbone to extract embeddings. The model was trained on the BirdSet training dataset, which consists of 9,734 bird species and over 6,800 hours of recordings.
  arXiv  Detail & Related papers  (2024-04-16T09:37:41Z)
• SoundDet: Polyphonic Sound Event Detection and Localization from Raw Waveform [48.68714598985078]
  SoundDet is an end-to-end trainable and light-weight framework for polyphonic moving sound event detection and localization. SoundDet directly consumes the raw, multichannel waveform and treats the temporal sound event as a complete sound-object" to be detected. A dense sound proposal event map is then constructed to handle the challenges of predicting events with large varying temporal duration.
  arXiv  Detail & Related papers  (2021-06-13T11:43:41Z)
• Learning based signal detection for MIMO systems with unknown noise statistics [84.02122699723536]
  This paper aims to devise a generalized maximum likelihood (ML) estimator to robustly detect signals with unknown noise statistics. In practice, there is little or even no statistical knowledge on the system noise, which in many cases is non-Gaussian, impulsive and not analyzable. Our framework is driven by an unsupervised learning approach, where only the noise samples are required.
  arXiv  Detail & Related papers  (2021-01-21T04:48:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.