SelectTSL: Prompt-Guided Selective Target Sound Localization in Complex Scenarios

• URL: http://arxiv.org/abs/2607.02343v1
• Date: Thu, 02 Jul 2026 15:49:10 GMT
• Title: SelectTSL: Prompt-Guided Selective Target Sound Localization in Complex Scenarios
• Abstract summary: We propose an end-to-end architecture that localizes only the user-specified target in multi-source acoustic scenes.<n>Specifically, we design a target-aware selective localization strategy that employs a Prompt-Guided Selective Attention Module.<n>This coupled design effectively focuses on the user-specified target spatial cues for selective localization and also handles time-varying numbers of target sources.
• Score: 95.0451976922633
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Humans can selectively attend to a target sound and estimate its direction in complex scenarios, whereas such selective localization remains challenging for current deep learning-based systems. Sound source localization (SSL) has achieved remarkable success with deep learning, yet most methods localize all active sources without selectivity. Conversely, target sound extraction (TSE) extracts sources using multimodal prompts but typically fails to preserve the multichannel spatial information required for accurate localization. To bridge this gap, we formulate the task of prompt-guided selective target sound localization and propose SelectTSL, an end-to-end architecture that localizes only the user-specified target in multi-source acoustic scenes. Specifically, we design a target-aware selective localization strategy that employs a Prompt-Guided Selective Attention Module (PGSA) to generate prompt-informed embeddings. These embeddings guide an inter-channel phase difference (IPD) enhancer to refine raw phase cues, fusing with target magnitudes to jointly estimate direction of arrival (DoA) and target-source cardinality, i.e., the number of target sound sources. This coupled design effectively focuses on the user-specified target spatial cues for selective localization and also handles time-varying numbers of target sources. Extensive experiments on both synthetic data and real-world recordings demonstrate that our proposed method consistently outperforms other baselines and exhibits robust generalization to real acoustic environments.

Related papers

• ActiveScope: Actively Seeking and Correcting Perception for MLLMs [73.84325380140547]
  Multimodal Large Language Models (MLLMs) have demonstrated impressive vision-correction understanding, yet still struggle with fine-grained perception in high-resolution images.<n>We propose ActiveScope, a training-free framework that enhances MLLMs by actively seeking and correcting perception.
  arXiv  Detail & Related papers  (2026-06-23T08:17:15Z)
• Spatio-Temporal Audio Language Modeling for Dynamic Sound Sources [57.68713138159972]
  We present a time-resolved audio encoder that learns event semantics together with source trajectories.<n>Experiments show that this representation improves the semanticlocalization and yields stronger reasoning than spatial and localization-oriented tradeoffs.
  arXiv  Detail & Related papers  (2026-06-12T05:58:31Z)
• Generate, Analyze, and Refine: Training-Free Sound Source Localization via MLLM Meta-Reasoning [24.266987119038134]
  Sound source localization task aims to identify the locations of sound-emitting objects by leveraging correlations between audio and visual modalities.<n>Most existing SSL methods rely on contrastive learning-based feature matching, but lack explicit reasoning and verification.<n>We propose a training-free SSL framework that exploits the intrinsic reasoning capabilities of Multimodal Large Language Models.
  arXiv  Detail & Related papers  (2026-04-08T08:40:33Z)
• Shared Representation Learning for Reference-Guided Targeted Sound Detection [12.339689044414401]
  We propose a unified encoder architecture that processes both the reference and mixture audio within a shared representation space.<n>We establish a new state-of-the-art benchmark for targeted sound detection with a segment-level F1 score of 83.15%.
  arXiv  Detail & Related papers  (2026-03-17T18:05:21Z)
• Target-Oriented Single Domain Generalization [27.182037614828968]
  Deep models trained on a single source domain often fail catastrophically under distribution shifts.<n>We propose Target-Oriented Single Domain Generalization, a novel problem setup that leverages the textual description of the target domain.<n>We introduce Spectral TARget Alignment (STAR), a module that injects target semantics into source features.
  arXiv  Detail & Related papers  (2025-08-30T04:21:48Z)
• GlocalCLIP: Object-agnostic Global-Local Prompt Learning for Zero-shot Anomaly Detection [5.530212768657544]
  We introduce glocal contrastive learning to improve the complementary learning of global and local prompts.<n>The generalization performance of GlocalCLIP in ZSAD was demonstrated on 15 real-world datasets.
  arXiv  Detail & Related papers  (2024-11-09T05:22:13Z)
• Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization using Geometrical Information [68.10033984296247]
  This paper explores the domain of active localization, emphasizing the importance of viewpoint selection to enhance localization accuracy. Our contributions involve using a data-driven approach with a simple architecture designed for real-time operation, a self-supervised data training method, and the capability to consistently integrate our map into a planning framework tailored for real-world robotics applications.
  arXiv  Detail & Related papers  (2024-07-22T12:32:09Z)
• Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledge [14.801564966406486]
  The goal of the multi-sound source localization task is to localize sound sources from the mixture individually. We present a novel multi-sound source localization method that can perform localization without prior knowledge of the number of sound sources.
  arXiv  Detail & Related papers  (2024-03-26T06:27:50Z)
• Position tracking of a varying number of sound sources with sliding permutation invariant training [19.873949136858354]
  We present a new training strategy for deep learning sound source localization models. It is based on the mean squared error of the optimal association between estimated and reference positions. It minimizes identity switches without compromising frame-wise localization accuracy.
  arXiv  Detail & Related papers  (2022-10-26T07:54:47Z)
• PILOT: Introducing Transformers for Probabilistic Sound Event Localization [107.78964411642401]
  This paper introduces a novel transformer-based sound event localization framework, where temporal dependencies in the received multi-channel audio signals are captured via self-attention mechanisms. The framework is evaluated on three publicly available multi-source sound event localization datasets and compared against state-of-the-art methods in terms of localization error and event detection accuracy.
  arXiv  Detail & Related papers  (2021-06-07T18:29:19Z)
• Progressive Localization Networks for Language-based Moment Localization [56.54450664871467]
  This paper focuses on the task of language-based moment localization. Most existing methods prefer to first sample sufficient candidate moments with various temporal lengths, and then match them with the given query to determine the target moment. We propose a novel multi-stage Progressive localization Network (PLN) which progressively localizes the target moment in a coarse-to-fine manner.
  arXiv  Detail & Related papers  (2021-02-02T03:45:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.