Your Microphone Array Retains Your Identity: A Robust Voice Liveness Detection System for Smart Speakers

• URL: http://arxiv.org/abs/2510.24393v1
• Date: Tue, 28 Oct 2025 13:05:30 GMT
• Title: Your Microphone Array Retains Your Identity: A Robust Voice Liveness Detection System for Smart Speakers
• Abstract summary: We propose a novel liveness feature, array fingerprint, which utilizes the microphone array to determine the identity of collected audios.<n>Our evaluation on the dataset containing 32,780 audio samples and 14 spoofing devices shows that ARRAYID achieves an accuracy of 99.84%.
• Score: 15.791088130388337
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Though playing an essential role in smart home systems, smart speakers are vulnerable to voice spoofing attacks. Passive liveness detection, which utilizes only the collected audio rather than the deployed sensors to distinguish between live-human and replayed voices, has drawn increasing attention. However, it faces the challenge of performance degradation under the different environmental factors as well as the strict requirement of the fixed user gestures. In this study, we propose a novel liveness feature, array fingerprint, which utilizes the microphone array inherently adopted by the smart speaker to determine the identity of collected audios. Our theoretical analysis demonstrates that by leveraging the circular layout of microphones, compared with existing schemes, array fingerprint achieves a more robust performance under the environmental change and user's movement. Then, to leverage such a fingerprint, we propose ARRAYID, a lightweight passive detection scheme, and elaborate a series of features working together with array fingerprint. Our evaluation on the dataset containing 32,780 audio samples and 14 spoofing devices shows that ARRAYID achieves an accuracy of 99.84%, which is superior to existing passive liveness detection schemes.

Related papers

• Transforming Keystroke Noise to Text: Self-Supervised Acoustic Eavesdropping Attacks on Keyboards [5.107513187852866]
  We present a self-supervised acoustic eavesdropping attack that reconstructs typed text solely from keystroke sounds.<n>The proposed attack enables stealthy eavesdropping in two real-world scenarios-physical spaces and online meetings.
  arXiv  Detail & Related papers  (2026-07-24T08:43:16Z)
• Speaker Embeddings to Improve Tracking of Intermittent and Moving Speakers [53.12031345322412]
  We propose to perform identity reassignment post-tracking, using speaker embeddings.<n>Beamforming is used to enhance the signal towards the speakers' positions in order to compute speaker embeddings.<n>We evaluate the performance of the proposed speaker embedding-based identity reassignment method on a dataset where speakers change position during inactivity periods.
  arXiv  Detail & Related papers  (2025-06-23T13:02:20Z)
• Speaker Fuzzy Fingerprints: Benchmarking Text-Based Identification in Multiparty Dialogues [2.048226951354646]
  We explore the use of fuzzy fingerprints from large pre-trained models to improve text-based speaker identification.<n>We integrate speaker-specific tokens and context-aware modeling, demonstrating that conversational context significantly boosts accuracy.<n>We analyze ambiguous utterances and propose a mechanism to detect speaker-agnostic lines.
  arXiv  Detail & Related papers  (2025-04-21T08:44:33Z)
• Controllable speech synthesis by learning discrete phoneme-level prosodic representations [53.926969174260705]
  We present a novel method for phoneme-level prosody control of F0 and duration using intuitive discrete labels. We propose an unsupervised prosodic clustering process which is used to discretize phoneme-level F0 and duration features from a multispeaker speech dataset.
  arXiv  Detail & Related papers  (2022-11-29T15:43:36Z)
• SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speech [10.354590276508283]
  Voice-activated systems are integrated into a variety of desktop, mobile, and Internet-of-Things (IoT) devices. Existing speaker verification techniques distinguish individual speakers via the spectrographic features extracted from an audible frequency range of voice commands. We propose a speaker verification system, SUPERVOICE, that uses a two-stream architecture with a feature fusion mechanism to generate distinctive speaker models.
  arXiv  Detail & Related papers  (2022-05-28T18:00:50Z)
• Multilingual Audio-Visual Smartphone Dataset And Evaluation [35.82191448400655]
  We present an audio-visual smartphone dataset captured in five different recent smartphones. Three different languages are acquired in this dataset to include the problem of language dependency of the speaker recognition systems. We also report the performance of the bench-marked biometric verification systems on our dataset.
  arXiv  Detail & Related papers  (2021-09-09T09:52:37Z)
• Speech Enhancement for Wake-Up-Word detection in Voice Assistants [60.103753056973815]
  Keywords spotting and in particular Wake-Up-Word (WUW) detection is a very important task for voice assistants. This paper proposes a Speech Enhancement model adapted to the task of WUW detection. It aims at increasing the recognition rate and reducing the false alarms in the presence of these types of noises.
  arXiv  Detail & Related papers  (2021-01-29T18:44:05Z)
• A Lightweight Speaker Recognition System Using Timbre Properties [0.5708902722746041]
  We propose a lightweight text-independent speaker recognition model based on random forest classifier. It also introduces new features that are used for both speaker verification and identification tasks. The prototype uses seven most actively searched properties, boominess, brightness, depth, hardness, timbre, sharpness, and warmth.
  arXiv  Detail & Related papers  (2020-10-12T07:56:03Z)
• Latent Fingerprint Registration via Matching Densely Sampled Points [100.53031290339483]
  Existing latent fingerprint registration approaches are mainly based on establishing correspondences between minutiae. We propose a non-minutia latent fingerprint registration method which estimates the spatial transformation between a pair of fingerprints. The proposed method achieves the state-of-the-art registration performance, especially under challenging conditions.
  arXiv  Detail & Related papers  (2020-05-12T15:51:59Z)
• Deep Speaker Embeddings for Far-Field Speaker Recognition on Short Utterances [53.063441357826484]
  Speaker recognition systems based on deep speaker embeddings have achieved significant performance in controlled conditions. Speaker verification on short utterances in uncontrolled noisy environment conditions is one of the most challenging and highly demanded tasks. This paper presents approaches aimed to achieve two goals: a) improve the quality of far-field speaker verification systems in the presence of environmental noise, reverberation and b) reduce the system qualitydegradation for short utterances.
  arXiv  Detail & Related papers  (2020-02-14T13:34:33Z)
• Speech Enhancement using Self-Adaptation and Multi-Head Self-Attention [70.82604384963679]
  This paper investigates a self-adaptation method for speech enhancement using auxiliary speaker-aware features. We extract a speaker representation used for adaptation directly from the test utterance.
  arXiv  Detail & Related papers  (2020-02-14T05:05:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.