Does Language Matter for Early Detection of Parkinson's Disease from Speech?

• URL: http://arxiv.org/abs/2507.16832v1
• Date: Mon, 14 Jul 2025 19:23:09 GMT
• Title: Does Language Matter for Early Detection of Parkinson's Disease from Speech?
• Authors: Peter Plantinga, Briac Cordelle, Dominique Louër, Mirco Ravanelli, Denise Klein,
• Abstract summary: Using speech samples as a biomarker is a promising avenue for detecting and monitoring the progression of Parkinson's disease (PD)<n>To assess the role of language in PD detection, we tested pretrained models with varying data types and pretraining objectives.
• Score: 9.968776083852813
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Using speech samples as a biomarker is a promising avenue for detecting and monitoring the progression of Parkinson's disease (PD), but there is considerable disagreement in the literature about how best to collect and analyze such data. Early research in detecting PD from speech used a sustained vowel phonation (SVP) task, while some recent research has explored recordings of more cognitively demanding tasks. To assess the role of language in PD detection, we tested pretrained models with varying data types and pretraining objectives and found that (1) text-only models match the performance of vocal-feature models, (2) multilingual Whisper outperforms self-supervised models whereas monolingual Whisper does worse, and (3) AudioSet pretraining improves performance on SVP but not spontaneous speech. These findings together highlight the critical role of language for the early detection of Parkinson's disease.

Related papers

• Evaluating the Effectiveness of Pre-Trained Audio Embeddings for Classification of Parkinson's Disease Speech Data [0.7673339435080445]
  Speech impairments are prevalent biomarkers for Parkinson's Disease (PD)<n>Deep acoustic features have shown promise for PD classification, but their effectiveness often varies due to speaker differences.<n>This study investigates the effectiveness of three pre-trained audio embeddings for PD classification.
  arXiv  Detail & Related papers  (2025-06-02T09:32:54Z)
• Languages in Multilingual Speech Foundation Models Align Both Phonetically and Semantically [58.019484208091534]
  Cross-lingual alignment in pretrained language models (LMs) has enabled efficient transfer in text-based LMs.<n>It remains an open question whether findings and methods from text-based cross-lingual alignment apply to speech.
  arXiv  Detail & Related papers  (2025-05-26T07:21:20Z)
• Language-Agnostic Analysis of Speech Depression Detection [2.5764071253486636]
  This work analyzes automatic speech-based depression detection across two languages, English and Malayalam. A CNN model is trained to identify acoustic features associated with depression in speech, focusing on both languages. Our findings and collected data could contribute to the development of language-agnostic speech-based depression detection systems.
  arXiv  Detail & Related papers  (2024-09-23T07:35:56Z)
• Self-supervised Speech Models for Word-Level Stuttered Speech Detection [66.46810024006712]
  We introduce a word-level stuttering speech detection model leveraging self-supervised speech models. Our evaluation demonstrates that our model surpasses previous approaches in word-level stuttering speech detection.
  arXiv  Detail & Related papers  (2024-09-16T20:18:20Z)
• NeuroVoz: a Castillian Spanish corpus of parkinsonian speech [34.916222066004465]
  This manuscript presents the NeuroVoz corpus consisting of 112 native Castilian-Spanish speakers, including 58 healthy controls and 54 individuals with PD.<n>The dataset is also complemented with subjective assessments of voice quality performed by an expert according to the GRBAS scale.<n>This data set has already supported several studies, achieving a benchmark accuracy of 89% for the screening of PD.
  arXiv  Detail & Related papers  (2024-03-04T16:17:39Z)
• Learning Cross-lingual Visual Speech Representations [108.68531445641769]
  Cross-lingual self-supervised visual representation learning has been a growing research topic in the last few years. We use the recently-proposed Raw Audio-Visual Speechs (RAVEn) framework to pre-train an audio-visual model with unlabelled data. Our experiments show that: (1) multi-lingual models with more data outperform monolingual ones, but, when keeping the amount of data fixed, monolingual models tend to reach better performance.
  arXiv  Detail & Related papers  (2023-03-14T17:05:08Z)
• M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval [56.49878599920353]
  This work investigates the use of large-scale, English-only pre-trained models (CLIP and HuBERT) for multilingual image-speech retrieval. For non-English image-speech retrieval, we outperform the current state-of-the-art performance by a wide margin both when training separate models for each language, and with a single model which processes speech in all three languages.
  arXiv  Detail & Related papers  (2022-11-02T14:54:45Z)
• Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation [94.80029087828888]
  Direct speech-to-speech translation (S2ST) is an attractive research topic with many advantages compared to cascaded S2ST. Direct S2ST suffers from the data scarcity problem because the corpora from speech of the source language to speech of the target language are very rare. We propose in this paper a Speech2S model, which is jointly pre-trained with unpaired speech and bilingual text data for direct speech-to-speech translation tasks.
  arXiv  Detail & Related papers  (2022-10-31T02:55:51Z)
• The Phonetic Footprint of Parkinson's Disease [16.64383793837174]
  Parkinson's disease (PD) has a significant impact on the fine motor skills of patients. Characteristic patterns such as vowel instability, slurred pronunciation and slow speech can often be observed in the affected individuals. We used a phonetic recognizer trained exclusively on healthy speech data to investigate how PD affected the phonetic footprint of patients.
  arXiv  Detail & Related papers  (2021-12-21T20:44:21Z)
• A Preliminary Study of a Two-Stage Paradigm for Preserving Speaker Identity in Dysarthric Voice Conversion [50.040466658605524]
  We propose a new paradigm for maintaining speaker identity in dysarthric voice conversion (DVC) The poor quality of dysarthric speech can be greatly improved by statistical VC. But as the normal speech utterances of a dysarthria patient are nearly impossible to collect, previous work failed to recover the individuality of the patient.
  arXiv  Detail & Related papers  (2021-06-02T18:41:03Z)
• Parkinsonian Chinese Speech Analysis towards Automatic Classification of Parkinson's Disease [31.431256876809343]
  Speech disorders often occur at the early stage of Parkinson's disease (PD) We constructed a new speech corpus of Mandarin Chinese and addressed classification of patients with PD. Our classification accuracy significantly surpassed state-of-the-art studies.
  arXiv  Detail & Related papers  (2021-05-31T04:51:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.