From Black Box to Biomarker: Sparse Autoencoders for Interpreting Speech Models of Parkinson's Disease
- URL: http://arxiv.org/abs/2507.16836v1
- Date: Wed, 16 Jul 2025 16:22:02 GMT
- Title: From Black Box to Biomarker: Sparse Autoencoders for Interpreting Speech Models of Parkinson's Disease
- Abstract summary: Speech holds promise as a cost-effective and non-invasive biomarker for neurological conditions such as Parkinson's disease (PD)<n>We apply sparse autoencoders (SAEs) to uncover interpretable internal representations from a speech-based PD detection system.<n>We introduce a novel mask-based activation for adapting SAEs to small biomedical datasets, creating sparse disentangled dictionary representations.
- Score: 9.968776083852813
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Speech holds promise as a cost-effective and non-invasive biomarker for neurological conditions such as Parkinson's disease (PD). While deep learning systems trained on raw audio can find subtle signals not available from hand-crafted features, their black-box nature hinders clinical adoption. To address this, we apply sparse autoencoders (SAEs) to uncover interpretable internal representations from a speech-based PD detection system. We introduce a novel mask-based activation for adapting SAEs to small biomedical datasets, creating sparse disentangled dictionary representations. These dictionary entries are found to have strong associations with characteristic articulatory deficits in PD speech, such as reduced spectral flux and increased spectral flatness in the low-energy regions highlighted by the model attention. We further show that the spectral flux is related to volumetric measurements of the putamen from MRI scans, demonstrating the potential of SAEs to reveal clinically relevant biomarkers for disease monitoring and diagnosis.
Related papers
- Depression Markers in Speech: An Approach based on Tract Variables Dynamics [52.72895760734978]
This study identifies new depression biomarkers based on the dynamical properties of tract variables.<n>The proposed biomarkers effectively discriminate between the depressed and control speakers, as evidenced by the high Cliffs delta values across both read and spontaneous speech.
arXiv Detail & Related papers (2026-07-28T15:48:07Z) - Gated Multi-Graph Fusion via Graph Attention Networks for Alzheimer's Disease Detection [52.36198268369384]
Spontaneous speech is a vital non-invasive biomarker for Alzheimer's Disease (AD)<n>We propose a Multi-View Gated Graph Attention Network that transcribes audio via Automatic Speech Recognition (ASR) to construct semantic, dependency, and co-occurrence graphs.
arXiv Detail & Related papers (2026-06-30T06:15:59Z) - Echo-DM: Ultrasound Marker Removal via Conditional Latent Diffusion and Region-Aware Fusion [50.02433280054874]
markers can introduce shortcut bias in downstream automated analysis.<n>We present Echo-DM, a framework for ultrasound marker removal via conditional latent diffusion and region-aware fusion.<n>Experiments on Echo-PAIR, a large-scale paired clinical ultrasound dataset, demonstrate superior marker removal and strong anatomical fidelity.
arXiv Detail & Related papers (2026-06-08T11:56:33Z) - Multi-View Speech Representation Learning for Parkinson's Disease Detection Using Context-guided Cross-modal Attention [9.395262542018235]
We propose a multi-branch deep learning framework for automatic Parkinson's disease detection from speech.<n>The proposed architecture achieves an accuracy of 91.51%, an F1-score of 91.24%, and an AUC of 95.97%.
arXiv Detail & Related papers (2026-06-08T09:39:33Z) - Adapting Self-Supervised Speech Representations for Cross-lingual Dysarthria Detection in Parkinson's Disease [72.0406069194794]
Speech representations often encode language-dependent structure that can confound dysarthria detection.<n>We propose a representation-level language shift that aligns source-language self-supervised speech representations with the target-language distribution.<n>We evaluate the approach on oral DDK recordings from Parkinson's disease speech datasets in Czech, German, and Spanish.
arXiv Detail & Related papers (2026-03-23T17:23:39Z) - Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology [46.83014413674925]
STAMP is a spatial transcriptomics-augmented multimodal pathology representation learning framework.<n>Our study shows that self-supervised, gene-guided training provides a robust and task-agnostic signal for learning pathology image representations.<n>We validate STAMP across six datasets and four downstream tasks, where it consistently achieves strong performance.
arXiv Detail & Related papers (2026-02-15T00:59:13Z) - AI-Enhanced Virtual Biopsies for Brain Tumor Diagnosis in Low Resource Settings [0.0]
This paper presents a prototype virtual biopsy pipeline for four-class classification of 2D brain MRI images using a lightweight convolutional neural network (CNN) and radiomics-style handcrafted features.<n>The system is framed as decision support and not a substitute for clinical diagnosis or histopathology.
arXiv Detail & Related papers (2025-12-19T19:53:56Z) - Explainable Parkinsons Disease Gait Recognition Using Multimodal RGB-D Fusion and Large Language Models [6.2676602262188625]
This paper presents an explainable multimodal framework that integrates RGB and Depth (RGB-D) data to recognize Parkinsonian gait patterns.<n>By combining multimodal feature learning with language-based interpretability, this study bridges the gap between visual recognition and clinical understanding.
arXiv Detail & Related papers (2025-12-04T03:43:43Z) - Graph Attention Networks for Detecting Epilepsy from EEG Signals Using Accessible Hardware in Low-Resource Settings [45.62331048595689]
Epilepsy remains under-diagnosed in low-income countries due to scarce neurologists and costly diagnostic tools.<n>We propose a graph-based deep learning framework to detect epilepsy from low-cost EEG hardware.
arXiv Detail & Related papers (2025-07-20T20:44:39Z) - Seeing the Trees for the Forest: Rethinking Weakly-Supervised Medical Visual Grounding [50.483761005446]
Current models struggle to associate textual descriptions with disease regions due to inefficient attention mechanisms and a lack of fine-grained token representations.<n>We introduce Disease-Aware Prompting (DAP), which uses the explainability map of a VLM to identify the appropriate image features.<n>DAP improves visual grounding accuracy by 20.74% compared to state-of-the-art methods across three major chest X-ray datasets.
arXiv Detail & Related papers (2025-05-21T05:16:45Z) - PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological Sensing [49.243031514520794]
Large Language Models (LLMs) excel at capturing long-range signals due to their text-centric design.<n>PhysLLM achieves state-the-art accuracy and robustness, demonstrating superior generalization across lighting variations and motion scenarios.
arXiv Detail & Related papers (2025-05-06T15:18:38Z) - Distinguishing Parkinson's Patients Using Voice-Based Feature Extraction and Classification [0.0]
This study focuses on differentiating individuals with Parkinson's disease from healthy controls through the extraction and classification of speech features.<n>The accuracy of our 3-layer artificial neural network architecture was also compared with classical machine learning algorithms.
arXiv Detail & Related papers (2025-01-24T10:44:16Z) - Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyography [0.0]
We present data and methods for decoding speech articulations using surface electromyogram (EMG) signals.<n>EMG-based speech neuroprostheses offer a promising approach for restoring audible speech in individuals who have lost the ability to speak intelligibly.
arXiv Detail & Related papers (2024-11-04T20:31:22Z) - Graph Neural Networks for Parkinsons Disease Detection [17.861421892442795]
We propose a novel PD detection framework utilizing Graph Convolutional Networks (GCNs)
By representing speech segments as nodes, our GCN model facilitates the aggregation of dysarthric cues across the graph, effectively exploiting segment relationships and mitigating the impact of label noise.
Experimental results demonstrate theadvantages of the proposed GCN model for PD detection and provide insights into its underlying mechanisms.
arXiv Detail & Related papers (2024-09-12T09:44:13Z) - NeuroSpex: Neuro-Guided Speaker Extraction with Cross-Modal Attention [47.8479647938849]
We present a neuro-guided speaker extraction model, i.e. NeuroSpex, using the EEG response of the listener as the sole auxiliary reference cue.
We propose a novel EEG signal encoder that captures the attention information. Additionally, we propose a cross-attention (CA) mechanism to enhance the speech feature representations.
arXiv Detail & Related papers (2024-09-04T07:33:01Z) - Can Self-Supervised Neural Representations Pre-Trained on Human Speech
distinguish Animal Callers? [23.041173892976325]
Self-supervised learning (SSL) models use only the intrinsic structure of a given signal, independent of its acoustic domain, to extract essential information from the input to an embedding space.
This paper explores the cross-transferability of SSL neural representations learned from human speech to analyze bio-acoustic signals.
arXiv Detail & Related papers (2023-05-23T13:06:14Z) - Toward Knowledge-Driven Speech-Based Models of Depression: Leveraging
Spectrotemporal Variations in Speech Vowels [10.961439164833891]
Psychomotor retardation associated with depression has been linked with tangible differences in vowel production.
This paper investigates a knowledge-driven machine learning (ML) method that integrates spectrotemporal information of speech at the vowel-level to identify the depression.
arXiv Detail & Related papers (2022-10-05T19:57:53Z) - Texture Characterization of Histopathologic Images Using Ecological
Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate.
It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
arXiv Detail & Related papers (2022-02-27T02:19:09Z) - The Phonetic Footprint of Parkinson's Disease [16.64383793837174]
Parkinson's disease (PD) has a significant impact on the fine motor skills of patients.
Characteristic patterns such as vowel instability, slurred pronunciation and slow speech can often be observed in the affected individuals.
We used a phonetic recognizer trained exclusively on healthy speech data to investigate how PD affected the phonetic footprint of patients.
arXiv Detail & Related papers (2021-12-21T20:44:21Z) - An Interpretable Multiple-Instance Approach for the Detection of
referable Diabetic Retinopathy from Fundus Images [72.94446225783697]
We propose a machine learning system for the detection of referable Diabetic Retinopathy in fundus images.
By extracting local information from image patches and combining it efficiently through an attention mechanism, our system is able to achieve high classification accuracy.
We evaluate our approach on publicly available retinal image datasets, in which it exhibits near state-of-the-art performance.
arXiv Detail & Related papers (2021-03-02T13:14:15Z) - G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for
Biomarker Identification and Disease Classification [49.53651166356737]
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers.
We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
arXiv Detail & Related papers (2021-01-27T19:28:04Z) - Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using
Deep Multiple-Instance Learning [59.74684475991192]
Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old.
PD symptoms include tremor, rigidity and braykinesia.
We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
arXiv Detail & Related papers (2020-05-06T09:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.