Automatic Detection of Stress from Speech in the Trier Social Stress Test
- URL: http://arxiv.org/abs/2607.00986v1
- Date: Wed, 01 Jul 2026 14:21:53 GMT
- Title: Automatic Detection of Stress from Speech in the Trier Social Stress Test
- Abstract summary: This study investigates the automatic differentiation between a stressful and non-stressful situation, and the prediction of physiological and affective stress responses.<n>With a processing pipeline that included speaker diarization and machine learning models, we achieved stress detection performance significantly above a mean baseline.
- Score: 12.593761734231883
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Automatically detecting stress in speech provides an unobtrusive way to gain insights relevant to behavioral research or clinical assessment. This study investigates the automatic differentiation between a stressful and non-stressful situation, and the prediction of physiological and affective stress responses. Speech data was collected from 50 participants who either completed the Trier Social Stress Test (TSST) or a non-stressful control condition. With a processing pipeline that included speaker diarization and machine learning models, we achieved stress detection performance significantly above a mean baseline. Moreover, relevant physiological and affective stress responses were partially predictable from acoustic-prosodic features. Feature-importance analyses identified the most informative predictors contributing to model performance. The findings demonstrate that speech can serve as a meaningful and unobtrusive indicator of multiple dimensions of the human stress response.
Related papers
- Depression Markers in Speech: An Approach based on Tract Variables Dynamics [52.72895760734978]
This study identifies new depression biomarkers based on the dynamical properties of tract variables.<n>The proposed biomarkers effectively discriminate between the depressed and control speakers, as evidenced by the high Cliffs delta values across both read and spontaneous speech.
arXiv Detail & Related papers (2026-07-28T15:48:07Z) - Dynamic Stress Detection: A Study of Temporal Progression Modelling of Stress in Speech [1.3320917259299652]
We model stress as a temporally evolving phenomenon influenced by historical emotional state.<n>We propose a dynamic labelling strategy that fine-grained stress annotations from emotional labels.<n>Our approach achieves notable accuracy gains on MuSE and StressID over existing baselines.
arXiv Detail & Related papers (2025-10-02T06:30:44Z) - The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs [60.15472325639723]
Personality traits have long been studied as predictors of human behavior.<n>Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems.
arXiv Detail & Related papers (2025-09-03T21:27:10Z) - Fine-Tuning Whisper for Inclusive Prosodic Stress Analysis [2.818750423530918]
This study explores fine-tuning OpenAI's Whisper large-v2 ASR model to recognize phrasal, lexical, and contrastive stress in speech.<n>Using a dataset of 66 native English speakers, we assess the model's ability to generalize stress patterns and classify speakers by neurotype and gender.
arXiv Detail & Related papers (2025-03-03T16:48:31Z) - Self-Explaining Hypergraph Neural Networks for Diagnosis Prediction [45.89562183034469]
Existing deep learning diagnosis prediction models with intrinsic interpretability often assign attention weights to every past diagnosis or hospital visit.<n>We introduce SHy, a self-explaining hypergraph neural network model, designed to offer personalized, concise and faithful explanations.<n> SHy captures higher-order disease interactions and extracts distinct temporal phenotypes as personalized explanations.
arXiv Detail & Related papers (2025-02-15T06:33:02Z) - Computational Analysis of Stress, Depression and Engagement in Mental Health: A Survey [62.31381724639944]
Stress and depression are interrelated and together they impact engagement in daily tasks.<n>This survey is the first to simultaneously explore computational methods for analyzing stress, depression and engagement.
arXiv Detail & Related papers (2024-03-09T11:16:09Z) - Multimodal Feature Extraction and Fusion for Emotional Reaction
Intensity Estimation and Expression Classification in Videos with
Transformers [47.16005553291036]
We present our solutions to the two sub-challenges of Affective Behavior Analysis in the wild (ABAW) 2023.
For the Expression Classification Challenge, we propose a streamlined approach that handles the challenges of classification effectively.
By studying, analyzing, and combining these features, we significantly enhance the model's accuracy for sentiment prediction in a multimodal context.
arXiv Detail & Related papers (2023-03-16T09:03:17Z) - Leveraging Pretrained Representations with Task-related Keywords for
Alzheimer's Disease Detection [69.53626024091076]
Alzheimer's disease (AD) is particularly prominent in older adults.
Recent advances in pre-trained models motivate AD detection modeling to shift from low-level features to high-level representations.
This paper presents several efficient methods to extract better AD-related cues from high-level acoustic and linguistic features.
arXiv Detail & Related papers (2023-03-14T16:03:28Z) - ForDigitStress: A multi-modal stress dataset employing a digital job
interview scenario [48.781127275906435]
We present a multi-modal stress dataset that uses digital job interviews to induce stress.
The dataset provides multi-modal data of 40 participants including audio, video and physiological information.
In order to establish a baseline, five different machine learning classifiers have been trained and evaluated.
arXiv Detail & Related papers (2023-03-14T09:40:37Z) - Classification of Stress via Ambulatory ECG and GSR Data [0.0]
This work empirically assesses several approaches to detect stress using physiological data recorded in an ambulatory setting with self-reported stress annotations.
The optimal stress detection approach achieves 90.77% classification accuracy, 91.24 F1-submission, 90.42 Sensitivity and 91.08 Specificity.
arXiv Detail & Related papers (2022-07-19T15:57:14Z) - Insights on Modelling Physiological, Appraisal, and Affective Indicators
of Stress using Audio Features [10.093374748790037]
Utilising speech samples collected while the subject is undergoing an induced stress episode has recently shown promising results for the automatic characterisation of individual stress responses.
We introduce new findings that shed light onto whether speech signals are suited to model physiological biomarkers.
arXiv Detail & Related papers (2022-05-09T14:32:38Z) - Hybrid Handcrafted and Learnable Audio Representation for Analysis of
Speech Under Cognitive and Physical Load [17.394964035035866]
We introduce a set of five datasets for task load detection in speech.
The voice recordings were collected as either cognitive or physical stress was induced in the cohort of volunteers.
We used the datasets to design and evaluate a novel self-supervised audio representation.
arXiv Detail & Related papers (2022-03-30T19:43:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.