Insights on Modelling Physiological, Appraisal, and Affective Indicators of Stress using Audio Features

• URL: http://arxiv.org/abs/2205.04328v1
• Date: Mon, 9 May 2022 14:32:38 GMT
• Title: Insights on Modelling Physiological, Appraisal, and Affective Indicators of Stress using Audio Features
• Authors: Andreas Triantafyllopoulos, Sandra Z\"ankert, Alice Baird, Julian Konzok, Brigitte M. Kudielka, and Bj\"orn W. Schuller
• Abstract summary: Utilising speech samples collected while the subject is undergoing an induced stress episode has recently shown promising results for the automatic characterisation of individual stress responses. We introduce new findings that shed light onto whether speech signals are suited to model physiological biomarkers.
• Score: 10.093374748790037
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Stress is a major threat to well-being that manifests in a variety of physiological and mental symptoms. Utilising speech samples collected while the subject is undergoing an induced stress episode has recently shown promising results for the automatic characterisation of individual stress responses. In this work, we introduce new findings that shed light onto whether speech signals are suited to model physiological biomarkers, as obtained via cortisol measurements, or self-assessed appraisal and affect measurements. Our results show that different indicators impact acoustic features in a diverse way, but that their complimentary information can nevertheless be effectively harnessed by a multi-tasking architecture to improve prediction performance for all of them.

Related papers

• The Effect of Acute Stress on the Interpretability and Generalization of Schizophrenia Predictive Machine Learning Models [2.5648452174203062]
  Schizophrenia is a severe mental disorder, and early diagnosis is key to improving outcomes. EEG has emerged as a valuable tool for studying schizophrenia, with machine learning increasingly applied for diagnosis. This paper assesses the accuracy of ML models for predicting schizophrenia and examines the impact of stress during EEG recording on model performance.
  arXiv  Detail & Related papers  (2024-10-04T02:41:12Z)
• Predicting Heart Activity from Speech using Data-driven and Knowledge-based features [19.14666002797423]
  We show that self-supervised speech models outperform acoustic features in predicting heart activity parameters. These findings underscore the value of data-driven representations in such tasks.
  arXiv  Detail & Related papers  (2024-06-10T15:01:46Z)
• Stressor Type Matters! -- Exploring Factors Influencing Cross-Dataset Generalizability of Physiological Stress Detection [5.304745246313982]
  This study explores the generalizability of machine learning models trained on HRV features for binary stress detection. Our findings reveal a crucial factor affecting model generalizability: stressor type. We recommend matching the stressor type when deploying HRV-based stress models in new environments.
  arXiv  Detail & Related papers  (2024-05-06T14:47:48Z)
• Investigating the Generalizability of Physiological Characteristics of Anxiety [3.4036712573981607]
  We evaluate the generalizability of physiological features that have been shown to be correlated with anxiety and stress to high-arousal emotions. This work is the first cross-corpus evaluation across stress and arousal from ECG and EDA signals, contributing new findings about the generalizability of stress detection.
  arXiv  Detail & Related papers  (2024-01-23T16:49:54Z)
• Show from Tell: Audio-Visual Modelling in Clinical Settings [58.88175583465277]
  We consider audio-visual modelling in a clinical setting, providing a solution to learn medical representations without human expert annotation. A simple yet effective multi-modal self-supervised learning framework is proposed for this purpose. The proposed approach is able to localise anatomical regions of interest during ultrasound imaging, with only speech audio as a reference.
  arXiv  Detail & Related papers  (2023-10-25T08:55:48Z)
• Heterogeneous Hidden Markov Models for Sleep Activity Recognition from Multi-Source Passively Sensed Data [67.60224656603823]
  Psychiatric patients' passive activity monitoring is crucial to detect behavioural shifts in real-time. Sleep Activity Recognition constitutes a behavioural marker to portray patients' activity cycles. Mobile passively sensed data captured from smartphones constitute an excellent alternative to profile patients' biorhythm.
  arXiv  Detail & Related papers  (2022-11-08T17:29:40Z)
• I am Only Happy When There is Light: The Impact of Environmental Changes on Affective Facial Expressions Recognition [65.69256728493015]
  We study the impact of different image conditions on the recognition of arousal from human facial expressions. Our results show how the interpretation of human affective states can differ greatly in either the positive or negative direction.
  arXiv  Detail & Related papers  (2022-10-28T16:28:26Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• Hybrid Handcrafted and Learnable Audio Representation for Analysis of Speech Under Cognitive and Physical Load [17.394964035035866]
  We introduce a set of five datasets for task load detection in speech. The voice recordings were collected as either cognitive or physical stress was induced in the cohort of volunteers. We used the datasets to design and evaluate a novel self-supervised audio representation.
  arXiv  Detail & Related papers  (2022-03-30T19:43:21Z)
• Designing A Clinically Applicable Deep Recurrent Model to Identify Neuropsychiatric Symptoms in People Living with Dementia Using In-Home Monitoring Data [52.40058724040671]
  Agitation is one of the neuropsychiatric symptoms with high prevalence in dementia. Detecting agitation episodes can assist in providing People Living with Dementia (PLWD) with early and timely interventions. This preliminary study presents a supervised learning model to analyse the risk of agitation in PLWD using in-home monitoring data.
  arXiv  Detail & Related papers  (2021-10-19T11:45:01Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.