On the Generalizability of ECG-based Stress Detection Models
- URL: http://arxiv.org/abs/2210.06225v2
- Date: Wed, 31 Jan 2024 15:50:17 GMT
- Title: On the Generalizability of ECG-based Stress Detection Models
- Authors: Pooja Prajod, Elisabeth Andr\'e
- Abstract summary: We explore the generalization capabilities of Electrocardiogram (ECG)-based deep learning models and models based on Heart Rate Variability (HRV) features.
To the best of our knowledge, this is the first work to compare the cross-dataset generalizability between ECG-based deep learning models and HRV models.
- Score: 4.592950581802712
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Stress is prevalent in many aspects of everyday life including work,
healthcare, and social interactions. Many works have studied handcrafted
features from various bio-signals that are indicators of stress. Recently, deep
learning models have also been proposed to detect stress. Typically, stress
models are trained and validated on the same dataset, often involving one
stressful scenario. However, it is not practical to collect stress data for
every scenario. So, it is crucial to study the generalizability of these models
and determine to what extent they can be used in other scenarios. In this
paper, we explore the generalization capabilities of Electrocardiogram
(ECG)-based deep learning models and models based on handcrafted ECG features,
i.e., Heart Rate Variability (HRV) features. To this end, we train three HRV
models and two deep learning models that use ECG signals as input. We use ECG
signals from two popular stress datasets - WESAD and SWELL-KW - differing in
terms of stressors and recording devices. First, we evaluate the models using
leave-one-subject-out (LOSO) cross-validation using training and validation
samples from the same dataset. Next, we perform a cross-dataset validation of
the models, that is, LOSO models trained on the WESAD dataset are validated
using SWELL-KW samples and vice versa. While deep learning models achieve the
best results on the same dataset, models based on HRV features considerably
outperform them on data from a different dataset. This trend is observed for
all the models on both datasets. Therefore, HRV models are a better choice for
stress recognition in applications that are different from the dataset
scenario. To the best of our knowledge, this is the first work to compare the
cross-dataset generalizability between ECG-based deep learning models and HRV
models.
Related papers
- Time Series Modeling for Heart Rate Prediction: From ARIMA to Transformers [4.744436991413165]
This study investigates advanced deep learning models, including LSTM, for predicting heart rate time series from the MIT-BIH Database.
Results demonstrate that deep learning models, particularly PatchTST, significantly outperform traditional models across multiple metrics.
arXiv Detail & Related papers (2024-06-18T01:55:37Z) - Stressor Type Matters! -- Exploring Factors Influencing Cross-Dataset Generalizability of Physiological Stress Detection [5.304745246313982]
This study explores the generalizability of machine learning models trained on HRV features for binary stress detection.
Our findings reveal a crucial factor affecting model generalizability: stressor type.
We recommend matching the stressor type when deploying HRV-based stress models in new environments.
arXiv Detail & Related papers (2024-05-06T14:47:48Z) - Data-Free Adversarial Knowledge Distillation for Graph Neural Networks [62.71646916191515]
We propose the first end-to-end framework for data-free adversarial knowledge distillation on graph structured data (DFAD-GNN)
To be specific, our DFAD-GNN employs a generative adversarial network, which mainly consists of three components: a pre-trained teacher model and a student model are regarded as two discriminators, and a generator is utilized for deriving training graphs to distill knowledge from the teacher model into the student model.
Our DFAD-GNN significantly surpasses state-of-the-art data-free baselines in the graph classification task.
arXiv Detail & Related papers (2022-05-08T08:19:40Z) - An Improved Subject-Independent Stress Detection Model Applied to
Consumer-grade Wearable Devices [7.714433991463217]
Two common approaches to training a stress detection model are subject-dependent and subject-independent training methods.
We introduce a stress-related bio-signal processing pipeline with a simple neural network architecture to improve the performance of subject-independent models.
Our proposed model outperforms conventional methods as well as providing 1.63% higher mean accuracy score compared to the state-of-the-art model.
arXiv Detail & Related papers (2022-03-18T00:19:42Z) - Synthetic ECG Signal Generation Using Generative Neural Networks [7.122393663641668]
We studied the synthetic ECG generation capability of 5 different models from the generative adversarial network (GAN) family.
The results show that all the tested models can to an extent successfully mass-generate acceptable heartbeats with high similarity in morphological features.
arXiv Detail & Related papers (2021-12-05T20:28:55Z) - Improving the efficacy of Deep Learning models for Heart Beat detection
on heterogeneous datasets [0.0]
We investigate the issues related to applying a Deep Learning model on heterogeneous datasets.
We show that the performance of a model trained on data from healthy subjects decreases when applied to patients with cardiac conditions.
We then evaluate the use of Transfer Learning to adapt the model to the different datasets.
arXiv Detail & Related papers (2021-10-26T14:26:55Z) - Comparing Test Sets with Item Response Theory [53.755064720563]
We evaluate 29 datasets using predictions from 18 pretrained Transformer models on individual test examples.
We find that Quoref, HellaSwag, and MC-TACO are best suited for distinguishing among state-of-the-art models.
We also observe span selection task format, which is used for QA datasets like QAMR or SQuAD2.0, is effective in differentiating between strong and weak models.
arXiv Detail & Related papers (2021-06-01T22:33:53Z) - Bootstrapping Your Own Positive Sample: Contrastive Learning With
Electronic Health Record Data [62.29031007761901]
This paper proposes a novel contrastive regularized clinical classification model.
We introduce two unique positive sampling strategies specifically tailored for EHR data.
Our framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data.
arXiv Detail & Related papers (2021-04-07T06:02:04Z) - Dataset Cartography: Mapping and Diagnosing Datasets with Training
Dynamics [118.75207687144817]
We introduce Data Maps, a model-based tool to characterize and diagnose datasets.
We leverage a largely ignored source of information: the behavior of the model on individual instances during training.
Our results indicate that a shift in focus from quantity to quality of data could lead to robust models and improved out-of-distribution generalization.
arXiv Detail & Related papers (2020-09-22T20:19:41Z) - ECG-DelNet: Delineation of Ambulatory Electrocardiograms with Mixed
Quality Labeling Using Neural Networks [69.25956542388653]
Deep learning (DL) algorithms are gaining weight in academic and industrial settings.
We demonstrate DL can be successfully applied to low interpretative tasks by embedding ECG detection and delineation onto a segmentation framework.
The model was trained using PhysioNet's QT database, comprised of 105 ambulatory ECG recordings.
arXiv Detail & Related papers (2020-05-11T16:29:12Z) - Deep transfer learning for improving single-EEG arousal detection [63.52264764099532]
Two datasets do not contain exactly the same setup leading to degraded performance in single-EEG models.
We train a baseline model and replace the first two layers to prepare the architecture for single-channel electroencephalography data.
Using a fine-tuning strategy, our model yields similar performance to the baseline model and was significantly better than a comparable single-channel model.
arXiv Detail & Related papers (2020-04-10T16:51:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.