A Comparison of Personalized and Generalized Approaches to Emotion Recognition Using Consumer Wearable Devices: Machine Learning Study

• URL: http://arxiv.org/abs/2308.14245v1
• Date: Mon, 28 Aug 2023 01:21:22 GMT
• Title: A Comparison of Personalized and Generalized Approaches to Emotion Recognition Using Consumer Wearable Devices: Machine Learning Study
• Abstract summary: We develop a convolutional encoder for the three-class emotion classification problem using data from WESAD. For the three-class classification problem, our personalized model achieved an average accuracy of 95.06% and F1-score of 91.71. Our results emphasize the need for increased research in personalized emotion recognition models.
• Score: 1.0895307583148537
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Background: Studies have shown the potential adverse health effects, ranging from headaches to cardiovascular disease, associated with long-term negative emotions and chronic stress. Since many indicators of stress are imperceptible to observers, the early detection and intervention of stress remains a pressing medical need. Physiological signals offer a non-invasive method of monitoring emotions and are easily collected by smartwatches. Existing research primarily focuses on developing generalized machine learning-based models for emotion classification. Objective: We aim to study the differences between personalized and generalized machine learning models for three-class emotion classification (neutral, stress, and amusement) using wearable biosignal data. Methods: We developed a convolutional encoder for the three-class emotion classification problem using data from WESAD, a multimodal dataset with physiological signals for 15 subjects. We compared the results between a subject-exclusive generalized, subject-inclusive generalized, and personalized model. Results: For the three-class classification problem, our personalized model achieved an average accuracy of 95.06% and F1-score of 91.71, our subject-inclusive generalized model achieved an average accuracy of 66.95% and F1-score of 42.50, and our subject-exclusive generalized model achieved an average accuracy of 67.65% and F1-score of 43.05. Conclusions: Our results emphasize the need for increased research in personalized emotion recognition models given that they outperform generalized models in certain contexts. We also demonstrate that personalized machine learning models for emotion classification are viable and can achieve high performance.

Related papers

• Leveraging Physiological Signals to Predict Exam Outcomes with Machine Learning [3.0714301039424776]
  This study investigates the application of machine learning models to predict exam outcomes using physiological data collected during examination sessions.<n> Physiological stress indicators, including electrodermal activity, heart rate, and skin temperature, were analyzed to uncover their association with academic performance.
  arXiv  Detail & Related papers  (2026-06-12T21:07:07Z)
• Simulating clinical interventions with a generative multimodal model of human physiology [49.828582089394445]
  HealthFormer is a decoder-only transformer that models the human physiological trajectory generatively.<n>We tokenise each participant's health trajectory across 667 measurements spanning seven domains.<n>HealthFormer improves prediction for 27 of 30 incident-disease and mortality endpoints, exceeding established clinical risk scores in every comparison.
  arXiv  Detail & Related papers  (2026-04-30T14:10:30Z)
• Investigating the Impact of Histopathological Foundation Models on Regressive Prediction of Homologous Recombination Deficiency [52.50039435394964]
  We systematically evaluate foundation models for regression-based tasks.<n>We extract patch-level features from whole slide images (WSI) using five state-of-the-art foundation models.<n>Models are trained to predict continuous HRD scores based on these extracted features across breast, endometrial, and lung cancer cohorts.
  arXiv  Detail & Related papers  (2026-01-29T14:06:50Z)
• Reproducible Physiological Features in Affective Computing: A Preliminary Analysis on Arousal Modeling [1.9400282838579548]
  We identify physiological features from cardiovascular and electrodermal signals associated with arousal levels.<n>Our approach is particularly promising for applications in safety-critical environments requiring trustworthy and reliable white box models.
  arXiv  Detail & Related papers  (2025-08-14T11:58:36Z)
• Adaptive Shrinkage Estimation For Personalized Deep Kernel Regression In Modeling Brain Trajectories [4.605794646684244]
  We introduce a novel personalized deep kernel regression framework for forecasting brain biomarkers. Our approach integrates two key components: a population model that captures brain trajectories from a large cohort, and a subject-specific model that captures individual trajectories.
  arXiv  Detail & Related papers  (2025-04-10T19:13:44Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [53.2981100111204]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring. Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors. In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type. Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• Improving Emotion Recognition Accuracy with Personalized Clustering [0.0]
  Emotion recognition should be done with fast, discrete, and non-luxurious systems working in real-time and real life. These customized models will be applicable to clusters of subjects sharing similarities in their emotional reactions to external stimuli.
  arXiv  Detail & Related papers  (2024-09-23T16:42:36Z)
• Causal machine learning for single-cell genomics [94.28105176231739]
  We discuss the application of machine learning techniques to single-cell genomics and their challenges. We first present the model that underlies most of current causal approaches to single-cell biology. We then identify open problems in the application of causal approaches to single-cell data.
  arXiv  Detail & Related papers  (2023-10-23T13:35:24Z)
• Personalization of Affective Models to Enable Neuropsychiatric Digital Precision Health Interventions: A Feasibility Study [0.820591242098274]
  Mobile digital therapeutics for autism spectrum disorder (ASD) often target emotion recognition and evocation. Here, we explore the potential of model personalization, or training a single emotion recognition model per person. We conducted experiments on the Emognition dataset, a video dataset of human subjects evoking a series of emotions.
  arXiv  Detail & Related papers  (2023-09-21T07:16:50Z)
• An investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation [8.449342469976758]
  We investigate how imbalances in subject sex and race affect AI-based cine cardiac magnetic resonance image segmentation. We find significant sex bias in three of the four models and racial bias in all of the models.
  arXiv  Detail & Related papers  (2023-08-25T14:55:38Z)
• Deep-seeded Clustering for Emotion Recognition from Wearable Physiological Sensors [1.380698851850167]
  We propose and test a deep-seeded clustering algorithm that automatically extracts and classifies features from physiological signals with minimal supervision. We show that the model obtains good performance results across three different datasets frequently used in affective computing studies.
  arXiv  Detail & Related papers  (2023-08-17T14:37:35Z)
• Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomes [72.13373216644021]
  We study the societal impact of machine learning by considering the collection of models that are deployed in a given context. We find deployed machine learning is prone to systemic failure, meaning some users are exclusively misclassified by all models available. These examples demonstrate ecosystem-level analysis has unique strengths for characterizing the societal impact of machine learning.
  arXiv  Detail & Related papers  (2023-07-12T01:11:52Z)
• Generative models improve fairness of medical classifiers under distribution shifts [49.10233060774818]
  We show that learning realistic augmentations automatically from data is possible in a label-efficient manner using generative models. We demonstrate that these learned augmentations can surpass ones by making models more robust and statistically fair in- and out-of-distribution.
  arXiv  Detail & Related papers  (2023-04-18T18:15:38Z)
• Classification of anomalous gait using Machine Learning techniques and embedded sensors [0.0]
  It is known that a high investment is demanded in order to raise a traditional clinical infrastructure able to provide human gait examinations. This work proposes an accessible and modern solution composed of a wearable device, to acquire 3D-accelerometer and 3D-gyroscope measurements.
  arXiv  Detail & Related papers  (2021-10-08T21:58:00Z)
• Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data [62.29031007761901]
  This paper proposes a novel contrastive regularized clinical classification model. We introduce two unique positive sampling strategies specifically tailored for EHR data. Our framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data.
  arXiv  Detail & Related papers  (2021-04-07T06:02:04Z)
• Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records [57.75125067744978]
  We propose a data augmentation method to facilitate domain adaptation. adversarially generated samples are used during domain adaptation. Results confirm the effectiveness of our method and the generality on different tasks.
  arXiv  Detail & Related papers  (2021-01-13T03:20:20Z)
• MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement [17.038017337552724]
  We present a novel meta-learning approach called MetaPhys for personalized video-based cardiac measurement. Our method uses only 18-seconds of video for customization and works effectively in both supervised and unsupervised manners.
  arXiv  Detail & Related papers  (2020-10-05T04:41:03Z)
• A Novel Transferability Attention Neural Network Model for EEG Emotion Recognition [51.203579838210885]
  We propose a transferable attention neural network (TANN) for EEG emotion recognition. TANN learns the emotional discriminative information by highlighting the transferable EEG brain regions data and samples adaptively. This can be implemented by measuring the outputs of multiple brain-region-level discriminators and one single sample-level discriminator.
  arXiv  Detail & Related papers  (2020-09-21T02:42:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.