SympCam: Remote Optical Measurement of Sympathetic Arousal

• URL: http://arxiv.org/abs/2410.20552v1
• Date: Sun, 27 Oct 2024 18:46:55 GMT
• Title: SympCam: Remote Optical Measurement of Sympathetic Arousal
• Authors: Björn Braun, Daniel McDuff, Tadas Baltrusaitis, Paul Streli, Max Moebus, Christian Holz,
• Abstract summary: We present a new convolutional architecture tailored to the task of remote sympathetic arousal prediction. We show that the sympathetic arousal predicted by our method allows detecting physical stress with a balanced accuracy of 90%. We contribute a dataset designed explicitly for the task of remote sympathetic arousal prediction.
• Score: 41.97525156940624
• License:
• Abstract: Recent work has shown that a person's sympathetic arousal can be estimated from facial videos alone using basic signal processing. This opens up new possibilities in the field of telehealth and stress management, providing a non-invasive method to measure stress only using a regular RGB camera. In this paper, we present SympCam, a new 3D convolutional architecture tailored to the task of remote sympathetic arousal prediction. Our model incorporates a temporal attention module (TAM) to enhance the temporal coherence of our sequential data processing capabilities. The predictions from our method improve accuracy metrics of sympathetic arousal in prior work by 48% to a mean correlation of 0.77. We additionally compare our method with common remote photoplethysmography (rPPG) networks and show that they alone cannot accurately predict sympathetic arousal "out-of-the-box". Furthermore, we show that the sympathetic arousal predicted by our method allows detecting physical stress with a balanced accuracy of 90% - an improvement of 61% compared to the rPPG method commonly used in related work, demonstrating the limitations of using rPPG alone. Finally, we contribute a dataset designed explicitly for the task of remote sympathetic arousal prediction. Our dataset contains synchronized face and hand videos of 20 participants from two cameras synchronized with electrodermal activity (EDA) and photoplethysmography (PPG) measurements. We will make this dataset available to the community and use it to evaluate the methods in this paper. To the best of our knowledge, this is the first dataset available to other researchers designed for remote sympathetic arousal prediction.

Related papers

• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• Your blush gives you away: detecting hidden mental states with remote photoplethysmography and thermal imaging [5.604613879541013]
  This study aims to bridge the gap by integrating r-modal and thermal imaging to enhance prediction performance. Using r- alone, the prediction accuracy was 77% for cognitive stress and 61% for moral elevation, as determined by SVM. An early fusion strategy of these modalities significantly improved accuracies, achieving 87% for cognitive stress and 83% for moral elevation using RF.
  arXiv  Detail & Related papers  (2024-01-17T11:38:21Z)
• Video-based sympathetic arousal assessment via peripheral blood flow estimation [46.695433930419945]
  We present a novel approach to infer sympathetic arousal by measuring the peripheral blood flow on the face or hand optically. We show that sympathetic arousal is best inferred from the forehead, finger, or palm.
  arXiv  Detail & Related papers  (2023-11-12T19:06:33Z)
• Privacy-Preserving Remote Heart Rate Estimation from Facial Videos [19.442685015494316]
  Deep learning techniques are vulnerable to perturbation attacks, which can result in significant data breaches. We propose a data method that involves extraction of certain areas of the face with less identity-related information, followed by pixel shuffling and blurring. Our approach reduces the accuracy of facial recognition algorithms by over 60%, with minimal impact on r extraction.
  arXiv  Detail & Related papers  (2023-06-01T20:48:04Z)
• Camera-Based HRV Prediction for Remote Learning Environments [4.074837550066978]
  Restoring blood volume pulse signals from facial videos is a challenging task that involves a series of preprocessing, image algorithms, and postprocessing to restore waveforms. The challenge in obtaining HRV indices through r is the necessity for algorithms to precisely predict the BVP peak positions. In this paper, we collected the Remote Learning Affect and Physiology (RLAP) dataset, which includes over 32 hours of highly synchronized video and labels from 58 subjects. Using the RLAP dataset, we trained a new model called Seq-r, it is a model based on one-dimensional convolution, and experimental results reveal
  arXiv  Detail & Related papers  (2023-05-07T02:26:00Z)
• MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
  We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos. We release a new dataset, MEDICA, for mental health patient engagement detection.
  arXiv  Detail & Related papers  (2020-11-17T15:18:38Z)
• Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
  In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
  arXiv  Detail & Related papers  (2020-06-18T09:49:11Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.