Employing Multimodal Machine Learning for Stress Detection
- URL: http://arxiv.org/abs/2306.09385v1
- Date: Thu, 15 Jun 2023 14:34:16 GMT
- Title: Employing Multimodal Machine Learning for Stress Detection
- Authors: Rahee Walambe, Pranav Nayak, Ashmit Bhardwaj, Ketan Kotecha
- Abstract summary: Mental wellness is one of the most neglected but crucial aspects of today's world.
In this work, a multimodal AI-based framework is proposed to monitor a person's working behavior and stress levels.
- Score: 8.430502131775722
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In the current age, human lifestyle has become more knowledge oriented
leading to generation of sedentary employment. This has given rise to a number
of health and mental disorders. Mental wellness is one of the most neglected
but crucial aspects of today's world. Mental health issues can, both directly
and indirectly, affect other sections of human physiology and impede an
individual's day-to-day activities and performance. However, identifying the
stress and finding the stress trend for an individual leading to serious mental
ailments is challenging and involves multiple factors. Such identification can
be achieved accurately by fusing these multiple modalities (due to various
factors) arising from behavioral patterns. Certain techniques are identified in
the literature for this purpose; however, very few machine learning-based
methods are proposed for such multimodal fusion tasks. In this work, a
multimodal AI-based framework is proposed to monitor a person's working
behavior and stress levels. We propose a methodology for efficiently detecting
stress due to workload by concatenating heterogeneous raw sensor data streams
(e.g., face expressions, posture, heart rate, computer interaction). This data
can be securely stored and analyzed to understand and discover personalized
unique behavioral patterns leading to mental strain and fatigue. The
contribution of this work is twofold; proposing a multimodal AI-based strategy
for fusion to detect stress and its level and secondly identify a stress
pattern over a period of time. We were able to achieve 96.09% accuracy on the
test set in stress detection and classification. Further, we reduce the stress
scale prediction model loss to 0.036 using these modalities. This work can
prove important for the community at large, specifically those working
sedentary jobs to monitor and identify stress levels, especially in current
times of COVID-19.
Related papers
- Measuring Non-Typical Emotions for Mental Health: A Survey of Computational Approaches [57.486040830365646]
Stress and depression impact the engagement in daily tasks, highlighting the need to understand their interplay.
This survey is the first to simultaneously explore computational methods for analyzing stress, depression, and engagement.
arXiv Detail & Related papers (2024-03-09T11:16:09Z) - Multimodal Stress Detection Using Facial Landmarks and Biometric Signals [1.0124625066746595]
Multi-modal learning aims to capitalize on the strength of each modality rather than relying on a single signal.
This paper proposes a multi-modal learning approach for stress detection that integrates facial landmarks and biometric signals.
arXiv Detail & Related papers (2023-11-06T23:20:30Z) - Causal machine learning for single-cell genomics [94.28105176231739]
We discuss the application of machine learning techniques to single-cell genomics and their challenges.
We first present the model that underlies most of current causal approaches to single-cell biology.
We then identify open problems in the application of causal approaches to single-cell data.
arXiv Detail & Related papers (2023-10-23T13:35:24Z) - Personalization of Stress Mobile Sensing using Self-Supervised Learning [1.7598252755538808]
Stress is widely recognized as a major contributor to a variety of health issues.
Real-time stress prediction can enable digital interventions to immediately react at the onset of stress, helping to avoid many psychological and physiological symptoms such as heart rhythm irregularities.
However, major challenges with the prediction of stress using machine learning include the subjectivity and sparseness of the labels, a large feature space, relatively few labels, and a complex nonlinear and subjective relationship between the features and outcomes.
arXiv Detail & Related papers (2023-08-04T22:26:33Z) - What's on your mind? A Mental and Perceptual Load Estimation Framework
towards Adaptive In-vehicle Interaction while Driving [55.41644538483948]
We analyze the effects of mental workload and perceptual load on psychophysiological dimensions.
We classify the mental and perceptual load levels through the fusion of these measurements.
We report up to 89% mental workload classification accuracy and provide a real-time minimally-intrusive solution.
arXiv Detail & Related papers (2022-08-10T21:19:49Z) - The world seems different in a social context: a neural network analysis
of human experimental data [57.729312306803955]
We show that it is possible to replicate human behavioral data in both individual and social task settings by modifying the precision of prior and sensory signals.
An analysis of the neural activation traces of the trained networks provides evidence that information is coded in fundamentally different ways in the network in the individual and in the social conditions.
arXiv Detail & Related papers (2022-03-03T17:19:12Z) - Personalized Stress Monitoring using Wearable Sensors in Everyday
Settings [9.621481727547215]
We explore objective prediction of stress levels in everyday settings based on heart rate (HR) and heart rate variability (HRV)
We present a layered system architecture for personalized stress monitoring that supports a tunable collection of data samples for labeling, and present a method for selecting informative samples from the stream of real-time data for labeling.
arXiv Detail & Related papers (2021-07-31T04:15:15Z) - A multimodal sensor dataset for continuous stress detection of nurses in
a hospital [0.8312466807725921]
This paper provides a unique stress detection dataset created in a natural working environment in a hospital.
This dataset is a collection of biometric data of nurses during the COVID-19 outbreak.
arXiv Detail & Related papers (2021-07-25T22:24:25Z) - MUSER: MUltimodal Stress Detection using Emotion Recognition as an
Auxiliary Task [22.80682208862559]
Stress and emotion are both human affective states, and stress has proven to have important implications on the regulation and expression of emotion.
In this work, we investigate the value of emotion recognition as an auxiliary task to improve stress detection.
We propose M -- a transformer-based model architecture and a novel multi-task learning algorithm with speed-based dynamic sampling strategy.
arXiv Detail & Related papers (2021-05-17T20:24:46Z) - Anxiety Detection Leveraging Mobile Passive Sensing [53.11661460916551]
Anxiety disorders are the most common class of psychiatric problems affecting both children and adults.
Leveraging passive and unobtrusive data collection from smartphones could be a viable alternative to classical methods.
eWellness is an experimental mobile application designed to track a full-suite of sensor and user-log data off an individual's device in a continuous and passive manner.
arXiv Detail & Related papers (2020-08-09T20:22:52Z) - Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using
Deep Multiple-Instance Learning [59.74684475991192]
Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old.
PD symptoms include tremor, rigidity and braykinesia.
We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
arXiv Detail & Related papers (2020-05-06T09:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.