A Self-supervised Framework for Improved Data-Driven Monitoring of
Stress via Multi-modal Passive Sensing
- URL: http://arxiv.org/abs/2303.14267v1
- Date: Fri, 24 Mar 2023 20:34:46 GMT
- Title: A Self-supervised Framework for Improved Data-Driven Monitoring of
Stress via Multi-modal Passive Sensing
- Authors: Shayan Fazeli, Lionel Levine, Mehrab Beikzadeh, Baharan Mirzasoleiman,
Bita Zadeh, Tara Peris, Majid Sarrafzadeh
- Abstract summary: We propose a multi-modal semi-supervised framework for tracking physiological precursors of the stress response.
Our methodology enables utilizing multi-modal data of differing domains and resolutions from wearable devices.
We perform training experiments using a corpus of real-world data on perceived stress.
- Score: 7.084068935028644
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Recent advances in remote health monitoring systems have significantly
benefited patients and played a crucial role in improving their quality of
life. However, while physiological health-focused solutions have demonstrated
increasing success and maturity, mental health-focused applications have seen
comparatively limited success in spite of the fact that stress and anxiety
disorders are among the most common issues people deal with in their daily
lives. In the hopes of furthering progress in this domain through the
development of a more robust analytic framework for the measurement of
indicators of mental health, we propose a multi-modal semi-supervised framework
for tracking physiological precursors of the stress response. Our methodology
enables utilizing multi-modal data of differing domains and resolutions from
wearable devices and leveraging them to map short-term episodes to semantically
efficient embeddings for a given task. Additionally, we leverage an
inter-modality contrastive objective, with the advantages of rendering our
framework both modular and scalable. The focus on optimizing both local and
global aspects of our embeddings via a hierarchical structure renders
transferring knowledge and compatibility with other devices easier to achieve.
In our pipeline, a task-specific pooling based on an attention mechanism, which
estimates the contribution of each modality on an instance level, computes the
final embeddings for observations. This additionally provides a thorough
diagnostic insight into the data characteristics and highlights the importance
of signals in the broader view of predicting episodes annotated per mental
health status. We perform training experiments using a corpus of real-world
data on perceived stress, and our results demonstrate the efficacy of the
proposed approach in performance improvements.
Related papers
- Interpretable Video based Stress Detection with Self-Refine Chain-of-thought Reasoning [4.541582055558865]
We propose a novel interpretable approach for video-based stress detection.
Our method focuses on extracting subtle behavioral and physiological cues from video sequences that indicate stress levels.
We evaluate our approach on several public and private datasets, demonstrating its superior performance in comparison to traditional video-based stress detection methods.
arXiv Detail & Related papers (2024-10-12T09:06:09Z) - Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysis [2.303486126296845]
Large Language Models (LLMs) have shown promise in delivering interactive health advice.
Traditional methods like Retrieval-Augmented Generation (RAG) and fine-tuning often fail to fully utilize the complex, multi-dimensional, and temporally relevant data.
This paper introduces a graph-augmented LLM framework designed to significantly enhance the personalization and clarity of health insights.
arXiv Detail & Related papers (2024-06-24T01:22:54Z) - Deep Reinforcement Learning Empowered Activity-Aware Dynamic Health
Monitoring Systems [69.41229290253605]
Existing monitoring approaches were designed on the premise that medical devices track several health metrics concurrently.
This means that they report all relevant health values within that scope, which can result in excess resource use and the gathering of extraneous data.
We propose Dynamic Activity-Aware Health Monitoring strategy (DActAHM) for striking a balance between optimal monitoring performance and cost efficiency.
arXiv Detail & Related papers (2024-01-19T16:26:35Z) - Clairvoyance: A Pipeline Toolkit for Medical Time Series [95.22483029602921]
Time-series learning is the bread and butter of data-driven *clinical decision support*
Clairvoyance proposes a unified, end-to-end, autoML-friendly pipeline that serves as a software toolkit.
Clairvoyance is the first to demonstrate viability of a comprehensive and automatable pipeline for clinical time-series ML.
arXiv Detail & Related papers (2023-10-28T12:08:03Z) - Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventions [17.405080523382235]
We propose a novel AI-driven patient monitoring framework using multi-agent deep reinforcement learning (DRL)
Our approach deploys multiple learning agents, each dedicated to monitoring a specific physiological feature, such as heart rate, respiration, and temperature.
We evaluate the performance of the proposed multi-agent DRL framework using real-world physiological and motion data from two datasets.
arXiv Detail & Related papers (2023-09-20T00:42:08Z) - CausalBench: A Large-scale Benchmark for Network Inference from
Single-cell Perturbation Data [61.088705993848606]
We introduce CausalBench, a benchmark suite for evaluating causal inference methods on real-world interventional data.
CaulBench incorporates biologically-motivated performance metrics, including new distribution-based interventional metrics.
arXiv Detail & Related papers (2022-10-31T13:04:07Z) - In-Bed Human Pose Estimation from Unseen and Privacy-Preserving Image
Domains [22.92165116962952]
In-bed human posture estimation provides important health-related metrics with potential value in medical condition assessments.
We propose a multi-modal conditional variational autoencoder (MC-VAE) capable of reconstructing features from missing modalities seen during training.
We demonstrate that body positions can be effectively recognized from the available modality, achieving on par results with baseline models.
arXiv Detail & Related papers (2021-11-30T04:56:16Z) - Learning Neural Causal Models with Active Interventions [83.44636110899742]
We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process.
Our method significantly reduces the required number of interactions compared with random intervention targeting.
We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
arXiv Detail & Related papers (2021-09-06T13:10:37Z) - On the Robustness of Pretraining and Self-Supervision for a Deep
Learning-based Analysis of Diabetic Retinopathy [70.71457102672545]
We compare the impact of different training procedures for diabetic retinopathy grading.
We investigate different aspects such as quantitative performance, statistics of the learned feature representations, interpretability and robustness to image distortions.
Our results indicate that models from ImageNet pretraining report a significant increase in performance, generalization and robustness to image distortions.
arXiv Detail & Related papers (2021-06-25T08:32:45Z) - MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos.
We release a new dataset, MEDICA, for mental health patient engagement detection.
arXiv Detail & Related papers (2020-11-17T15:18:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.