Real-Time Monitoring of User Stress, Heart Rate and Heart Rate Variability on Mobile Devices

• URL: http://arxiv.org/abs/2210.01791v1
• Date: Tue, 4 Oct 2022 17:58:37 GMT
• Title: Real-Time Monitoring of User Stress, Heart Rate and Heart Rate Variability on Mobile Devices
• Authors: Peyman Bateni, Leonid Sigal
• Abstract summary: Beam AI SDK can monitor user stress through the selfie camera in real-time. We evaluate our technology on the UBFC dataset, the MMSE-HR dataset, and Beam AI's internal data.
• Score: 36.16114600037677
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Stress is considered to be the epidemic of the 21st-century. Yet, mobile apps cannot directly evaluate the impact of their content and services on user stress. We introduce the Beam AI SDK to address this issue. Using our SDK, apps can monitor user stress through the selfie camera in real-time. Our technology extracts the user's pulse wave by analyzing subtle color variations across the skin regions of the user's face. The user's pulse wave is then used to determine stress (according to the Baevsky Stress Index), heart rate, and heart rate variability. We evaluate our technology on the UBFC dataset, the MMSE-HR dataset, and Beam AI's internal data. Our technology achieves 99.2%, 97.8% and 98.5% accuracy for heart rate estimation on each benchmark respectively, a nearly twice lower error rate than competing methods. We further demonstrate an average Pearson correlation of 0.801 in determining stress and heart rate variability, thus producing commercially useful readings to derive content decisions in apps. Our SDK is available for use at www.beamhealth.ai.

Related papers

• UbiHR: Resource-efficient Long-range Heart Rate Sensing on Ubiquitous Devices [9.971578670060564]
  We present UbiHR, a ubiquitous device-based heart rate sensing system. Key to UbiHR is a real-time long-range-temporal model enabling noise-independent heart rate recognition and display on commodity mobile devices.
  arXiv  Detail & Related papers  (2024-10-25T03:28:19Z)
• What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systems [52.499838151272016]
  This paper addresses the "what-if" problem of estimating the values of key performance indicators (KPIs) that would have been obtained if a different app had been implemented by the radio access network (RAN) We propose a conformal-prediction-based counterfactual analysis method for wireless systems that provides reliable "error bars" for the estimated, containing the true with a user-defined probability.
  arXiv  Detail & Related papers  (2024-09-30T18:47:26Z)
• Heart rate estimation in intense exercise videos [12.117553807794383]
  Existing work can robustly measure heart rate under some degree of motion by face tracking. We present IntensePhysio: a challenging video heart rate estimation dataset. We show that the existing remote photo-plethysmography methods have difficulty in estimating heart rate in this setting.
  arXiv  Detail & Related papers  (2022-08-04T07:42:40Z)
• Mobile Behavioral Biometrics for Passive Authentication [65.94403066225384]
  This work carries out a comparative analysis of unimodal and multimodal behavioral biometric traits. Experiments are performed over HuMIdb, one of the largest and most comprehensive freely available mobile user interaction databases. In our experiments, the most discriminative background sensor is the magnetometer, whereas among touch tasks the best results are achieved with keystroke.
  arXiv  Detail & Related papers  (2022-03-14T17:05:59Z)
• In-Bed Person Monitoring Using Thermal Infrared Sensors [53.561797148529664]
  We use 'Griddy', a prototype with a Panasonic Grid-EYE, a low-resolution infrared thermopile array sensor, which offers more privacy. For this purpose, two datasets were captured, one (480 images) under constant conditions, and a second one (200 images) under different variations. We test three machine learning algorithms: Support Vector Machines (SVM), k-Nearest Neighbors (k-NN) and Neural Network (NN)
  arXiv  Detail & Related papers  (2021-07-16T15:59:07Z)
• Robustness to Spurious Correlations via Human Annotations [100.63051542531171]
  We present a framework for making models robust to spurious correlations by leveraging humans' common sense knowledge of causality. Specifically, we use human annotation to augment each training example with a potential unmeasured variable. We then introduce a new distributionally robust optimization objective over unmeasured variables (UV-DRO) to control the worst-case loss over possible test-time shifts.
  arXiv  Detail & Related papers  (2020-07-13T20:05:19Z)
• Heart Rate Estimation from Face Videos for Student Assessment: Experiments on edBB [24.666654058140836]
  This study focuses on the RGB and near-infrared video sequences for performing heart rate estimation applying remote photoplethysmography techniques. Experiments include behavioral and physiological data from 25 different students completing a collection of tasks related to e-learning. Our proposed face heart rate estimation approach is compared with the heart rate provided by the smartwatch, achieving very promising results for its future deployment in e-learning applications.
  arXiv  Detail & Related papers  (2020-06-01T10:04:36Z)
• MOMBAT: Heart Rate Monitoring from Face Video using Pulse Modeling and Bayesian Tracking [10.43230025523549]
  We propose a novel face video based HR monitoring method MOMBAT. We utilize out-of-plane face movements to define a novel quality estimation mechanism. We design a Bayesian decision theory based HR tracking mechanism to rectify the spurious HR estimates.
  arXiv  Detail & Related papers  (2020-05-10T09:41:16Z)
• Optimised Convolutional Neural Networks for Heart Rate Estimation and Human Activity Recognition in Wrist Worn Sensing Applications [3.8137985834223507]
  We provide improved heart rate and human activity recognition simultaneously at low sample rates. This simplifies hardware design and reduces costs and power budgets. We apply two deep learning pipelines, one for human activity recognition and one for heart rate estimation.
  arXiv  Detail & Related papers  (2020-03-30T11:44:58Z)
• Pedestrian orientation dynamics from high-fidelity measurements [65.06084067891364]
  We propose a novel measurement method based on a deep neural architecture that we train on the basis of generic physical properties of the motion of pedestrians. We show that our method is capable of estimating orientation with an error as low as 7.5 degrees. This tool opens up new possibilities in the studies of human crowd dynamics where orientation is key.
  arXiv  Detail & Related papers  (2020-01-14T07:08:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.