Non-contact, Real-time, Heart-rate Measurement using Image Processing with Commodity Cameras and AI Agents

• URL: http://arxiv.org/abs/2607.06598v1
• Date: Mon, 06 Jul 2026 23:38:02 GMT
• Title: Non-contact, Real-time, Heart-rate Measurement using Image Processing with Commodity Cameras and AI Agents
• Abstract summary: We develop a system for non-contact, real-time, heart rate measurement using image processing with commodity cameras such as an embedded camera on a laptop.<n>We use an innovative algorithm to capture the relevant signals for the computation of heart rate in a time series in real life environments.<n>We test and analyze the developed prototypes against heart rate results by Apple Watch.
• Score: 1.1458853556386797
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Heart rate measurement is one of the key requirements for real-time health monitoring, in particular for health caring of elderly people. Traditional heart rate measurement relies on contact sensing mechanisms such as some heart rate measurement devices at medical hospitals or some wearable devices with embedded sensors such as Apple Watch, etc. In this paper, we develop a system for non-contact, real-time, heart rate measurement using image processing with commodity cameras such as an embedded camera on a laptop, where we use an innovative algorithm to capture the relevant signals for the computation of heart rate in a time series in real life environments. The presented heart rate computation (HRC) process is composed with four major steps: (a) identify frames per second of the camera in use, i.e., 30 frames per second for a given camera, (b) face detection (FD) with shape predictor of 68 face landmarks using deep learning (DL) method, (c) time sliding window (TSW) algorithm to de-noise the signal by smoothing out the noise, and (d) compute heart rate based on identified signal periodicity. We test and analyze the developed prototypes against heart rate results by Apple Watch and check the difference range in multiple rounds and compute the mean of the difference for the measurement values of the heart rate of the same person at the same time. We will do further tuning and optimization of the present methods and deploy the system as a personal AI agent [6] for health monitoring as our future directions.

Related papers

• CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation [33.42512865785489]
  We introduce CardioState-JEPA, a cardiac foundation model to learn a single shared representation jointly across ECG, PPG, and PCG.<n>The model maps heterogeneous waveforms into a common token space, processes them with a single shared Transformer encoder, and learns by predicting masked latent cardiac states.<n>Our encoder improves average PPG classification by 8.2 AUROC points, PCG murmur detection by 18.8 AUROC points, and ECG classification by 15.5 AUROC points over the best self-supervised signal baseline.
  arXiv  Detail & Related papers  (2026-08-13T08:21:06Z)
• Temporal Cardiovascular Dynamics for Improved PPG-Based Heart Rate Estimation [35.715609556178165]
  We study the non-linear chaotic behavior of heart rate through mutual information.<n>Our proposed approach handles the non-linear temporal complexity from a mathematical perspective.<n>Our results demonstrate a substantial improvement, up to 40%, of the proposed approach in estimating heart rate.
  arXiv  Detail & Related papers  (2025-10-31T09:12:14Z)
• Prototyping an End-to-End Multi-Modal Tiny-CNN for Cardiovascular Sensor Patches [35.899401205042615]
  We propose a convolutional neural network with early fusion of data to solve a binary classification problem.<n>Our approach reduces memory footprint and compute cost by three orders of magnitude compared to the state-of-the-art.
  arXiv  Detail & Related papers  (2025-10-21T14:23:20Z)
• Advancing Intoxication Detection: A Smartwatch-Based Approach [32.23955373368]
  This work introduces a mobile smartwatch application approach to just-in-time interventions for intoxication warnings.<n>We have created a dataset gathering TAC, accelerometer, gyroscope, and heart rate data from the participants during a period of three weeks.<n>This is the first study to combine accelerometer, gyroscope, and heart rate smartwatch data collected over an extended monitoring period to classify intoxication levels.
  arXiv  Detail & Related papers  (2025-10-10T23:21:15Z)
• Time-Series U-Net with Recurrence for Noise-Robust Imaging Photoplethysmography [14.749406169315554]
  Photoplethysmography system consists of three modules: face and landmark detection, time-series extraction, and pulse signal/pulse rate estimation.<n>The pulse signal estimation module, which we call TURNIP, allows the system to faithfully reconstruct the underlying pulse signal waveform.<n>Our algorithm provides reliable heart rate estimates without the need for specialized sensors or contact with the skin.
  arXiv  Detail & Related papers  (2025-03-21T17:52:33Z)
• Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
  Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more.<n>We introduce methods that combine signal processing and deep learning methods in an inverse problem.
  arXiv  Detail & Related papers  (2025-03-21T16:11:21Z)
• Dataset Creation Pipeline for Camera-Based Heart Rate Estimation [0.3058685580689604]
  Heart rate is one of the most vital health metrics which can be utilized to investigate and gain intuitions into various human physiological and psychological information. Various techniques for camera-based heart rate estimation have been developed ranging from classical image processing to convoluted deep learning models and architectures. In this paper, we discuss how to prepare data for the task of developing an algorithm or machine learning model for heart rate estimation from images of facial regions.
  arXiv  Detail & Related papers  (2023-03-02T18:28:29Z)
• A Supervised Learning Approach for Robust Health Monitoring using Face Videos [32.157163136267954]
  Non-contact, device-free human sensing methods can eliminate the need for specialized heart and blood pressure monitoring equipment. In this paper, we used a non-contact method that only requires face videos recorded using commercially-available webcams. The proposed approach used facial recognition to detect the face in each frame of the video using facial landmarks.
  arXiv  Detail & Related papers  (2021-01-30T22:03:16Z)
• Personalized Deep Learning for Ventricular Arrhythmias Detection on Medical IoT Systems [17.966382901357118]
  Life-threatening ventricular arrhythmias (VA) are the leading cause of sudden cardiac death (SCD) We propose the personalized computing framework for deep learning based VA detection on medical IoT systems. We equip the system with real-time inference on both intracardiac and surface rhythm monitors.
  arXiv  Detail & Related papers  (2020-08-18T17:41:58Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)
• Optimised Convolutional Neural Networks for Heart Rate Estimation and Human Activity Recognition in Wrist Worn Sensing Applications [3.8137985834223507]
  We provide improved heart rate and human activity recognition simultaneously at low sample rates. This simplifies hardware design and reduces costs and power budgets. We apply two deep learning pipelines, one for human activity recognition and one for heart rate estimation.
  arXiv  Detail & Related papers  (2020-03-30T11:44:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.