Multi-Head Cross-Attentional PPG and Motion Signal Fusion for Heart Rate Estimation

• URL: http://arxiv.org/abs/2210.11415v1
• Date: Fri, 14 Oct 2022 08:07:53 GMT
• Title: Multi-Head Cross-Attentional PPG and Motion Signal Fusion for Heart Rate Estimation
• Authors: Panagiotis Kasnesis, Lazaros Toumanidis, Alessio Burrello, Christos Chatzigeorgiou and Charalampos Z. Patrikakis
• Abstract summary: We present a new deep learning model, PULSE, which exploits temporal convolutions and multi-head cross-attention to improve sensor fusion's effectiveness. We evaluate the performance of PULSE on three publicly available datasets, reducing the mean absolute error by 7.56%.
• Score: 2.839269856680851
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Nowadays, Hearth Rate (HR) monitoring is a key feature of almost all wrist-worn devices exploiting photoplethysmography (PPG) sensors. However, arm movements affect the performance of PPG-based HR tracking. This issue is usually addressed by fusing the PPG signal with data produced by inertial measurement units. Thus, deep learning algorithms have been proposed, but they are considered too complex to deploy on wearable devices and lack the explainability of results. In this work, we present a new deep learning model, PULSE, which exploits temporal convolutions and multi-head cross-attention to improve sensor fusion's effectiveness and achieve a step towards explainability. We evaluate the performance of PULSE on three publicly available datasets, reducing the mean absolute error by 7.56% on the most extensive available dataset, PPG-DaLiA. Finally, we demonstrate the explainability of PULSE and the benefits of applying attention modules to PPG and motion data.

Related papers

• SQUWA: Signal Quality Aware DNN Architecture for Enhanced Accuracy in Atrial Fibrillation Detection from Noisy PPG Signals [37.788535094404644]
  Atrial fibrillation (AF) significantly increases the risk of stroke, heart disease, and mortality. Photoplethysmography ( PPG) signals are susceptible to corruption from motion artifacts and other factors often encountered in ambulatory settings. We propose a novel deep learning model, designed to learn how to retain accurate predictions from partially corrupted PPG.
  arXiv  Detail & Related papers  (2024-04-15T01:07:08Z)
• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• Deep adaptative spectral zoom for improved remote heart rate estimation [10.220888127527152]
  Chirp-Z Transform (CZT) can refine the spectrum to the narrow-band range of interest for heart rate, providing improved frequential resolution and, consequently, more accurate estimation. This paper presents the advantages of employing the CZT for remote HR estimation and introduces a novel data-driven adaptive CZT estimator.
  arXiv  Detail & Related papers  (2024-03-11T16:55:19Z)
• Full-Body Motion Reconstruction with Sparse Sensing from Graph Perspective [22.761692765158646]
  Estimating 3D full-body pose from sparse sensor data is a pivotal technique employed for the reconstruction of realistic human motions in Augmented Reality and Virtual Reality. We use Body Pose Graph (BPG) to represent the human body and translate the challenge into a prediction problem of graph missing nodes. Our method's effectiveness is evidenced by the attained state-of-the-art performance, particularly in lower body motion, outperforming other baseline methods.
  arXiv  Detail & Related papers  (2024-01-22T09:29:42Z)
• Bayes-enhanced Multi-view Attention Networks for Robust POI Recommendation [81.4999547454189]
  Existing works assume the available POI check-ins reported by users are the ground-truth depiction of user behaviors. In real application scenarios, the check-in data can be rather unreliable due to both subjective and objective causes. We propose a Bayes-enhanced Multi-view Attention Network to address the uncertainty factors of the user check-ins.
  arXiv  Detail & Related papers  (2023-11-01T12:47:38Z)
• AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time [47.19339667836196]
  We present AlphaPose, a system that can perform accurate whole-body pose estimation and tracking jointly while running in realtime. We show a significant improvement over current state-of-the-art methods in both speed and accuracy on COCO-wholebody, COCO, PoseTrack, and our proposed Halpe-FullBody pose estimation dataset.
  arXiv  Detail & Related papers  (2022-11-07T09:15:38Z)
• Embedding Temporal Convolutional Networks for Energy-Efficient PPG-Based Heart Rate Monitoring [17.155316991045765]
  Photoplethysmography (volution) sensors allow for non-invasive and comfortable heart-rate (HR) monitoring. Motion Artifacts (MAs) severely impact the monitoring accuracy, causing high variability in the skin-to-sensor interface. We propose a computationally lightweight yet robust deep learning-based approach for PPG-based HR estimation. We validate our approaches on two benchmark datasets, achieving as low as 3.84 Beats per Minute (BPM) of Mean Absolute Error (MAE) on PPGDalia.
  arXiv  Detail & Related papers  (2022-03-01T17:04:28Z)
• PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer [55.936527926778695]
  Recent deep learning approaches focus on mining subtle r clues using convolutional neural networks with limited-temporal receptive fields. In this paper, we propose the PhysFormer, an end-to-end video transformer based architecture.
  arXiv  Detail & Related papers  (2021-11-23T18:57:11Z)
• FasterPose: A Faster Simple Baseline for Human Pose Estimation [65.8413964785972]
  We propose a design paradigm for cost-effective network with LR representation for efficient pose estimation, named FasterPose. We study the training behavior of FasterPose, and formulate a novel regressive cross-entropy (RCE) loss function for accelerating the convergence. Compared with the previously dominant network of pose estimation, our method reduces 58% of the FLOPs and simultaneously gains 1.3% improvement of accuracy.
  arXiv  Detail & Related papers  (2021-07-07T13:39:08Z)
• Non-contact PPG Signal and Heart Rate Estimation with Multi-hierarchical Convolutional Network [12.119293125608976]
  Heart rate (HR) are important physiological parameters of the human body. This study presents an efficient multi-archhierical- convolutional network that can estimate HR from face video clips.
  arXiv  Detail & Related papers  (2021-04-06T03:04:27Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.