Joint Attention Mechanism Learning to Facilitate Opto-physiological Monitoring during Physical Activity

• URL: http://arxiv.org/abs/2502.09291v1
• Date: Thu, 13 Feb 2025 13:08:11 GMT
• Title: Joint Attention Mechanism Learning to Facilitate Opto-physiological Monitoring during Physical Activity
• Authors: Xiaoyu Zheng, Sijung Hu, Vincent Dwyer, Mahsa Derakhshani, Laura Barrett,
• Abstract summary: This study proposes a practical adversarial learning approach for opto-physiological monitoring by using a generative adversarial network with an attention mechanism (AM-GAN)<n>The AM-GAN learns an MA-resistant mapping from raw and noisy signals to clear PPG signals in an adversarial manner.<n>The study demonstrates the robustness and resilience of AM-GAN, particularly during low-to-high-intensity physical activities.
• Score: 4.674309739521861
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Opto-physiological monitoring is a non-contact technique for measuring cardiac signals, i.e., photoplethysmography (PPG). Quality PPG signals directly lead to reliable physiological readings. However, PPG signal acquisition procedures are often accompanied by spurious motion artefacts (MAs), especially during low-to-high-intensity physical activity. This study proposes a practical adversarial learning approach for opto-physiological monitoring by using a generative adversarial network with an attention mechanism (AM-GAN) to model motion noise and to allow MA removal. The AM-GAN learns an MA-resistant mapping from raw and noisy signals to clear PPG signals in an adversarial manner, guided by an attention mechanism to directly translate the motion reference of triaxial acceleration to the MAs appearing in the raw signal. The AM-GAN was experimented with three various protocols engaged with 39 subjects in various physical activities. The average absolute error for heart rate (HR) derived from the MA-free PPG signal via the AM-GAN, is 1.81 beats/min for the IEEE-SPC dataset and 3.86 beats/min for the PPGDalia dataset. The same procedure applied to an in-house LU dataset resulted in average absolute errors for HR and respiratory rate (RR) of less than 1.37 beats/min and 2.49 breaths/min, respectively. The study demonstrates the robustness and resilience of AM-GAN, particularly during low-to-high-intensity physical activities.

Related papers

• Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
  Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more. We introduce methods that combine signal processing and deep learning methods in an inverse problem.
  arXiv  Detail & Related papers  (2025-03-21T16:11:21Z)
• Finger-to-Chest Style Transfer-assisted Deep Learning Method For Photoplethysmogram Waveform Restoration with Timing Preservation [1.0470286407954037]
  We propose a style transfer-assisted cycle-consistent generative adversarial network, called starGAN, to efficiently restore chest-acquired PPG signals. Two identical devices are adopted, one sensor to collect the PPG signal on the chest considered to feature low quality and undergoing restoration, and another sensor to obtain a high-quality PPG signal measured on the finger.
  arXiv  Detail & Related papers  (2025-03-11T09:38:44Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [53.2981100111204]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring. Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors. In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type. Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• Synthetic Time Series Data Generation for Healthcare Applications: A PCG Case Study [43.28613210217385]
  We employ and compare three state-of-the-art generative models to generate PCG data.<n>Our results demonstrate that the generated PCG data closely resembles the original datasets.<n>In our future work, we plan to incorporate this method into a data augmentation pipeline to synthesize abnormal PCG signals with heart murmurs.
  arXiv  Detail & Related papers  (2024-12-17T18:07:40Z)
• Machine Learning-based Estimation of Respiratory Fluctuations in a Healthy Adult Population using BOLD fMRI and Head Motion Parameters [39.96015789655091]
  In many fMRI studies, respiratory signals are often missing or of poor quality. It could be highly beneficial to have a tool to extract respiratory variation (RV) waveforms directly from fMRI data without the need for peripheral recording devices. This study proposes a CNN model for reconstruction of RV waveforms using head motion parameters and BOLD signals.
  arXiv  Detail & Related papers  (2024-04-30T21:53:11Z)
• PAD-Phys: Exploiting Physiology for Presentation Attack Detection in Face Biometrics [48.683457383784145]
  Three approaches to presentation attack detection based on r: (i) the physiological domain, (ii) the Deepfakes domain, and (iii) a new Presentation Attack domain. Results show a 21.70% decrease in average classification error rate (ACER) when the presentation attack domain is compared to the physiological and Deepfakes domains. Experiments highlight the efficiency of transfer learning in r-based models and perform well in presentation attack detection in instruments that do not allow copying of this physiological feature.
  arXiv  Detail & Related papers  (2023-10-03T15:24:15Z)
• PPG-to-ECG Signal Translation for Continuous Atrial Fibrillation Detection via Attention-based Deep State-Space Modeling [11.617950008187366]
  Photoplethysmography ( PPG) is a cost-effective and non-invasive technique that utilizes optical methods to measure cardiac physiology. Here, we propose a subject-independent attention-based deep state-space model (ADSSM) to translate PPG signals to corresponding ECG waveforms.
  arXiv  Detail & Related papers  (2023-09-27T03:07:46Z)
• Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based Sparse PCA Network [93.22587316229954]
  We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E) We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
  arXiv  Detail & Related papers  (2021-10-27T19:28:36Z)
• Motion Artifact Reduction In Photoplethysmography For Reliable Signal Selection [5.264561559435017]
  Photoplethysmography ( PPG) is a non-invasive and economical technique to extract vital signs of the human body. It is sensitive to motion which can corrupt the signal's quality. It is valuable to collect realistic PPG signals while performing Activities of Daily Living (ADL) to develop practical signal denoising and analysis methods.
  arXiv  Detail & Related papers  (2021-09-06T21:53:56Z)
• Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses [78.120734120667]
  We introduce a novel method, based on a long short-term memory (LSTM) network, to continuously map forearm EMG activity onto hand kinematics. Ours is the first reported work on the prediction of hand kinematics that uses this challenging dataset. Our results suggest that the presented method is suitable for the generation of control signals for the independent and proportional actuation of the multiple DOFs of state-of-the-art hand prostheses.
  arXiv  Detail & Related papers  (2021-04-29T00:11:32Z)
• Non-contact PPG Signal and Heart Rate Estimation with Multi-hierarchical Convolutional Network [12.119293125608976]
  Heart rate (HR) are important physiological parameters of the human body. This study presents an efficient multi-archhierical- convolutional network that can estimate HR from face video clips.
  arXiv  Detail & Related papers  (2021-04-06T03:04:27Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.