Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers

• URL: http://arxiv.org/abs/2505.21767v2
• Date: Tue, 22 Jul 2025 22:06:36 GMT
• Title: Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers
• Abstract summary: We propose a novel PPG-to-ECG reconstruction method that leverages a Vision Transformer (ViT) as the core network.<n>By leveraging the self-attention mechanism in ViT, our approach effectively captures both inter-beat and intra-beat dependencies.<n> Experimental results demonstrate that our method consistently outperforms existing 1D convolution-based approaches.
• Score: 6.70504799375581
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reconstructing ECG from PPG is a promising yet challenging task. While recent advancements in generative models have significantly improved ECG reconstruction, accurately capturing fine-grained waveform features remains a key challenge. To address this, we propose a novel PPG-to-ECG reconstruction method that leverages a Vision Transformer (ViT) as the core network. Unlike conventional approaches that rely on single-channel PPG, our method employs a four-channel signal image representation, incorporating the original PPG, its first-order difference, second-order difference, and area under the curve. This multi-channel design enriches feature extraction by preserving both temporal and physiological variations within the PPG. By leveraging the self-attention mechanism in ViT, our approach effectively captures both inter-beat and intra-beat dependencies, leading to more robust and accurate ECG reconstruction. Experimental results demonstrate that our method consistently outperforms existing 1D convolution-based approaches, achieving up to 29% reduction in PRD and 15% reduction in RMSE. The proposed approach also produces improvements in other evaluation metrics, highlighting its robustness and effectiveness in reconstructing ECG signals. Furthermore, to ensure a clinically relevant evaluation, we introduce new performance metrics, including QRS area error, PR interval error, RT interval error, and RT amplitude difference error. Our findings suggest that integrating a four-channel signal image representation with the self-attention mechanism of ViT enables more effective extraction of informative PPG features and improved modeling of beat-to-beat variations for PPG-to-ECG mapping. Beyond demonstrating the potential of PPG as a viable alternative for heart activity monitoring, our approach opens new avenues for cyclic signal analysis and prediction.

Related papers

• P2E-VQ: ECG-linked representation augmentation for PPG via discrete patch retrieval [11.204271681329898]
  Photoplethysmography ( PPG) is widely used in consumer wearables because of its low cost and ease of acquisition.<n>Unlike electrocardiography (ECG), PPG measures peripheral morphological dynamics rather than cardiac electrical activity.<n>Existing methods attempt to bridge this gap by reconstructing ECG signals from PPG signals.<n>We propose P2E-VQ, a retrieval-augmented framework that replaces ECG waveform reconstruction with ECG-linked representation retrieval.
  arXiv  Detail & Related papers  (2026-07-31T10:30:41Z)
• Rethinking Feature Alignment in Generalist Graph Anomaly Detection: A Relational Fingerprint-based Approach [60.199985286210904]
  Generalist graph anomaly detection (GAD) aims to detect anomalies on unseen graphs without graph-specific retraining.<n>Existing approaches primarily focus on aligning heterogeneous data across domains, which ignores different feature semantics.<n>We propose Fingerprint-based generalist GAD approach (ReFi-GAD)<n>We show that ReFi-GAD significantly outperforms state-of-the-art methods in experiments on 14 datasets.
  arXiv  Detail & Related papers  (2026-05-25T05:12:26Z)
• PG-LRF: Physiology-Guided Latent Rectified Flow for Electro-Hemodynamic PPG-to-ECG Generation [51.79176059799321]
  Photoplethysmography is ubiquitous in wearables but lacks ECG-specific diagnostic morphology.<n>Existing methods rely on statistical alignment and data-driven generation.<n>We propose PG-LRF, a physiology-guided latent flow framework.
  arXiv  Detail & Related papers  (2026-05-09T07:39:58Z)
• Echo2ECG: Enhancing ECG Representations with Cardiac Morphology from Multi-View Echos [53.368813255127115]
  Existing self-supervised methods suffer from a representational mismatch by aligning ECGs to single-view Echos.<n>We propose Echo2ECG, a multimodal self-supervised learning framework that enriches ECG representations with the heart's morphological structure captured in multi-view Echos.<n>We evaluate Echo2ECG as an ECG feature extractor on two clinically relevant tasks.
  arXiv  Detail & Related papers  (2026-03-09T15:39:57Z)
• LifWavNet: Lifting Wavelet-based Network for Non-contact ECG Reconstruction from Radar [16.599277853699604]
  We present LifWavNet, a lifting wavelet network based on a multi-resolution analysis and synthesis (MRAS) model for radar-to-ECG reconstruction.<n> Evaluations demonstrate that LifWavNet outperforms state-of-the-art methods in ECG reconstruction and downstream vital sign estimation.
  arXiv  Detail & Related papers  (2025-10-31T17:59:58Z)
• Translation from Wearable PPG to 12-Lead ECG [35.793551592077016]
  The 12-lead electrocardiogram (ECG) is the gold standard for cardiovascular monitoring.<n>Existing 12-lead ECG systems rely on cumbersome multi-electrode setups, limiting sustained monitoring in ambulatory settings.<n>We introduce P2Es, an innovative demographic-aware framework designed to generate clinically valid 12-lead ECG from PPG signals.
  arXiv  Detail & Related papers  (2025-09-29T20:36:24Z)
• APHQ-ViT: Post-Training Quantization with Average Perturbation Hessian Based Reconstruction for Vision Transformers [71.2294205496784]
  We propose textbfAPHQ-ViT, a novel PTQ approach based on importance estimation with Average Perturbation Hessian (APH)<n>We show that APHQ-ViT using linear quantizers outperforms existing PTQ methods by substantial margins in 3-bit and 4-bit across different vision tasks.
  arXiv  Detail & Related papers  (2025-04-03T11:48:56Z)
• CLEP-GAN: An Innovative Approach to Subject-Independent ECG Reconstruction from PPG Signals [6.327810380749031]
  The study addresses the challenge of reconstructing unseen ECG signals from PPG signals.<n>Data collection processes often introduce noise, complicating ECG reconstruction from PPG even with advanced machine learning models.<n>We develop a novel subject-independent PPG-to-ECG reconstruction model that integrates contrastive learning, adversarial learning, and attention gating.
  arXiv  Detail & Related papers  (2025-02-24T16:53:47Z)
• DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection [49.196182908826565]
  Auditory Attention Detection (AAD) aims to detect target speaker from brain signals in a multi-speaker environment. Current approaches primarily rely on traditional convolutional neural network designed for processing Euclidean data like images. This paper proposes a dynamical graph self-distillation (DGSD) approach for AAD, which does not require speech stimuli as input.
  arXiv  Detail & Related papers  (2023-09-07T13:43:46Z)
• PulseNet: Deep Learning ECG-signal classification using random augmentation policy and continous wavelet transform for canines [46.09869227806991]
  evaluating canine electrocardiograms (ECG) require skilled veterinarians. Current availability of veterinary cardiologists for ECG interpretation and diagnostic support is limited. We implement a deep convolutional neural network (CNN) approach for classifying canine electrocardiogram sequences as either normal or abnormal.
  arXiv  Detail & Related papers  (2023-05-17T09:06:39Z)
• DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signal [48.97719097435527]
  DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels. An artery re-identification module qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images.
  arXiv  Detail & Related papers  (2023-05-15T18:19:29Z)
• Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
  In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network. We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module. Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
  arXiv  Detail & Related papers  (2022-12-01T07:32:56Z)
• REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
  REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images. To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
  arXiv  Detail & Related papers  (2022-08-17T03:42:19Z)
• Identifying Rhythmic Patterns for Face Forgery Detection and Categorization [46.21354355137544]
  We propose a framework for face forgery detection and categorization consisting of: 1) a Spatial-Temporal Filtering Network (STFNet) for PPG signals, and 2) a Spatial-Temporal Interaction Network (STINet) for constraint and interaction of PPG signals. With insight into the generation of forgery methods, we further propose intra-source and inter-source blending to boost the performance of the framework.
  arXiv  Detail & Related papers  (2022-07-04T04:57:06Z)
• Performer: A Novel PPG to ECG Reconstruction Transformer For a Digital Biomarker of Cardiovascular Disease Detection [0.0]
  Cardiovascular diseases (CVDs) have become the top one cause of death; three-quarters of these deaths occur in lower-income communities. Electrocardiography (ECG) is infeasible for continuous cardiac monitoring due to its requirement for user participation. Photoplethysmography is easy to collect, but the limited accuracy constrains its clinical usage.
  arXiv  Detail & Related papers  (2022-04-25T17:10:13Z)
• Multi-Channel Convolutional Analysis Operator Learning for Dual-Energy CT Reconstruction [108.06731611196291]
  We develop a multi-channel convolutional analysis operator learning (MCAOL) method to exploit common spatial features within attenuation images at different energies. We propose an optimization method which jointly reconstructs the attenuation images at low and high energies with a mixed norm regularization on the sparse features.
  arXiv  Detail & Related papers  (2022-03-10T14:22:54Z)
• Face2PPG: An unsupervised pipeline for blood volume pulse extraction from faces [0.456877715768796]
  Photoplethys signals have become a key technology in many fields, such as medicine, well-being, or sports. Our work proposes a set of pipelines to extract PPG signals from the face robustly, reliably, and robustness.
  arXiv  Detail & Related papers  (2022-02-08T19:06:20Z)
• Runtime Monitoring and Statistical Approaches for Correlation Analysis of ECG and PPG [3.9526036279093937]
  ECG and PPG are signals, which provide a "different window" into the same phenomena. ECG and PPG are used separately, but there are no studies regarding the exact correction of the different ECG and PPG events. We present the first approach in formally establishing the key relationships between ECG and PPG signals.
  arXiv  Detail & Related papers  (2022-01-20T08:01:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.