Echo2ECG: Enhancing ECG Representations with Cardiac Morphology from Multi-View Echos
- URL: http://arxiv.org/abs/2603.08505v1
- Date: Mon, 09 Mar 2026 15:39:57 GMT
- Title: Echo2ECG: Enhancing ECG Representations with Cardiac Morphology from Multi-View Echos
- Abstract summary: Existing self-supervised methods suffer from a representational mismatch by aligning ECGs to single-view Echos.<n>We propose Echo2ECG, a multimodal self-supervised learning framework that enriches ECG representations with the heart's morphological structure captured in multi-view Echos.<n>We evaluate Echo2ECG as an ECG feature extractor on two clinically relevant tasks.
- Score: 53.368813255127115
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological phenotypes, such as left ventricular ejection fraction (LVEF), which typically require echocardiography (Echo). Predicting these phenotypes from ECG would enable early, accessible health screening. Existing self-supervised methods suffer from a representational mismatch by aligning ECGs to single-view Echos, which only capture local, spatially restricted anatomical snapshots. To address this, we propose Echo2ECG, a multimodal self-supervised learning framework that enriches ECG representations with the heart's morphological structure captured in multi-view Echos. We evaluate Echo2ECG as an ECG feature extractor on two clinically relevant tasks that fundamentally require morphological information: (1) classification of structural cardiac phenotypes across three datasets, and (2) retrieval of Echo studies with similar morphological characteristics using ECG queries. Our extracted ECG representations consistently outperform those of state-of-the-art unimodal and multimodal baselines across both tasks, despite being 18x smaller than the largest baseline. These results demonstrate that Echo2ECG is a robust, powerful ECG feature extractor. Our code is accessible at https://github.com/michelleespranita/Echo2ECG.
Related papers
- ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning [50.82313761980655]
ECG-LLM is an ECG-conditioned large language model trained across four cohorts 679,112 ECG studies from 186,409 patients.<n>It is trained on clinically structured question-answer pairs derived from ECG signals, clinical context, CMR, and ECHO.<n>It successfully recovers conventional ECG measurements, such as heart rate, and strongly predicts complex CMR-derived phenotypes.
arXiv Detail & Related papers (2026-07-15T11:06:35Z) - Learning Cardiac Latent Representations in Vectorcardiogram Space [54.12639543496968]
Existing methods operate almost exclusively in the observable ECG signal space.<n>We propose learning a unified latent representation of cardiac electrical activity directly in the VCG space.<n>We introduce LVCG, the first general self-supervised representation learning framework designed to operate in this physically grounded latent space.
arXiv Detail & Related papers (2026-05-29T12:48:12Z) - PG-LRF: Physiology-Guided Latent Rectified Flow for Electro-Hemodynamic PPG-to-ECG Generation [51.79176059799321]
Photoplethysmography is ubiquitous in wearables but lacks ECG-specific diagnostic morphology.<n>Existing methods rely on statistical alignment and data-driven generation.<n>We propose PG-LRF, a physiology-guided latent flow framework.
arXiv Detail & Related papers (2026-05-09T07:39:58Z) - RhythmBERT: A Self-Supervised Language Model Based on Latent Representations of ECG Waveforms for Heart Disease Detection [8.583942286312135]
Electrocardiogram (ECG) analysis is crucial for diagnosing heart disease.<n>Most self-supervised learning methods treat ECG as a generic time series.<n>We propose RhythmBERT, a generative ECG language model that considers ECG as a language paradigm.
arXiv Detail & Related papers (2026-02-26T14:45:29Z) - Dual-Phase Cross-Modal Contrastive Learning for CMR-Guided ECG Representations for Cardiovascular Disease Assessment [5.214355651899765]
We introduce a contrastive learning framework that improves the extraction of clinically relevant cardiac phenotypes from ECG.<n>We demonstrate improved extraction of image-derived phenotypes from ECG, particularly for functional parameters.<n>This strategy could enable scalable and cost-effective extraction of image-derived traits from ECG.
arXiv Detail & Related papers (2026-02-13T12:34:28Z) - Simulator and Experience Enhanced Diffusion Model for Comprehensive ECG Generation [52.19347532840774]
We propose SE-Diff, a novel physiological simulator and experience enhanced diffusion model for ECG generation.<n> SE-Diff integrates a lightweight ordinary differential equation (ODE)-based ECG simulator into the diffusion process via a beat decoder.<n>Extensive experiments on real-world ECG datasets demonstrate that SE-Diff improves both signal fidelity and text-ECG semantic alignment.
arXiv Detail & Related papers (2025-11-13T02:57:10Z) - Reconstructing 12-Lead ECG from 3-Lead ECG using Variational Autoencoder to Improve Cardiac Disease Detection of Wearable ECG Devices [22.76333494370181]
We propose WearECG, a Variational Autoencoder (VAE) method that reconstructs twelve-lead ECGs from three leads: II, V1, and V5.<n>Our model includes architectural improvements to better capture temporal and spatial dependencies in ECG signals.<n>We fine-tune ECGFounder, a large-scale pretrained ECG model, on a multi-label classification task involving over 40 cardiac conditions.
arXiv Detail & Related papers (2025-10-13T14:14:37Z) - EchoingECG: An Electrocardiogram Cross-Modal Model for Echocardiogram Tasks [23.243697999272825]
We introduce EchoingECG, a probabilistic student-teacher model that leverages uncertainty-aware ECG embeddings and ECHO supervision to improve ECG-based cardiac function prediction.<n>Our approach integrates Probabilistic Cross-Modal Embeddings (PCME++), a probabilistic contrastive framework, with ECHO-CLIP, a vision-language pre-trained model trained on ECHO-text pairs, to distill ECHO knowledge into ECG representations.
arXiv Detail & Related papers (2025-09-30T05:03:33Z) - Heartcare Suite: Multi-dimensional Understanding of ECG with Raw Multi-lead Signal Modeling [50.58126509704037]
Heartcare Suite is a framework for fine-grained electrocardiogram (ECG) understanding.<n>Heartcare-220K is a high-quality, structured, and comprehensive multimodal ECG dataset.<n>Heartcare-Bench is a benchmark to guide the optimization of Medical Multimodal Large Language Models (Med-MLLMs) in ECG scenarios.
arXiv Detail & Related papers (2025-06-06T07:56:41Z) - PulseNet: Deep Learning ECG-signal classification using random
augmentation policy and continous wavelet transform for canines [46.09869227806991]
evaluating canine electrocardiograms (ECG) require skilled veterinarians.
Current availability of veterinary cardiologists for ECG interpretation and diagnostic support is limited.
We implement a deep convolutional neural network (CNN) approach for classifying canine electrocardiogram sequences as either normal or abnormal.
arXiv Detail & Related papers (2023-05-17T09:06:39Z) - Classification of Arrhythmia by Using Deep Learning with 2-D ECG
Spectral Image Representation [3.3426603061273994]
We propose a two-dimensional (2-D) convolutional neural network (CNN) model for the classification of ECG signals into eight classes.
We achieved a state-of-the-art average classification accuracy of 99.11%, which is better than those of recently reported results in classifying similar types of arrhythmias.
arXiv Detail & Related papers (2020-05-14T12:11:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.