Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction
- URL: http://arxiv.org/abs/2403.10581v2
- Date: Fri, 22 Mar 2024 16:00:24 GMT
- Title: Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction
- Authors: Chen Chen, Lei Li, Marcel Beetz, Abhirup Banerjee, Ramneek Gupta, Vicente Grau,
- Abstract summary: Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate.
We introduce a novel methodology for predicting HF risk using 12-lead electrocardiograms (ECGs)
We present a novel, lightweight dual-attention ECG network designed to capture complex ECG features essential for early HF risk prediction.
- Score: 9.823423993036055
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate. Early detection and prevention of HF could significantly reduce its impact. We introduce a novel methodology for predicting HF risk using 12-lead electrocardiograms (ECGs). We present a novel, lightweight dual-attention ECG network designed to capture complex ECG features essential for early HF risk prediction, despite the notable imbalance between low and high-risk groups. This network incorporates a cross-lead attention module and twelve lead-specific temporal attention modules, focusing on cross-lead interactions and each lead's local dynamics. To further alleviate model overfitting, we leverage a large language model (LLM) with a public ECG-Report dataset for pretraining on an ECG-report alignment task. The network is then fine-tuned for HF risk prediction using two specific cohorts from the UK Biobank study, focusing on patients with hypertension (UKB-HYP) and those who have had a myocardial infarction (UKB-MI).The results reveal that LLM-informed pre-training substantially enhances HF risk prediction in these cohorts. The dual-attention design not only improves interpretability but also predictive accuracy, outperforming existing competitive methods with C-index scores of 0.6349 for UKB-HYP and 0.5805 for UKB-MI. This demonstrates our method's potential in advancing HF risk assessment with clinical complex ECG data.
Related papers
- Self-supervised inter-intra period-aware ECG representation learning for detecting atrial fibrillation [41.82319894067087]
We propose an inter-intra period-aware ECG representation learning approach.
Considering ECGs of atrial fibrillation patients exhibit the irregularity in RR intervals and the absence of P-waves, we develop specific pre-training tasks for interperiod and intraperiod representations.
Our approach demonstrates remarkable AUC performances on the BTCH dataset, textiti.e., 0.953/0.996 for paroxysmal/persistent atrial fibrillation detection.
arXiv Detail & Related papers (2024-10-08T10:03:52Z) - ConvexECG: Lightweight and Explainable Neural Networks for Personalized, Continuous Cardiac Monitoring [43.23305904110984]
ConvexECG is an explainable and resource-efficient method for reconstructing six-lead electrocardiograms from single-lead data.
We demonstrate that ConvexECG achieves accuracy comparable to larger neural networks while significantly reducing computational overhead.
arXiv Detail & Related papers (2024-09-19T06:14:30Z) - Multi-modal Heart Failure Risk Estimation based on Short ECG and Sampled Long-Term HRV [2.1040040536783637]
Cardiovascular diseases, including Heart Failure (HF), remain a leading global cause of mortality, often evading early detection.
Traditional approaches rely on resource-intensive diagnostic tests, typically administered after the onset of symptoms.
In this paper, we propose several multi-modal approaches that combine 30-second ECG recordings and approximate long-term Heart Rate Variability data to estimate the risk of HF hospitalization.
arXiv Detail & Related papers (2024-03-01T01:16:27Z) - Improving Diffusion Models for ECG Imputation with an Augmented Template
Prior [43.6099225257178]
noisy and poor-quality recordings are a major issue for signals collected using mobile health systems.
Recent studies have explored the imputation of missing values in ECG with probabilistic time-series models.
We present a template-guided denoising diffusion probabilistic model (DDPM), PulseDiff, which is conditioned on an informative prior for a range of health conditions.
arXiv Detail & Related papers (2023-10-24T11:34:15Z) - Learning to diagnose cirrhosis from radiological and histological labels
with joint self and weakly-supervised pretraining strategies [62.840338941861134]
We propose to leverage transfer learning from large datasets annotated by radiologists, to predict the histological score available on a small annex dataset.
We compare different pretraining methods, namely weakly-supervised and self-supervised ones, to improve the prediction of the cirrhosis.
This method outperforms the baseline classification of the METAVIR score, reaching an AUC of 0.84 and a balanced accuracy of 0.75.
arXiv Detail & Related papers (2023-02-16T17:06:23Z) - SurvLatent ODE : A Neural ODE based time-to-event model with competing
risks for longitudinal data improves cancer-associated Deep Vein Thrombosis
(DVT) prediction [68.8204255655161]
We propose a generative time-to-event model, SurvLatent ODE, which parameterizes a latent representation under irregularly sampled data.
Our model then utilizes the latent representation to flexibly estimate survival times for multiple competing events without specifying shapes of event-specific hazard function.
SurvLatent ODE outperforms the current clinical standard Khorana Risk scores for stratifying DVT risk groups.
arXiv Detail & Related papers (2022-04-20T17:28:08Z) - Deep artificial neural network for prediction of atrial fibrillation
through the analysis of 12-leads standard ECG [0.0]
Atrial Fibrillation (AF) is a heart's arrhythmia which, despite being often asymptomatic, represents an important risk factor for stroke.
We use Convolution Neural Networks to analyze ECG and predict AF starting from realistic datasets.
arXiv Detail & Related papers (2022-01-14T10:09:01Z) - A Novel Transfer Learning-Based Approach for Screening Pre-existing
Heart Diseases Using Synchronized ECG Signals and Heart Sounds [0.5621251909851629]
Diagnosing pre-existing heart diseases early in life is important to prevent complications such as pulmonary hypertension, heart rhythm problems, blood clots, heart failure and sudden cardiac arrest.
To identify such diseases, phonocardiogram (PCG) and electrocardiogram (ECG) waveforms convey important information.
Here, we evaluate this hypothesis on a subset of the PhysioNet Challenge 2016 dataset which contains simultaneously acquired PCG and ECG recordings.
Our novel Dual-Convolutional Neural Network based approach uses transfer learning to tackle the problem of having limited amounts of simultaneous PCG and ECG data that is publicly available.
arXiv Detail & Related papers (2021-02-02T19:51:12Z) - Prediction of the onset of cardiovascular diseases from electronic
health records using multi-task gated recurrent units [51.14334174570822]
We propose a multi-task recurrent neural network with attention mechanism for predicting cardiovascular events from electronic health records.
The proposed approach is compared to a standard clinical risk predictor (QRISK) and machine learning alternatives using 5-year data from a NHS Foundation Trust.
arXiv Detail & Related papers (2020-07-16T17:43:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.