Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction
- URL: http://arxiv.org/abs/2403.10581v2
- Date: Fri, 22 Mar 2024 16:00:24 GMT
- Title: Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction
- Authors: Chen Chen, Lei Li, Marcel Beetz, Abhirup Banerjee, Ramneek Gupta, Vicente Grau,
- Abstract summary: Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate.
We introduce a novel methodology for predicting HF risk using 12-lead electrocardiograms (ECGs)
We present a novel, lightweight dual-attention ECG network designed to capture complex ECG features essential for early HF risk prediction.
- Score: 9.823423993036055
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate. Early detection and prevention of HF could significantly reduce its impact. We introduce a novel methodology for predicting HF risk using 12-lead electrocardiograms (ECGs). We present a novel, lightweight dual-attention ECG network designed to capture complex ECG features essential for early HF risk prediction, despite the notable imbalance between low and high-risk groups. This network incorporates a cross-lead attention module and twelve lead-specific temporal attention modules, focusing on cross-lead interactions and each lead's local dynamics. To further alleviate model overfitting, we leverage a large language model (LLM) with a public ECG-Report dataset for pretraining on an ECG-report alignment task. The network is then fine-tuned for HF risk prediction using two specific cohorts from the UK Biobank study, focusing on patients with hypertension (UKB-HYP) and those who have had a myocardial infarction (UKB-MI).The results reveal that LLM-informed pre-training substantially enhances HF risk prediction in these cohorts. The dual-attention design not only improves interpretability but also predictive accuracy, outperforming existing competitive methods with C-index scores of 0.6349 for UKB-HYP and 0.5805 for UKB-MI. This demonstrates our method's potential in advancing HF risk assessment with clinical complex ECG data.
Related papers
- FADE: Forecasting for Anomaly Detection on ECG [4.914228925573227]
The objective of this work is to propose a deep learning system, FADE, designed for normal ECG forecasting and anomaly detection.
FADE has been trained in a self-supervised manner with a novel morphological inspired loss function.
Using a novel distance function to compare forecasted ECG signals with actual sensor data, our method effectively identifies cardiac anomalies.
arXiv Detail & Related papers (2025-02-11T09:19:39Z) - DiffuSETS: 12-lead ECG Generation Conditioned on Clinical Text Reports and Patient-Specific Information [13.680337221159506]
Heart disease remains a significant threat to human health.
Scarcity of high-quality ECG data, driven by privacy concerns and limited medical resources, creates a pressing need for effective ECG signal generation.
We propose DiffuSETS, a novel framework capable of generating ECG signals with high semantic alignment and fidelity.
arXiv Detail & Related papers (2025-01-10T12:55:34Z) - Self-supervised inter-intra period-aware ECG representation learning for detecting atrial fibrillation [41.82319894067087]
We propose an inter-intra period-aware ECG representation learning approach.
Considering ECGs of atrial fibrillation patients exhibit the irregularity in RR intervals and the absence of P-waves, we develop specific pre-training tasks for interperiod and intraperiod representations.
Our approach demonstrates remarkable AUC performances on the BTCH dataset, textiti.e., 0.953/0.996 for paroxysmal/persistent atrial fibrillation detection.
arXiv Detail & Related papers (2024-10-08T10:03:52Z) - ConvexECG: Lightweight and Explainable Neural Networks for Personalized, Continuous Cardiac Monitoring [43.23305904110984]
ConvexECG is an explainable and resource-efficient method for reconstructing six-lead electrocardiograms from single-lead data.
We demonstrate that ConvexECG achieves accuracy comparable to larger neural networks while significantly reducing computational overhead.
arXiv Detail & Related papers (2024-09-19T06:14:30Z) - Augmented Risk Prediction for the Onset of Alzheimer's Disease from Electronic Health Records with Large Language Models [42.676566166835585]
Alzheimer's disease (AD) is the fifth-leading cause of death among Americans aged 65 and older.
Recent advancements in large language models (LLMs) offer strong potential for enhancing risk prediction.
This paper proposes a novel pipeline that augments risk prediction by leveraging the few-shot inference power of LLMs.
arXiv Detail & Related papers (2024-05-26T03:05:10Z) - Multi-modal Heart Failure Risk Estimation based on Short ECG and Sampled Long-Term HRV [2.1040040536783637]
Cardiovascular diseases, including Heart Failure (HF), remain a leading global cause of mortality, often evading early detection.
Traditional approaches rely on resource-intensive diagnostic tests, typically administered after the onset of symptoms.
In this paper, we propose several multi-modal approaches that combine 30-second ECG recordings and approximate long-term Heart Rate Variability data to estimate the risk of HF hospitalization.
arXiv Detail & Related papers (2024-03-01T01:16:27Z) - Improving Diffusion Models for ECG Imputation with an Augmented Template
Prior [43.6099225257178]
noisy and poor-quality recordings are a major issue for signals collected using mobile health systems.
Recent studies have explored the imputation of missing values in ECG with probabilistic time-series models.
We present a template-guided denoising diffusion probabilistic model (DDPM), PulseDiff, which is conditioned on an informative prior for a range of health conditions.
arXiv Detail & Related papers (2023-10-24T11:34:15Z) - Learning to diagnose cirrhosis from radiological and histological labels
with joint self and weakly-supervised pretraining strategies [62.840338941861134]
We propose to leverage transfer learning from large datasets annotated by radiologists, to predict the histological score available on a small annex dataset.
We compare different pretraining methods, namely weakly-supervised and self-supervised ones, to improve the prediction of the cirrhosis.
This method outperforms the baseline classification of the METAVIR score, reaching an AUC of 0.84 and a balanced accuracy of 0.75.
arXiv Detail & Related papers (2023-02-16T17:06:23Z) - Deep artificial neural network for prediction of atrial fibrillation
through the analysis of 12-leads standard ECG [0.0]
Atrial Fibrillation (AF) is a heart's arrhythmia which, despite being often asymptomatic, represents an important risk factor for stroke.
We use Convolution Neural Networks to analyze ECG and predict AF starting from realistic datasets.
arXiv Detail & Related papers (2022-01-14T10:09:01Z) - Prediction of the onset of cardiovascular diseases from electronic
health records using multi-task gated recurrent units [51.14334174570822]
We propose a multi-task recurrent neural network with attention mechanism for predicting cardiovascular events from electronic health records.
The proposed approach is compared to a standard clinical risk predictor (QRISK) and machine learning alternatives using 5-year data from a NHS Foundation Trust.
arXiv Detail & Related papers (2020-07-16T17:43:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.