ASCENDgpt: A Phenotype-Aware Transformer Model for Cardiovascular Risk Prediction from Electronic Health Records
- URL: http://arxiv.org/abs/2509.04485v1
- Date: Sun, 31 Aug 2025 16:43:07 GMT
- Title: ASCENDgpt: A Phenotype-Aware Transformer Model for Cardiovascular Risk Prediction from Electronic Health Records
- Abstract summary: We present ASCENDgpt, a transformer-based model for cardiovascular risk prediction from longitudinal electronic health records.<n>Our approach introduces a novel phenotype-aware tokenization scheme that maps 47,155 raw ICD codes to 176 clinically meaningful phenotype tokens.<n>This phenotype mapping contributes to a total vocabulary of 10,442 tokens - a 77.9% reduction when compared with using raw ICD codes directly.
- Score: 0.04910937238451483
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present ASCENDgpt, a transformer-based model specifically designed for cardiovascular risk prediction from longitudinal electronic health records (EHRs). Our approach introduces a novel phenotype-aware tokenization scheme that maps 47,155 raw ICD codes to 176 clinically meaningful phenotype tokens, achieving 99.6\% consolidation of diagnosis codes while preserving semantic information. This phenotype mapping contributes to a total vocabulary of 10,442 tokens - a 77.9\% reduction when compared with using raw ICD codes directly. We pretrain ASCENDgpt on sequences derived from 19402 unique individuals using a masked language modeling objective, then fine-tune for time-to-event prediction of five cardiovascular outcomes: myocardial infarction (MI), stroke, major adverse cardiovascular events (MACE), cardiovascular death, and all-cause mortality. Our model achieves excellent discrimination on the held-out test set with an average C-index of 0.816, demonstrating strong performance across all outcomes (MI: 0.792, stroke: 0.824, MACE: 0.800, cardiovascular death: 0.842, all-cause mortality: 0.824). The phenotype-based approach enables clinically interpretable predictions while maintaining computational efficiency. Our work demonstrates the effectiveness of domain-specific tokenization and pretraining for EHR-based risk prediction tasks.
Related papers
- A Latent ODE Approach to Spatiotemporal Modeling of Cine Cardiac MRI [35.84205082882139]
We present a latent dynamical model that encodes bi-ventricular anatomy and full-cycle cine motion as a continuous trajectory.<n>We studied 72,386 UK Biobank participants without baseline cardiovascular disease, including 367 incident heart failure events.
arXiv Detail & Related papers (2026-06-25T07:53:45Z) - Early Prediction of Multi-Label Care Escalation Triggers in the Intensive Care Unit Using Electronic Health Records [1.116791976498254]
This study proposes a multi-label classification framework to predict Care Escalation Triggers (CETs)<n>CETs are defined using rule-based criteria applied to data from hours 24 to 72.<n>We train and evaluate multiple classification models on a cohort of 85,242 ICU stays.
arXiv Detail & Related papers (2025-09-15T20:40:45Z) - A Novel Attention-Augmented Wavelet YOLO System for Real-time Brain Vessel Segmentation on Transcranial Color-coded Doppler [49.03919553747297]
We propose an AI-powered, real-time CoW auto-segmentation system capable of efficiently capturing cerebral arteries.<n>No prior studies have explored AI-driven cerebrovascular segmentation using Transcranial Color-coded Doppler (TCCD)<n>The proposed AAW-YOLO demonstrated strong performance in segmenting both ipsilateral and contralateral CoW vessels.
arXiv Detail & Related papers (2025-08-19T14:41:22Z) - CardioTabNet: A Novel Hybrid Transformer Model for Heart Disease Prediction using Tabular Medical Data [0.46581008529871043]
Our study utilizes the open-source dataset for heart disease prediction with 1190 instances and 11 features.<n>Ten machine-learning models were used to predict heart disease using selected features.<n>The top downstream model (a hyper-tuned ExtraTree) achieved an average accuracy rate of 94.1% and an average Area Under Curve (AUC) of 95.0%.
arXiv Detail & Related papers (2025-03-22T06:17:08Z) - A Transformer-based survival model for prediction of all-cause mortality in heart failure patients: a multi-cohort study [5.831730826863567]
We developed and validated TRisk, a Transformer-based AI model predicting 36-month mortality in heart failure patients.<n>Our study included 403,534 heart failure patients (ages 40-90) from 1,418 English general practices.
arXiv Detail & Related papers (2025-03-16T01:53:50Z) - Leveraging Cardiovascular Simulations for In-Vivo Prediction of Cardiac Biomarkers [43.17768785084301]
We train an amortized neural posterior estimator on a newly built large dataset of cardiac simulations.<n>We incorporate elements modeling effects to better align simulated data with real-world measurements.<n>The proposed framework can further integrate in-vivo data sources to refine its predictive capabilities on real-world data.
arXiv Detail & Related papers (2024-12-23T13:05:17Z) - CRTRE: Causal Rule Generation with Target Trial Emulation Framework [47.2836994469923]
We introduce a novel method called causal rule generation with target trial emulation framework (CRTRE)
CRTRE applies randomize trial design principles to estimate the causal effect of association rules.
We then incorporate such association rules for the downstream applications such as prediction of disease onsets.
arXiv Detail & Related papers (2024-11-10T02:40:06Z) - Integrating Deep Learning with Fundus and Optical Coherence Tomography for Cardiovascular Disease Prediction [47.7045293755736]
Early identification of patients at risk of cardiovascular diseases (CVD) is crucial for effective preventive care, reducing healthcare burden, and improving patients' quality of life.
This study demonstrates the potential of retinal optical coherence tomography ( OCT) imaging combined with fundus photographs for identifying future adverse cardiac events.
We propose a novel binary classification network based on a Multi-channel Variational Autoencoder (MCVAE), which learns a latent embedding of patients' fundus and OCT images to classify individuals into two groups: those likely to develop CVD in the future and those who are not.
arXiv Detail & Related papers (2024-10-18T12:37:51Z) - Predicting risk of cardiovascular disease using retinal OCT imaging [40.71667870702634]
Cardiovascular diseases (CVD) are the leading cause of death globally.<n>Optical coherence tomography ( OCT) has gained recognition as a potential tool for early CVD risk prediction.<n>We investigated the potential of OCT as an additional imaging technique to predict future CVD events.
arXiv Detail & Related papers (2024-03-26T14:42:46Z) - Interpretable estimation of the risk of heart failure hospitalization
from a 30-second electrocardiogram [2.167398752829277]
This study shows it is possible to estimate hospitalization for congestive heart failure by a 30 seconds single-lead electrocardiogram signal.
Using a machine learning approach not only results in greater predictive power but also provides clinically meaningful interpretations.
arXiv Detail & Related papers (2022-11-02T01:53:07Z) - BIO-CXRNET: A Robust Multimodal Stacking Machine Learning Technique for
Mortality Risk Prediction of COVID-19 Patients using Chest X-Ray Images and
Clinical Data [0.0]
This study uses 25 biomarkers and CXR images in predicting the risk in 930 COVID-19 patients admitted in Italy.
The proposed multimodal stacking technique produced the precision, sensitivity, and F1-score, of 89.03%, 90.44%, and 89.03%, respectively.
The nomogram-based scoring technique was able to predict the death probability of high-risk patients with an F1 score of 92.88 %.
arXiv Detail & Related papers (2022-06-15T15:23:43Z) - Prediction of the onset of cardiovascular diseases from electronic
health records using multi-task gated recurrent units [51.14334174570822]
We propose a multi-task recurrent neural network with attention mechanism for predicting cardiovascular events from electronic health records.
The proposed approach is compared to a standard clinical risk predictor (QRISK) and machine learning alternatives using 5-year data from a NHS Foundation Trust.
arXiv Detail & Related papers (2020-07-16T17:43:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.