Transformer Model for Alzheimer's Disease Progression Prediction Using Longitudinal Visit Sequences
- URL: http://arxiv.org/abs/2507.03899v1
- Date: Sat, 05 Jul 2025 04:35:04 GMT
- Title: Transformer Model for Alzheimer's Disease Progression Prediction Using Longitudinal Visit Sequences
- Authors: Mahdi Moghaddami, Clayton Schubring, Mohammad-Reza Siadat,
- Abstract summary: Alzheimer's disease (AD) is a neurodegenerative disorder with no known cure that affects tens of millions of people worldwide.<n>We propose a Transformer model for predicting the stage of AD progression at a subject's next clinical visit using features from a sequence of visits extracted from the subject's visit history.
- Score: 0.032771631221674334
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Alzheimer's disease (AD) is a neurodegenerative disorder with no known cure that affects tens of millions of people worldwide. Early detection of AD is critical for timely intervention to halt or slow the progression of the disease. In this study, we propose a Transformer model for predicting the stage of AD progression at a subject's next clinical visit using features from a sequence of visits extracted from the subject's visit history. We also rigorously compare our model to recurrent neural networks (RNNs) such as long short-term memory (LSTM), gated recurrent unit (GRU), and minimalRNN and assess their performances based on factors such as the length of prior visits and data imbalance. We test the importance of different feature categories and visit history, as well as compare the model to a newer Transformer-based model optimized for time series. Our model demonstrates strong predictive performance despite missing visits and missing features in available visits, particularly in identifying converter subjects -- individuals transitioning to more severe disease stages -- an area that has posed significant challenges in longitudinal prediction. The results highlight the model's potential in enhancing early diagnosis and patient outcomes.
Related papers
- Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events.
Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
arXiv Detail & Related papers (2024-07-28T02:42:36Z) - Assessing the significance of longitudinal data in Alzheimer's Disease forecasting [7.72135261611709]
We employ a transformer encoder model to characterize the significance of longitudinal patient data for forecasting the progression of Alzheimer's Disease (AD)
Our model, Longitudinal Forecasting Model for Alzheimer's Disease (LongForMAD), harnesses the comprehensive temporal information embedded in sequences of patient visits.
Our results support the incorporation of longitudinal data in clinical settings to enhance the early detection and monitoring of AD.
arXiv Detail & Related papers (2024-05-27T16:55:48Z) - Conditional Score-Based Diffusion Model for Cortical Thickness
Trajectory Prediction [29.415616701032604]
Alzheimer's Disease (AD) is a neurodegenerative condition characterized by diverse progression rates among individuals.
We propose a conditional score-based diffusion model to generate CTh trajectories with the given baseline information.
Our model has a near-zero bias with narrow confidential 95% interval compared to the ground-truth CTh in 6-36 months.
arXiv Detail & Related papers (2024-03-11T17:26:18Z) - Automatic diagnosis of knee osteoarthritis severity using Swin
transformer [55.01037422579516]
Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint.
We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
arXiv Detail & Related papers (2023-07-10T09:49:30Z) - Benchmarking Continuous Time Models for Predicting Multiple Sclerosis
Progression [46.394865849252696]
Multiple sclerosis is a disease that affects the brain and spinal cord, it can lead to severe disability and has no known cure.
In a recent paper it was shown that disease progression can be predicted effectively using performance outcome measures and demographic data.
We benchmark four continuous time models using a publicly available multiple sclerosis dataset.
We find that the best continuous model is often able to outperform the best benchmarked discrete time model.
arXiv Detail & Related papers (2023-02-15T18:45:32Z) - SurvLatent ODE : A Neural ODE based time-to-event model with competing
risks for longitudinal data improves cancer-associated Deep Vein Thrombosis
(DVT) prediction [68.8204255655161]
We propose a generative time-to-event model, SurvLatent ODE, which parameterizes a latent representation under irregularly sampled data.
Our model then utilizes the latent representation to flexibly estimate survival times for multiple competing events without specifying shapes of event-specific hazard function.
SurvLatent ODE outperforms the current clinical standard Khorana Risk scores for stratifying DVT risk groups.
arXiv Detail & Related papers (2022-04-20T17:28:08Z) - Toward a multimodal multitask model for neurodegenerative diseases
diagnosis and progression prediction [0.5735035463793008]
This article overviews various categories of models used for Alzheimer's disease prediction with their respective learning methods.
It establishes a comparative study of early prediction and detection Alzheimer's disease progression.
Finally, a robust and precise detection model is proposed.
arXiv Detail & Related papers (2021-10-10T11:44:16Z) - SANSformers: Self-Supervised Forecasting in Electronic Health Records
with Attention-Free Models [48.07469930813923]
This work aims to forecast the demand for healthcare services, by predicting the number of patient visits to healthcare facilities.
We introduce SANSformer, an attention-free sequential model designed with specific inductive biases to cater for the unique characteristics of EHR data.
Our results illuminate the promising potential of tailored attention-free models and self-supervised pretraining in refining healthcare utilization predictions across various patient demographics.
arXiv Detail & Related papers (2021-08-31T08:23:56Z) - Approximate Bayesian Computation for an Explicit-Duration Hidden Markov
Model of COVID-19 Hospital Trajectories [55.786207368853084]
We address the problem of modeling constrained hospital resources in the midst of the COVID-19 pandemic.
For broad applicability, we focus on the common yet challenging scenario where patient-level data for a region of interest are not available.
We propose an aggregate count explicit-duration hidden Markov model, nicknamed the ACED-HMM, with an interpretable, compact parameterization.
arXiv Detail & Related papers (2021-04-28T15:32:42Z) - STELAR: Spatio-temporal Tensor Factorization with Latent Epidemiological
Regularization [76.57716281104938]
We develop a tensor method to predict the evolution of epidemic trends for many regions simultaneously.
STELAR enables long-term prediction by incorporating latent temporal regularization through a system of discrete-time difference equations.
We conduct experiments using both county- and state-level COVID-19 data and show that our model can identify interesting latent patterns of the epidemic.
arXiv Detail & Related papers (2020-12-08T21:21:47Z) - Learning transition times in event sequences: the Event-Based Hidden
Markov Model of disease progression [4.12857285066818]
We connect ideas from event-based and hidden Markov modelling to derive a new generative model of disease progression.
Our model can infer the most likely group-level sequence and timing of events from limited datasets.
We use clinical, imaging and biofluid data from the Alzheimer's Disease Neuroimaging Initiative to demonstrate the validity and utility of our model.
arXiv Detail & Related papers (2020-11-02T15:13:03Z) - Deep Recurrent Model for Individualized Prediction of Alzheimer's
Disease Progression [4.034948808542701]
Alzheimer's disease (AD) is one of the major causes of dementia and is characterized by slow progression over several years.
We propose a novel computational framework that can predict the phenotypic measurements of MRI biomarkers and trajectories of clinical status.
arXiv Detail & Related papers (2020-05-06T08:08:00Z) - Short Term Blood Glucose Prediction based on Continuous Glucose
Monitoring Data [53.01543207478818]
This study explores the use of Continuous Glucose Monitoring (CGM) data as input for digital decision support tools.
We investigate how Recurrent Neural Networks (RNNs) can be used for Short Term Blood Glucose (STBG) prediction.
arXiv Detail & Related papers (2020-02-06T16:39:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.