Modeling Patient Care Trajectories with Transformer Hawkes Processes

• URL: http://arxiv.org/abs/2604.05844v1
• Date: Tue, 07 Apr 2026 13:10:49 GMT
• Title: Modeling Patient Care Trajectories with Transformer Hawkes Processes
• Abstract summary: We build on the Transformer Hawkes Process framework to model patient trajectories in continuous time.<n>We introduce an imbalance-aware training strategy using inverse square-root class weighting.
• Score: 8.0206789155224
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Patient healthcare utilization consists of irregularly time-stamped events, such as outpatient visits, inpatient admissions, and emergency encounters, forming individualized care trajectories. Modeling these trajectories is crucial for understanding utilization patterns and predicting future care needs, but is challenging due to temporal irregularity and severe class imbalance. In this work, we build on the Transformer Hawkes Process framework to model patient trajectories in continuous time. By combining Transformer-based history encoding with Hawkes process dynamics, the model captures event dependencies and jointly predicts event type and time-to-event. To address extreme imbalance, we introduce an imbalance-aware training strategy using inverse square-root class weighting. This improves sensitivity to rare but clinically important events without altering the data distribution. Experiments on real-world data demonstrate improved performance and provide clinically meaningful insights for identifying high-risk patient populations.

Related papers

• NOAH: Learning the Full Patient Journey. A Longitudinal Multimodal Time-Aware Model for Representation and Forecasting [15.183085955033148]
  We introduce NOAH, a time-aware, task-agnostic, generative transformer model representing and forecasting the full patient journey.<n>NOAH processes medical images, time-series and numeric signals, categorical events, as well as structured and unstructured clinical records.<n>It generates highly informative and predictive patient state representations that demonstrate strong performance in probing for clinical outcomes.
  arXiv  Detail & Related papers  (2026-09-08T17:56:13Z)
• Time-to-Event Transformer to Capture Timing Attention of Events in EHR Time Series [15.049813932448112]
  LITT is a novel Timing-Transformer architecture that enables temporary alignment of sequential events on a virtual relative timeline''<n>Its interpretability and effectiveness are validated on real-world longitudinal EHR data from 3,276 breast cancer patients.
  arXiv  Detail & Related papers  (2026-02-11T00:13:08Z)
• SeqRisk: Transformer-augmented latent variable model for improved survival prediction with longitudinal data [4.1476925904032464]
  We propose SeqRisk, a method that combines variational autoencoder (VAE) or longitudinal VAE (LVAE) with a transformer encoder and Cox proportional hazards module for risk prediction. We demonstrate that SeqRisk performs competitively compared to existing approaches on both simulated and real-world datasets.
  arXiv  Detail & Related papers  (2024-09-19T12:35:25Z)
• Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
  We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events. Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
  arXiv  Detail & Related papers  (2024-07-28T02:42:36Z)
• Enhancing Uncertain Demand Prediction in Hospitals Using Simple and Advanced Machine Learning [3.9054437595657534]
  Using patient care demand data from Rambam Medical Center in Israel, our results show that both proposed models effectively capture hourly variations of patient demand. It is possible to predict patient care demand with good accuracy (around 4 patients) three days or a week in advance using machine learning.
  arXiv  Detail & Related papers  (2024-04-29T13:05:59Z)
• SurvTimeSurvival: Survival Analysis On The Patient With Multiple Visits/Records [26.66492761632773]
  The accurate prediction of survival times for patients with severe diseases remains a critical challenge despite recent advances in artificial intelligence. This study introduces "SurvTimeSurvival: Survival Analysis On Patients With Multiple Visits/Records"
  arXiv  Detail & Related papers  (2023-11-16T12:30:14Z)
• SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models [48.07469930813923]
  This work aims to forecast the demand for healthcare services, by predicting the number of patient visits to healthcare facilities. We introduce SANSformer, an attention-free sequential model designed with specific inductive biases to cater for the unique characteristics of EHR data. Our results illuminate the promising potential of tailored attention-free models and self-supervised pretraining in refining healthcare utilization predictions across various patient demographics.
  arXiv  Detail & Related papers  (2021-08-31T08:23:56Z)
• DeepRite: Deep Recurrent Inverse TreatmEnt Weighting for Adjusting Time-varying Confounding in Modern Longitudinal Observational Data [68.29870617697532]
  We propose Deep Recurrent Inverse TreatmEnt weighting (DeepRite) for time-varying confounding in longitudinal data. DeepRite is shown to recover the ground truth from synthetic data, and estimate unbiased treatment effects from real data.
  arXiv  Detail & Related papers  (2020-10-28T15:05:08Z)
• Temporal Phenotyping using Deep Predictive Clustering of Disease Progression [97.88605060346455]
  We develop a deep learning approach for clustering time-series data, where each cluster comprises patients who share similar future outcomes of interest. Experiments on two real-world datasets show that our model achieves superior clustering performance over state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2020-06-15T20:48:43Z)
• Adaptive Prediction Timing for Electronic Health Records [3.308743964406688]
  We introduce a novel, more realistic, approach to generating patient outcome predictions at an adaptive rate. We use a Recurrent Neural Network (RNN) and a Bayesian embedding layer with a new aggregation method to demonstrate adaptive prediction timing. At 48 hours after patient admission, our model achieves equal performance compared to its static-windowed counterparts.
  arXiv  Detail & Related papers  (2020-03-05T12:02:44Z)
• Transformer Hawkes Process [79.16290557505211]
  We propose a Transformer Hawkes Process (THP) model, which leverages the self-attention mechanism to capture long-term dependencies. THP outperforms existing models in terms of both likelihood and event prediction accuracy by a notable margin. We provide a concrete example, where THP achieves improved prediction performance for learning multiple point processes when incorporating their relational information.
  arXiv  Detail & Related papers  (2020-02-21T13:48:13Z)
• Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representations [114.16762407465427]
  We introduce the Counterfactual Recurrent Network (CRN) to estimate treatment effects over time. CRN uses domain adversarial training to build balancing representations of the patient history. We show how our model achieves lower error in estimating counterfactuals and in choosing the correct treatment and timing of treatment.
  arXiv  Detail & Related papers  (2020-02-10T20:47:36Z)
• Learning Dynamic and Personalized Comorbidity Networks from Event Data using Deep Diffusion Processes [102.02672176520382]
  Comorbid diseases co-occur and progress via complex temporal patterns that vary among individuals. In electronic health records we can observe the different diseases a patient has, but can only infer the temporal relationship between each co-morbid condition. We develop deep diffusion processes to model "dynamic comorbidity networks"
  arXiv  Detail & Related papers  (2020-01-08T15:47:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.