LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models

• URL: http://arxiv.org/abs/2607.15447v1
• Date: Thu, 16 Jul 2026 20:40:04 GMT
• Title: LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models
• Abstract summary: Recent research in clinical machine learning has shifted from bespoke supervised models to foundation models.<n>Here, foundation models are pre-trained on mixtures of complex clinical data modalities, useful for various downstream tasks.
• Score: 36.391923477672776
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent research in clinical machine learning, focusing on outcome predictions in intensive care unit (ICU), has shifted from bespoke supervised models to foundation models, utilising modern representation learning methods. Here, foundation models are pre-trained on mixtures of complex clinical data modalities, useful for various downstream tasks. Existing works often utilise Electronic Health Records (EHR) to provide rich and diverse patient observations to train clinical foundation models. However, existing methods do not sufficiently explore the shared temporal structures between clinical events and time series (TS) observations recorded in EHRs. This limitation potentially leads to less robust and adaptive clinical foundation models, resulting in reduced performance on downstream tasks. To fully exploit this temporal structure, we propose LLM4EHR, a new clinical foundation model trained on ICU EHR data. Combining domain adapted large language models with a transformer TS encoder, we pre-trained LLM4EHR by temporally aligning the EHR events and TS. For this, we propose a regularised contrastive objective to learn robust EHR TS representations conditioned on EHR event embeddings produced by the domain adapted LLM. Supported by an ablation study, we find that learnt EHR TS embeddings from LLM4EHR improve performance on various downstream clinical tasks with competitive performance. Further, we empirically demonstrate that LLM4EHR learns transferable clinical TS embeddings that can be deployed to new cohorts via k-shot adaptation. These findings provide a step towards building more generalisable and performant clinical foundation models.

Related papers

• Reinforcement Learning over Patient Trajectories for Clinical Reasoning in EHR Foundation Models [38.37812950780674]
  We propose a reinforcement learning framework that treats EHR foundation models as generative policies over patient trajectories.<n>We formulate common clinical prediction problems as event-conditioned, time-windowed reasoning tasks.<n>We then design time-aware, rollout-sensitive rewards to account for finite rollout lengths and temporally inconclusive outcomes.
  arXiv  Detail & Related papers  (2026-09-10T23:10:38Z)
• Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts [3.299672391663527]
  We propose a Cohort-Anchored Foundation Model framework to elevate patient cohorts to a first-class object throughout the learning pipeline.<n>The framework consists of four stages: deviation-aware data curation, cohort-conditioned pretraining, multimodal cohort alignment, and clinician-in-the-loop refinement.<n>We illustrate CAFM through four clinical case studies spanning acute kidney injury prediction, cardiovascular risk stratification from electrocardiograms, optic neuropathy triage from orbital imaging, and electroretinogram-grounded report generation.
  arXiv  Detail & Related papers  (2026-06-20T05:14:43Z)
• EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Records [0.9989630065856642]
  EHR contain rich longitudinal patient information and are widely used in predictive modeling applications.<n>We introduce EHR-RAGp, a retrieval-augmented foundation model that dynamically integrates the most relevant patient history across diverse clinical event types.
  arXiv  Detail & Related papers  (2026-05-12T16:17:03Z)
• CLEF: EEG Foundation Model for Learning Clinical Semantics [50.3767252824646]
  We introduce CLEF, a clinically grounded long-context EEG foundation model.<n>We evaluate CLEF on a new 234-task benchmark spanning disease phenotypes, medication exposures, and EEG findings.
  arXiv  Detail & Related papers  (2026-05-11T16:34:58Z)
• Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging [10.955738714664276]
  Large language models have been adopted in the medical domain for clinical documentation to reduce clinician burden.<n>Studies have reported that LLMs often "forget" a significant amount of instruction-following ability when fine-tuned using a task-specific medical dataset.<n>This study presents a model merging framework to efficiently adapt general-purpose LLMs to the medical domain.
  arXiv  Detail & Related papers  (2026-04-02T02:18:49Z)
• Can we generate portable representations for clinical time series data using LLMs? [14.97461269508036]
  We study the question of can large language models (LLMs) create portable patient embeddings i.e. representations of patients.<n>We find that our approach is simple, easy to use and competitive with in-distribution with grid imputation.<n>We find that using these portable representations improves few-shot learning and does not increase demographic recoverability of age or sex relative to baselines.
  arXiv  Detail & Related papers  (2026-03-25T06:34:32Z)
• A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine [59.78991974851707]
  Large language models (LLMs) have demonstrated strong performance on medical benchmarks, including question answering and diagnosis.<n>Most medical LLMs are trained on data from a single institution, which faces limitations in generalizability and safety in heterogeneous systems.<n>We introduce the model-agnostic and parameter-efficient federated learning framework for adapting LLMs to medical applications.
  arXiv  Detail & Related papers  (2026-01-29T18:48:21Z)
• Integrating Genomics into Multimodal EHR Foundation Models [56.31910745104141]
  This paper introduces an innovative EHR foundation model that integrates Polygenic Risk Scores (PRS) as a foundational data modality.<n>The framework aims to learn complex relationships between clinical data and genetic predispositions.<n>This approach is pivotal for unlocking new insights into disease prediction, proactive health management, risk stratification, and personalized treatment strategies.
  arXiv  Detail & Related papers  (2025-10-24T15:56:40Z)
• Large Language Models are Powerful Electronic Health Record Encoders [2.310631440585048]
  General-purpose Large Language Models are used to encode EHR into representations for downstream clinical prediction tasks.<n>We show that our approach requires no institution-specific training and can incorporate any medical code with a text description.<n>An LLM-based model achieves superior performance for prediction of disease onset, hospitalization, and mortality, indicating robustness to population and coding shifts.
  arXiv  Detail & Related papers  (2025-02-24T18:30:36Z)
• Time Associated Meta Learning for Clinical Prediction [78.99422473394029]
  We propose a novel time associated meta learning (TAML) method to make effective predictions at multiple future time points. To address the sparsity problem after task splitting, TAML employs a temporal information sharing strategy to augment the number of positive samples. We demonstrate the effectiveness of TAML on multiple clinical datasets, where it consistently outperforms a range of strong baselines.
  arXiv  Detail & Related papers  (2023-03-05T03:54:54Z)
• Competence-based Multimodal Curriculum Learning for Medical Report Generation [98.10763792453925]
  We propose a Competence-based Multimodal Curriculum Learning framework ( CMCL) to alleviate the data bias and make best use of available data. Specifically, CMCL simulates the learning process of radiologists and optimize the model in a step by step manner. Experiments on the public IU-Xray and MIMIC-CXR datasets show that CMCL can be incorporated into existing models to improve their performance.
  arXiv  Detail & Related papers  (2022-06-24T08:16:01Z)
• SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models [48.07469930813923]
  This work aims to forecast the demand for healthcare services, by predicting the number of patient visits to healthcare facilities. We introduce SANSformer, an attention-free sequential model designed with specific inductive biases to cater for the unique characteristics of EHR data. Our results illuminate the promising potential of tailored attention-free models and self-supervised pretraining in refining healthcare utilization predictions across various patient demographics.
  arXiv  Detail & Related papers  (2021-08-31T08:23:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.