EHR-RAG: Bridging Long-Horizon Structured Electronic Health Records and Large Language Models via Enhanced Retrieval-Augmented Generation
- URL: http://arxiv.org/abs/2601.21340v1
- Date: Thu, 29 Jan 2026 07:06:34 GMT
- Title: EHR-RAG: Bridging Long-Horizon Structured Electronic Health Records and Large Language Models via Enhanced Retrieval-Augmented Generation
- Abstract summary: EHR-RAG is a retrieval-augmented framework designed for accurate interpretation of long-horizon structured EHR data.<n>Experiments across four long-horizon EHR prediction tasks show that EHR-RAG consistently outperforms the strongest LLM-based baselines.
- Score: 8.087606137290217
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Electronic Health Records (EHRs) provide rich longitudinal clinical evidence that is central to medical decision-making, motivating the use of retrieval-augmented generation (RAG) to ground large language model (LLM) predictions. However, long-horizon EHRs often exceed LLM context limits, and existing approaches commonly rely on truncation or vanilla retrieval strategies that discard clinically relevant events and temporal dependencies. To address these challenges, we propose EHR-RAG, a retrieval-augmented framework designed for accurate interpretation of long-horizon structured EHR data. EHR-RAG introduces three components tailored to longitudinal clinical prediction tasks: Event- and Time-Aware Hybrid EHR Retrieval to preserve clinical structure and temporal dynamics, Adaptive Iterative Retrieval to progressively refine queries in order to expand broad evidence coverage, and Dual-Path Evidence Retrieval and Reasoning to jointly retrieves and reasons over both factual and counterfactual evidence. Experiments across four long-horizon EHR prediction tasks show that EHR-RAG consistently outperforms the strongest LLM-based baselines, achieving an average Macro-F1 improvement of 10.76%. Overall, our work highlights the potential of retrieval-augmented LLMs to advance clinical prediction on structured EHR data in practice.
Related papers
- EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Records [0.9989630065856642]
EHR contain rich longitudinal patient information and are widely used in predictive modeling applications.<n>We introduce EHR-RAGp, a retrieval-augmented foundation model that dynamically integrates the most relevant patient history across diverse clinical event types.
arXiv Detail & Related papers (2026-05-12T16:17:03Z) - ReMedi: Reasoner for Medical Clinical Prediction [70.84466325266068]
We present ReMedi, a framework for improving clinical outcome prediction from EHR.<n>ReMedi generates rationale-answer pairs using a challenging sample regeneration mechanism for complex clinical questions.<n> Experiments on multiple EHR prediction tasks demonstrate substantial gains of up to 19.9 percent over state-of-the-art baselines in terms of F1 score.
arXiv Detail & Related papers (2026-05-02T14:44:49Z) - EviCare: Enhancing Diagnosis Prediction with Deep Model-Guided Evidence for In-Context Reasoning [62.61394722212386]
EviCare is an in-context reasoning framework that integrates deep model guidance into large language models.<n>It consistently outperforms both LLM-only and deep model-only baselines in experiments on two real-world EHR benchmarks.
arXiv Detail & Related papers (2026-04-12T04:35:14Z) - EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysis [78.05962117947259]
We present EHR-Ins, a large-scale, comprehensive EHR reasoning instruction dataset.<n>We also develop EHR-R1, a series of reasoning-enhanced LLMs with up to 72B parameters tailored for EHR analysis.<n>Finally, we introduce EHR-Bench, a new benchmark curated from MIMIC-IV, spanning 42 tasks.
arXiv Detail & Related papers (2025-10-29T15:32:47Z) - Integrating Genomics into Multimodal EHR Foundation Models [56.31910745104141]
This paper introduces an innovative EHR foundation model that integrates Polygenic Risk Scores (PRS) as a foundational data modality.<n>The framework aims to learn complex relationships between clinical data and genetic predispositions.<n>This approach is pivotal for unlocking new insights into disease prediction, proactive health management, risk stratification, and personalized treatment strategies.
arXiv Detail & Related papers (2025-10-24T15:56:40Z) - R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth? [63.51955244144878]
R-HORIZON is a method designed to stimulate long-horizon reasoning behaviors in Large Reasoning Models (LRMs)<n>Based on R-HORIZON, we construct a long-horizon reasoning benchmark, comprising complex multi-step reasoning tasks with interdependent problems that span long reasoning horizons.<n>Our analysis reveals that LRMs exhibit limited effective reasoning length and struggle to allocate thinking budget across multiple problems appropriately.
arXiv Detail & Related papers (2025-10-09T13:16:22Z) - Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidance [9.106439376182513]
Large language models (LLMs) for electronic health record ( EHR) reasoning are essential for enabling accurate and generalizable clinical predictions.<n>We propose EAG-RL, a novel two-stage training framework designed to intrinsically enhance LLMs' EHR reasoning ability.<n>EAG-RL first constructs high-quality, stepwise reasoning trajectories using expert-guided Monte Carlo Tree Search.
arXiv Detail & Related papers (2025-08-19T07:24:48Z) - HiRef: Leveraging Hierarchical Ontology and Network Refinement for Robust Medication Recommendation [17.45722229030237]
We propose Hierarchical Ontology and Network Refinement for Robust Medication Recommendation (HiRef)<n>We embed entities in hyperbolic space, which naturally captures tree-like relationships and enables knowledge transfer through shared ancestors.<n>Our model achieves strong performance on EHR benchmarks (MIMIC-III and MIMIC-IV) and maintains high accuracy under simulated unseen-code settings.
arXiv Detail & Related papers (2025-08-14T07:55:03Z) - Retrieval-Augmented Perception: High-Resolution Image Perception Meets Visual RAG [79.61269381878547]
High-resolution (HR) image perception remains a key challenge in multimodal large language models (MLLMs)<n>This paper shifts away from prior dedicated approaches and revisits the most fundamental idea to HR perception by enhancing the long-context capability of MLLMs.<n>We propose Retrieval-Augmented Perception (RAP), a training-free framework that retrieves and fuses relevant image crops while preserving spatial context.
arXiv Detail & Related papers (2025-03-03T06:40:21Z) - Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction [27.00269079168807]
Large language models (LLMs) have shown potential in clinical text summarization.<n>Recent advances in large language models (LLMs) have shown potential in clinical text summarization.<n>This study systematically evaluates several state-of-the-art open-source LLMs.
arXiv Detail & Related papers (2025-01-30T19:58:45Z) - HC-LLM: Historical-Constrained Large Language Models for Radiology Report Generation [89.3260120072177]
We propose a novel Historical-Constrained Large Language Models (HC-LLM) framework for Radiology report generation.<n>Our approach extracts both time-shared and time-specific features from longitudinal chest X-rays and diagnostic reports to capture disease progression.<n> Notably, our approach performs well even without historical data during testing and can be easily adapted to other multimodal large models.
arXiv Detail & Related papers (2024-12-15T06:04:16Z) - Synthesizing Multimodal Electronic Health Records via Predictive Diffusion Models [69.06149482021071]
We propose a novel EHR data generation model called EHRPD.
It is a diffusion-based model designed to predict the next visit based on the current one while also incorporating time interval estimation.
We conduct experiments on two public datasets and evaluate EHRPD from fidelity, privacy, and utility perspectives.
arXiv Detail & Related papers (2024-06-20T02:20:23Z) - Prompting Large Language Models for Zero-Shot Clinical Prediction with
Structured Longitudinal Electronic Health Record Data [7.815738943706123]
Large Language Models (LLMs) are traditionally tailored for natural language processing.
This research investigates the adaptability of LLMs, like GPT-4, to EHR data.
In response to the longitudinal, sparse, and knowledge-infused nature of EHR data, our prompting approach involves taking into account specific characteristics.
arXiv Detail & Related papers (2024-01-25T20:14:50Z) - SANSformers: Self-Supervised Forecasting in Electronic Health Records
with Attention-Free Models [48.07469930813923]
This work aims to forecast the demand for healthcare services, by predicting the number of patient visits to healthcare facilities.
We introduce SANSformer, an attention-free sequential model designed with specific inductive biases to cater for the unique characteristics of EHR data.
Our results illuminate the promising potential of tailored attention-free models and self-supervised pretraining in refining healthcare utilization predictions across various patient demographics.
arXiv Detail & Related papers (2021-08-31T08:23:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.