SafeRx-Agent: A Knowledge-Grounded Multi-Agent Framework for Safe and Explainable Medication Recommendation

• URL: http://arxiv.org/abs/2605.29146v2
• Date: Fri, 29 May 2026 00:45:07 GMT
• Title: SafeRx-Agent: A Knowledge-Grounded Multi-Agent Framework for Safe and Explainable Medication Recommendation
• Abstract summary: We propose SafeRx-Agent, a knowledge-grounded multi-agent framework that uses patient context, external clinical knowledge, and safety verification to recommend traceable medication sets.<n> Experimental results on MIMIC-III and MIMIC-IV datasets show that SafeRx-Agent improves fine-grained medication prediction accuracy while controlling drug interactions, contraindications, and medication set size.
• Score: 12.70587762578296
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Medication recommendation predicts medications for patient visits, but existing methods still face two key challenges. At the model level, traditional drug recommendation methods only predict structured drug codes with limited evidence grounding, while LLM agents can use richer clinical context but may lack safety verification and traceability. At the task level, existing benchmarks often use broad medication categories, which ignore subgroup-level safety differences and can lead to risk overestimation. We introduce the first fine-grained medication recommendation setting based on fourth-level ATC code generation. We propose Safe Prescription Agent (SafeRx-Agent), a knowledge-grounded multi-agent framework that uses patient context, external clinical knowledge, and safety verification to recommend traceable medication sets. Experimental results on MIMIC-III and MIMIC-IV datasets show that SafeRx-Agent improves fine-grained medication prediction accuracy while controlling drug interactions, contraindications, and medication set size.

Related papers

• DrugReason: Dynamic Multi-View Reasoning over Knowledge Graph and Language Evidence for Drug Repurposing [55.45112712244231]
  DrugReason is a multi-view reasoning framework that integrates grounded KG reasoning with LLM-generated mechanistic inference for drug repurposing.<n> Experiments on PharmaDB, DDInter, and DrugBank show that DrugReason improves average performance over strong single-view reasoning baselines.
  arXiv  Detail & Related papers  (2026-09-06T18:54:26Z)
• Coupled Graph--Policy Distillation for Personalized Medication Safety in Older Adults with Multimorbidity [18.025324480690752]
  ATLAS is a coupled graph--policy distillation framework for patient-adaptive medication safety.<n>GeriMedBench is an interactive benchmark that tests safety-critical information acquisition and evidence-based decision revision.
  arXiv  Detail & Related papers  (2026-08-10T11:19:44Z)
• GRAIN: Molecules Are Not the Right Granularity -- Active-Ingredient Modeling for Safe Medication Recommendation [2.26215287738502]
  Medication recommendation from electronic health records must balance predictive accuracy against the risk of adverse drug-drug interactions (DDIs) under polypharmacy.<n>We argue that the active ingredient is the missing granularity, and introduce GRAIN, a medication recommendation framework built around it.<n>GRAIN encodes longitudinal patient trajectories (diagnoses, procedures, past medications) with a selective state space backbone that handles long, irregular visit sequences in linear time.
  arXiv  Detail & Related papers  (2026-07-30T18:13:30Z)
• Improving Rare Medication Recommendation with Counterfactual Data Augmentation and Large Language Models [36.25693349096678]
  GenRxR is a novel framework based on large language models (LLMs)<n>It generates counterfactual medical data, mitigating the data scarcity issue for rare-meds.<n>It achieves up to 30.9% higher predictive performance for rare-meds than the strongest baseline.
  arXiv  Detail & Related papers  (2026-07-23T02:48:23Z)
• RxSafeBench: Identifying Medication Safety Issues of Large Language Models in Simulated Consultation [19.41567007880886]
  Large Language Models (LLMs) have achieved remarkable progress in diverse healthcare tasks.<n>However, research on their medication safety remains limited due to the lack of real world datasets.<n>We propose a framework that simulates and evaluates clinical consultations to systematically assess the medication safety capabilities of LLMs.
  arXiv  Detail & Related papers  (2025-11-06T12:56:34Z)
• Lessons Learned from Evaluation of LLM based Multi-agents in Safer Therapy Recommendation [9.84660526673816]
  This study investigated the feasibility and value of using a Large Language Model (LLM)-based multi-agent system for safer therapy recommendations.<n>We designed a single agent and a MAS framework simulating multidisciplinary team (MDT) decision-making.<n>We compared MAS performance with single-agent approaches and real-world benchmarks.
  arXiv  Detail & Related papers  (2025-07-15T02:01:38Z)
• SAFER: A Calibrated Risk-Aware Multimodal Recommendation Model for Dynamic Treatment Regimes [18.881967326672456]
  We introduce SAFER, a risk-aware calibrated recommendation framework for dynamic treatment regimes (DTRs)<n> SAFER integrates structured EHR and clinical notes, enabling them to learn from each other and address label uncertainty.<n>Experiments demonstrate that SAFER outperforms state-of-the-art baselines across multiple recommendation metrics and counterfactual mortality rate.
  arXiv  Detail & Related papers  (2025-06-07T04:05:43Z)
• Fine-grained List-wise Alignment for Generative Medication Recommendation [30.397147691681607]
  We propose FLAME, a fine-grained list-wise alignment framework for large language models (LLMs)<n> FLAME formulates recommendation as a sequential decision process, where each step adds or removes a single drug.<n> Experiments on benchmark datasets demonstrate that FLAME achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-05-26T16:59:23Z)
• Natural Language-Assisted Multi-modal Medication Recommendation [97.07805345563348]
  We introduce the Natural Language-Assisted Multi-modal Medication Recommendation(NLA-MMR)<n>The NLA-MMR is a multi-modal alignment framework designed to learn knowledge from the patient view and medication view jointly.<n>In this vein, we employ pretrained language models(PLMs) to extract in-domain knowledge regarding patients and medications.
  arXiv  Detail & Related papers  (2025-01-13T09:51:50Z)
• HELIOT: LLM-Based CDSS for Adverse Drug Reaction Management [3.2627279988912194]
  Heliot is an innovative Clinical Decision Support System (CDSS) for adverse drug reaction management.<n>It processes free-text clinical information using Large Language Models (LLMs) integrated with a comprehensive pharmaceutical data repository.<n>Heliot learns from past patient-specific medication tolerances to reduce false alerts, enabling more nuanced and contextual adverse drug event warnings.
  arXiv  Detail & Related papers  (2024-09-24T18:55:10Z)
• Leave No Patient Behind: Enhancing Medication Recommendation for Rare Disease Patients [47.68396964741116]
  We propose a novel model called Robust and Accurate REcommendations for Medication (RAREMed) to enhance accuracy for rare diseases. It employs a transformer encoder with a unified input sequence approach to capture complex relationships among disease and procedure codes. It provides accurate drug sets for both rare and common disease patients, thereby mitigating unfairness in medication recommendation systems.
  arXiv  Detail & Related papers  (2024-03-26T14:36:22Z)
• Knowledge-Driven New Drug Recommendation [88.35607943144261]
  We develop a drug-dependent multi-phenotype few-shot learner to bridge the gap between existing and new drugs. EDGE eliminates the false-negative supervision signal using an external drug-disease knowledge base. Results show that EDGE achieves 7.3% improvement on the ROC-AUC score over the best baseline.
  arXiv  Detail & Related papers  (2022-10-11T16:07:52Z)
• SafeDrug: Dual Molecular Graph Encoders for Safe Drug Recommendations [59.590084937600764]
  We propose a DDI-controllable drug recommendation model named SafeDrug to leverage drugs' molecule structures and model DDIs explicitly. On a benchmark dataset, our SafeDrug is relatively shown to reduce DDI by 19.43% and improves 2.88% on Jaccard similarity between recommended and actually prescribed drug combinations over previous approaches.
  arXiv  Detail & Related papers  (2021-05-05T00:20:48Z)
• SDF-Bayes: Cautious Optimism in Safe Dose-Finding Clinical Trials with Drug Combinations and Heterogeneous Patient Groups [84.63561578944183]
  This paper proposes a novel Bayesian design, SDF-Bayes, for finding the maximum tolerated dose (MTD) of a drug in a clinical trial. Rather than the conventional principle of escalating or de-escalating the current dose of one drug, SDF-Bayes proceeds by cautious optimism. Extensive experiments based on both synthetic and real-world datasets demonstrate the advantages of SDF-Bayes over state of the art DC trial designs.
  arXiv  Detail & Related papers  (2021-01-26T18:59:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.