Improving Rare Medication Recommendation with Counterfactual Data Augmentation and Large Language Models

• URL: http://arxiv.org/abs/2607.24829v1
• Date: Thu, 23 Jul 2026 02:48:23 GMT
• Title: Improving Rare Medication Recommendation with Counterfactual Data Augmentation and Large Language Models
• Abstract summary: GenRxR is a novel framework based on large language models (LLMs)<n>It generates counterfactual medical data, mitigating the data scarcity issue for rare-meds.<n>It achieves up to 30.9% higher predictive performance for rare-meds than the strongest baseline.
• Score: 36.25693349096678
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: AI-based medication recommendation systems have attracted substantial attention due to their potential to enhance patient safety and therapeutic outcomes. Despite the clinical importance of accurately recommending rarely prescribed medications (rare-meds), we observe that most existing methods show significantly lower predictive performance for rare-meds. We attribute this issue to two intrinsic limitations: (a) the inherent scarcity of data for rare-meds and (b) limited consideration of co-recommended medications. To address these limitations, we propose GenRxR, a novel framework based on large language models (LLMs). GenRxR leverages the medical knowledge and clinical reasoning capability of LLMs to generate counterfactual medical data, mitigating the data scarcity issue for rare-meds. It also integrates an LLM into the medication recommendation process to model relationships among co-recommended medications. To further enhance the clinical reasoning, we introduce an instruction tuning step that aligns the LLM's capability with the recommendation task, enabling better handling of clinical context, including rare-meds cases. In our experiments, we show that GenRxR outperforms 14 (including 5 LLM-based) baselines in most cases. Specifically, it achieves up to 30.9% higher predictive performance for rare-meds than the strongest baseline.

Related papers

• Eliciting Medical Reasoning with Knowledge-enhanced Data Synthesis: A Semi-Supervised Reinforcement Learning Approach [62.0906177191353]
  Existing approaches distill chain-of-thought reasoning traces from large proprietary models via supervised fine-tuning, then conduct reinforcement learning (RL)<n>We propose MedSSR, a Medical Knowledge-enhanced data Synthesis and Semi-supervised Reinforcement learning framework.<n>Our framework first employs rare disease knowledge to synthesize distribution-controllable reasoning questions.<n>We then utilize the policy model itself to generate high-quality pseudo-labels. This enables a two-stage, intrinsic-to-extrinsic training paradigm: self-supervised RL on the pseudo-labeled data, followed by supervised RL on the human-annotated real data
  arXiv  Detail & Related papers  (2026-04-13T14:37:38Z)
• A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine [59.78991974851707]
  Large language models (LLMs) have demonstrated strong performance on medical benchmarks, including question answering and diagnosis.<n>Most medical LLMs are trained on data from a single institution, which faces limitations in generalizability and safety in heterogeneous systems.<n>We introduce the model-agnostic and parameter-efficient federated learning framework for adapting LLMs to medical applications.
  arXiv  Detail & Related papers  (2026-01-29T18:48:21Z)
• CDrugRed: A Chinese Drug Recommendation Dataset for Discharge Medications in Metabolic Diseases [49.09102662968899]
  We present CDrugRed, a first publicly available Chinese drug recommendation dataset focused on discharge medications for metabolic diseases.<n>The dataset includes 5,894 de-identified records from 3,190 patients, containing comprehensive information such as patient demographics, medical history, clinical course, and discharge diagnoses.<n>We assess the utility of CDrugRed by benchmarking several state-of-the-art large language models (LLMs) on the discharge medication recommendation task.
  arXiv  Detail & Related papers  (2025-10-24T01:47:23Z)
• Retrieval Augmented Large Language Model System for Comprehensive Drug Contraindications [0.0]
  The versatility of large language models (LLMs) has been explored across various sectors, but their application in healthcare poses challenges.<n>This study enhances the capability of LLMs to address contraindications effectively by implementing a Retrieval Augmented Generation (RAG) pipeline.
  arXiv  Detail & Related papers  (2025-08-08T09:09:03Z)
• Lessons Learned from Evaluation of LLM based Multi-agents in Safer Therapy Recommendation [9.84660526673816]
  This study investigated the feasibility and value of using a Large Language Model (LLM)-based multi-agent system for safer therapy recommendations.<n>We designed a single agent and a MAS framework simulating multidisciplinary team (MDT) decision-making.<n>We compared MAS performance with single-agent approaches and real-world benchmarks.
  arXiv  Detail & Related papers  (2025-07-15T02:01:38Z)
• Combating the Bucket Effect:Multi-Knowledge Alignment for Medication Recommendation [7.962835256943926]
  We introduce a cross-modal medication encoder capable of seamlessly aligning data from different modalities.<n>We then combine the multi-knowledge medication representations with patient records for recommendations.<n>Experiments show that MKMed mitigates the "bucket effect" in data, and significantly outperforms state-of-the-art baselines in recommendation accuracy and safety.
  arXiv  Detail & Related papers  (2025-04-25T05:47:15Z)
• Fine-grained Alignment of Large Language Models for General Medication Recommendation without Overprescription [45.41664696802343]
  Large language models (LLMs) hold significant promise in achieving general medication recommendation systems.<n>We introduce Language-Assisted Medication Recommendation, which tailors LLMs for medication recommendation in a medication-aware manner.<n>Fine-tuning LLMs with this framework can outperform existing methods by more than 10% in internal validation and generalize across temporal and external validations.
  arXiv  Detail & Related papers  (2025-03-05T17:28:16Z)
• Leave No Patient Behind: Enhancing Medication Recommendation for Rare Disease Patients [47.68396964741116]
  We propose a novel model called Robust and Accurate REcommendations for Medication (RAREMed) to enhance accuracy for rare diseases. It employs a transformer encoder with a unified input sequence approach to capture complex relationships among disease and procedure codes. It provides accurate drug sets for both rare and common disease patients, thereby mitigating unfairness in medication recommendation systems.
  arXiv  Detail & Related papers  (2024-03-26T14:36:22Z)
• REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models [19.62552013839689]
  Existing models often lack the medical context relevent to clinical tasks, prompting the incorporation of external knowledge. We propose REALM, a Retrieval-Augmented Generation (RAG) driven framework to enhance multimodal EHR representations. Our experiments on MIMIC-III mortality and readmission tasks showcase the superior performance of our REALM framework over baselines.
  arXiv  Detail & Related papers  (2024-02-10T18:27:28Z)
• Large Language Model Distilling Medication Recommendation Model [58.94186280631342]
  We harness the powerful semantic comprehension and input-agnostic characteristics of Large Language Models (LLMs)<n>Our research aims to transform existing medication recommendation methodologies using LLMs.<n>To mitigate this, we have developed a feature-level knowledge distillation technique, which transfers the LLM's proficiency to a more compact model.
  arXiv  Detail & Related papers  (2024-02-05T08:25:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.