KREL: Automatic Medical Coding via Knowledge-Guided Reasoning over Clinical Evidence with LLMs
- URL: http://arxiv.org/abs/2608.20887v1
- Date: Fri, 21 Aug 2026 09:05:15 GMT
- Title: KREL: Automatic Medical Coding via Knowledge-Guided Reasoning over Clinical Evidence with LLMs
- Abstract summary: Automatic Medical Coding (AMC) assigns standardized International Classification of Diseases (ICD) codes to clinical notes.<n>Key challenges remain, including the extreme length of clinical notes and the vast ICD label space.<n>We propose Knowledge-Guided Reasoning over Clinical Evidence with LLMs.
- Score: 32.666218878368575
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic Medical Coding (AMC), which assigns standardized International Classification of Diseases (ICD) codes to clinical notes, is essential for medical reimbursement, quality reporting, and clinical research. Existing pre-trained language model (PLM)-based methods typically formulate AMC as an extreme multi-label classification problem over a predefined code set, while recent large language model (LLM)-based approaches instead frame it as generation or multi-step reasoning. However, key challenges remain, including the extreme length of clinical notes that hinders effective interpretation, the vast ICD label space, and complex coding rules that are not explicitly captured by LLMs. In this work, we propose Knowledge-Guided Reasoning over Clinical Evidence with LLMs (KREL), a framework that leverages LLMs for clinical text understanding and reasoning while integrating external ICD coding guidelines as structured knowledge. This design enables tight coupling between domain knowledge and LLM reasoning, reducing hallucinations and improving compliance with coding standards. Experiments on benchmark datasets show that KREL consistently outperforms strong PLM-based and state-of-the-art LLM-based baselines.
Related papers
- Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation [66.62662330558906]
CORAL is a multimodal framework that integrates spatial grounding and concept-level supervision into a unified reasoning process.<n>CORAL employs a prompt-driven medical segmentation model to localize lesions and predicts multi-class clinical attributes through a Concept Bottleneck module.<n>Experiments on BUS-CoT and IU X-ray datasets demonstrate consistent improvements in diagnostic accuracy, concept consistency, and report quality over strong general-purpose and medical MLLMs.
arXiv Detail & Related papers (2026-09-14T10:21:23Z) - Benchmarking Clinical Decision Pathway Adherence in Large Language Models [111.31765633748081]
MEGA-CDP is a benchmark for evaluating whether medical LLMs can generate guideline-adherent CDPs.<n>It is constructed from 2,274 English and Chinese clinical practice guidelines through a guideline-to-case pipeline.<n>It supports both single-turn vignette and multi-turn interactive settings, and introduces a CDP-oriented evaluation framework.
arXiv Detail & Related papers (2026-08-27T04:17:12Z) - Language Models as Interfaces, Not Oracles: A Hybrid LLM-ML System for Pediatric Appendicitis [1.0312968200748116]
ClaMPAPP (Clinical Language-assisted Machine-learning Pipeline for Appendicitis) is a hybrid system that uses an LLM as an interface rather than as the final decision-maker.<n>We evaluated ClaMPAPP on two independent pediatric appendicitis cohorts from German hospitals.
arXiv Detail & Related papers (2026-06-17T15:22:51Z) - Can Post-Training Turn LLMs into Good Medical Coders? An Empirical Study of Generative ICD Coding [40.63304781183767]
Generative large language models (LLMs) are often reported as weak medical coders.<n>We present a controlled empirical study of post-training for generative ICD coding.
arXiv Detail & Related papers (2026-06-11T22:04:50Z) - EHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMs [51.129595320595094]
Clinical decision-making (CDM) is central to real-world clinical, where clinicians infer diagnoses, select treatments, or anticipate future health outcomes under incomplete evidence.<n>LLM models are increasingly used to support these decisions due to strong language capabilities, broad biomedical knowledge, and efficiency.<n>The reliability of LLMs on real-world clinical decision tasks remains insufficiently understood.
arXiv Detail & Related papers (2026-05-28T22:38:26Z) - LingLanMiDian: Systematic Evaluation of LLMs on TCM Knowledge and Clinical Reasoning [27.37958097277936]
LingLan benchmark is a large-scale, expert-curated, multi-task suite that unifies evaluation across knowledge recall, multi-hop reasoning, information extraction, and real-world clinical decision-making.<n>LingLan introduces a consistent metric design, a synonym-tolerant protocol for clinical labels, a per-dataset 400-item Hard subset, and a reframing of diagnosis and treatment recommendation into single-choice decision recognition.
arXiv Detail & Related papers (2026-02-02T08:02:25Z) - A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine [59.78991974851707]
Large language models (LLMs) have demonstrated strong performance on medical benchmarks, including question answering and diagnosis.<n>Most medical LLMs are trained on data from a single institution, which faces limitations in generalizability and safety in heterogeneous systems.<n>We introduce the model-agnostic and parameter-efficient federated learning framework for adapting LLMs to medical applications.
arXiv Detail & Related papers (2026-01-29T18:48:21Z) - ClinDEF: A Dynamic Evaluation Framework for Large Language Models in Clinical Reasoning [58.01333341218153]
We propose ClinDEF, a dynamic framework for assessing clinical reasoning in LLMs through simulated diagnostic dialogues.<n>Our method generates patient cases and facilitates multi-turn interactions between an LLM-based doctor and an automated patient agent.<n>Experiments show that ClinDEF effectively exposes critical clinical reasoning gaps in state-of-the-art LLMs.
arXiv Detail & Related papers (2025-12-29T12:58:58Z) - Toward Reliable Clinical Coding with Language Models: Verification and Lightweight Adaptation [3.952186976672079]
We show that lightweight interventions, including prompt engineering and small-scale fine-tuning, can improve accuracy without the computational overhead of search-based methods.<n>To address hierarchically near-miss errors, we introduce clinical code verification as both a standalone task and a pipeline component.
arXiv Detail & Related papers (2025-10-08T23:50:58Z) - MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Models [10.46932473088646]
We introduce MedGUIDE, a new benchmark for evaluating Large Language Models (LLMs) on their ability to make guideline-consistent clinical decisions.<n> MedGUIDE is constructed from 55 curated NCCN decision trees across 17 cancer types.<n>We apply a two-stage quality selection process, combining expert-labeled reward models and LLM-as-a-judge ensembles across ten clinical and linguistic criteria, to select 7,747 high-quality samples.
arXiv Detail & Related papers (2025-05-16T18:21:52Z) - SemioLLM: Evaluating Large Language Models for Diagnostic Reasoning from Unstructured Clinical Narratives in Epilepsy [45.2233252981348]
Large Language Models (LLMs) have been shown to encode clinical knowledge.<n>We present SemioLLM, an evaluation framework that benchmarks 6 state-of-the-art models.<n>We show that most LLMs are able to accurately and confidently generate probabilistic predictions of seizure onset zones in the brain.
arXiv Detail & Related papers (2024-07-03T11:02:12Z) - Does Biomedical Training Lead to Better Medical Performance? [7.341724934479004]
Large Language Models (LLMs) are expected to significantly contribute to patient care, diagnostics, and administrative processes.<n>This study investigates the effect of biomedical training in the context of six practical medical tasks evaluating $25$ models.
arXiv Detail & Related papers (2024-04-05T12:51:37Z) - Don't Ignore Dual Logic Ability of LLMs while Privatizing: A
Data-Intensive Analysis in Medical Domain [19.46334739319516]
We study how the dual logic ability of LLMs is affected during the privatization process in the medical domain.
Our results indicate that incorporating general domain dual logic data into LLMs not only enhances LLMs' dual logic ability but also improves their accuracy.
arXiv Detail & Related papers (2023-09-08T08:20:46Z) - Self-Verification Improves Few-Shot Clinical Information Extraction [73.6905567014859]
Large language models (LLMs) have shown the potential to accelerate clinical curation via few-shot in-context learning.
They still struggle with issues regarding accuracy and interpretability, especially in mission-critical domains such as health.
Here, we explore a general mitigation framework using self-verification, which leverages the LLM to provide provenance for its own extraction and check its own outputs.
arXiv Detail & Related papers (2023-05-30T22:05:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.