Characterizing Treatment-Context Medication Evidence Across Clinic Notes and Structured EHR Medication History

• URL: http://arxiv.org/abs/2608.01570v1
• Date: Mon, 03 Aug 2026 01:00:01 GMT
• Title: Characterizing Treatment-Context Medication Evidence Across Clinic Notes and Structured EHR Medication History
• Abstract summary: Clinic notes and structured electronic health record (EHR) medication history often contain different medication information.<n>Same-visit disagreement may result from note-side normalization errors, differences in terminology or timing, or actual differences in documentation.<n>We developed a note-grounded approach that uses large language model (LLM) assisted reference construction, targeted and random human review, deterministic medication normalization, and semantic and temporal comparisons with structured medication history.
• Score: 1.6612653577971574
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Clinic notes and structured electronic health record (EHR) medication history often contain different medication information. Same-visit disagreement between these sources may result from note-side normalization errors, differences in terminology or timing, or actual differences in documentation. We developed a note-grounded approach that uses large language model (LLM) assisted reference construction, targeted and random human review, deterministic medication normalization, and semantic and temporal comparisons with structured medication history. We evaluated all normalization results on a patient-level held-out test set to limit adaptation to the study cohort. On 5,403 held-out mention rows, exact canonical agreement improved from 0.7226 with surface-exact matching to 0.8429 after lexical cleanup and curated alias mapping. In a random audit of previously unaudited rows, canonical-label agreement was 0.9210 among evaluable valid medication mentions, whereas treatment-action attribution was lower at 0.5326. In the full-cohort characterization analysis, only 16.44% of note-derived rows had same-visit exact overlap with structured medication history, but 55.17% had same-visit semantic overlap, 90.34% had same-visit or +/-30-day overlap, and only 3.97% remained in the strict no-structured-overlap bucket under broad project-level mapping. An ontology-backed sensitivity analysis further showed that held-out strict Observational Medical Outcomes Partnership (OMOP)-backed no-overlap fell from 43.99% to 36.68% after a development-derived alias supplement. These results show that note-to-structured-medication mismatch can arise from normalization errors, differences in terminology, and differences in documentation timing.

Related papers

• Learning a Continuous Sepsis Severity Score Without Hour-by-Hour Supervision: A Two-Site Retrospective Study [6.58570893992725]
  Currently used sepsis severity indices rely on fixed variables and weights established decades ago.<n>We developed a mortality index using 43 routinely charted variables over a 72-hour treatment window.<n>Within-patient change in the index correlated with change in lactate.
  arXiv  Detail & Related papers  (2026-08-27T17:46:21Z)
• Auditable agentic AI for evidence-grounded thyroid ultrasound diagnosis and reporting [59.709162055944915]
  ThyroidXAgent is an agentic AI system that coordinates specialized diagnostic tools and stores their outputs as an auditable case-level evidence record.<n>It was evaluated on 28,458 non-overlapping test cases, including 8,721 cases from 35 centres in the private NHC-MISD-TUS cohort.<n>It achieved a mean Dice score of 87.21 percent for segmentation and a mean AUROC of 0.9466 for benign-malignant classification.
  arXiv  Detail & Related papers  (2026-08-12T21:02:59Z)
• Evaluation Protocols and Cross-Subject Generalization in EEG Emotion Recognition [2.5603375915051747]
  We use a dynamical graph convolutional neural network pathway on SEED and SEED-IV as an illustrative case.<n>Subject-dependent, subject-disjoint, and cross-session results should therefore be reported as answers to different questions.
  arXiv  Detail & Related papers  (2026-07-30T04:13:43Z)
• RareLens: Towards End-to-End Rare Disease Care via Aligning Divergent Large Language Model Reasoning [42.80742579670377]
  RareLens is a system that supports clinical decision-making across the entire rare disease trajectory.<n>Developed and evaluated on RareBench, a real-world dataset of 157,525 cases spanning all 33 Orphanet categories and more than 7,000 conditions.<n>It achieved an area under the curve of 0.917 for screening and top-1 accuracies of 65.5% and 89.8% for diagnosis and treatment.
  arXiv  Detail & Related papers  (2026-07-25T16:58:10Z)
• The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports [0.0]
  Using 450 chest X-ray reports from the Indiana University dataset, we generate synthetic versions via three realistic rewriting tasks.<n>We measure entity erosion (via medical NER), hedging collapse (loss of clinical uncertainty language), and cross-modal alignment degradation.<n>The dominant determinant of degradation is the type of AI rewriting task, not the clinical content.
  arXiv  Detail & Related papers  (2026-06-16T11:07:48Z)
• Compared to What? Baselines and Metrics for Counterfactual Prompting [39.56472929066589]
  We observe prediction flip rates on MedQA of 14.9% when we surgically change patient gender.<n>We propose a framework in which we compare differences observed under target interventions to those induced by paraphrasing inputs.<n>We find that these effects largely dissipate when we account for general model sensitivity.
  arXiv  Detail & Related papers  (2026-05-01T19:23:33Z)
• Detecting Clinical Discrepancies in Health Coaching Agents: A Dual-Stream Memory and Reconciliation Architecture [71.46525715889656]
  General-purpose agent memory systems optimize for coherence by overwriting older facts with the user's latest statement.<n>We introduce a Dual-Stream Memory Architecture that strictly separates the patient narrative from the structured clinical record.<n>We evaluate this architecture on 26 patients across 675 longitudinal wellness coaching sessions.
  arXiv  Detail & Related papers  (2026-04-29T17:59:28Z)
• Agentic clinical reasoning over longitudinal myeloma records: a retrospective evaluation against expert consensus [13.511095666949055]
  Multiple myeloma is managed through sequential lines of therapy over years to decades.<n>A retrospective evaluation was conducted on longitudinal clinical records of 811 myeloma patients treated at a tertiary centre (2001-2026)<n>An agentic reasoning system was compared against single-pass retrieval-augmented generation (RAG), iterative RAG, and full-context input on 469 patient-question pairs.<n>Agentic reasoning was the only approach to exceed the shared ceiling, with gains concentrated on the most complex questions and longest records.
  arXiv  Detail & Related papers  (2026-04-27T13:41:18Z)
• From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentation [43.148402136307716]
  Cross-model disagreement among heterogeneous ASR systems can act as a reference-free uncertainty signal.<n>We transcribed 50 publicly available medical audio clips with eight ASR systems spanning commercial APIs and open-source engines.<n>Low-agreement regions were enriched for content disagreements, with the content fraction increasing from 53.9% to 73.9% across quintiles of high-risk mass.
  arXiv  Detail & Related papers  (2026-03-02T13:02:13Z)
• PanCanBench: A Comprehensive Benchmark for Evaluating Large Language Models in Pancreatic Oncology [48.732366302949515]
  Large language models (LLMs) have achieved expert-level performance on standardized examinations, yet multiple-choice accuracy poorly reflects real-world clinical utility and safety.<n>We developed a human-in-the-loop pipeline to create expert rubrics for de-identified patient questions.<n>We evaluated 22 proprietary and open-source LLMs using an LLM-as-a-judge framework, measuring clinical completeness, factual accuracy, and web-search integration.
  arXiv  Detail & Related papers  (2026-03-02T00:50:39Z)
• Modeling Expert AI Diagnostic Alignment via Immutable Inference Snapshots [1.0499611180329804]
  The transition between initial model inference and expert correction is rarely analyzed as a structured signal.<n>We introduce a diagnostic alignment framework in which the AI-generated image based report is preserved as an immutable inference state.
  arXiv  Detail & Related papers  (2026-02-26T13:11:58Z)
• MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning [7.167933033102407]
  We introduce MEDEQUALQA, a counterfactual benchmark that perturbs only patient pronouns while holding critical symptoms and conditions constant.<n>We evaluate a GPT-4.1 model and compute Semantic Textual Similarity (STS) between reasoning traces to measure stability across pronoun variants.<n>Our results show overall high similarity (mean STS >0.80), but reveal consistent localized divergences in cited risk factors, guideline anchors, and differential ordering.
  arXiv  Detail & Related papers  (2025-10-09T22:12:58Z)
• Evaluating AI systems under uncertain ground truth: a case study in dermatology [43.8328264420381]
  We show that ignoring uncertainty leads to overly optimistic estimates of model performance.<n>In skin condition classification, we find that a large portion of the dataset exhibits significant ground truth uncertainty.
  arXiv  Detail & Related papers  (2023-07-05T10:33:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.