A Proactive EMR Assistant for Doctor-Patient Dialogue: Streaming ASR, Belief Stabilization, and Preliminary Controlled Evaluation
- URL: http://arxiv.org/abs/2604.13059v1
- Date: Wed, 18 Mar 2026 05:54:01 GMT
- Title: A Proactive EMR Assistant for Doctor-Patient Dialogue: Streaming ASR, Belief Stabilization, and Preliminary Controlled Evaluation
- Abstract summary: We present an end-to-end proactive EMR assistant built around streaming speech recognition, punctuation restoration, stateful extraction, belief stabilization, objectified retrieval, action planning, and replayable report generation.<n>The full system reaches state-event F1 of 0.84, retrieval Recall@5 of 0.87, and end-to-end pilot scores of 83.3% coverage, 81.4% structural, completeness, and 80.0% risk recall.
- Score: 4.321699303483216
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most dialogue-based electronic medical record (EMR) systems still behave as passive pipelines: transcribe speech, extract information, and generate the final note after the consultation. That design improves documentation efficiency, but it is insufficient for proactive consultation support because it does not explicitly address streaming speech noise, missing punctuation, unstable diagnostic belief, objectification quality, or measurable next-action gains. We present an end-to-end proactive EMR assistant built around streaming speech recognition, punctuation restoration, stateful extraction, belief stabilization, objectified retrieval, action planning, and replayable report generation. The system is evaluated in a preliminary controlled setting using ten streamed doctor-patient dialogues and a 300-query retrieval benchmark aggregated across dialogues. The full system reaches state-event F1 of 0.84, retrieval Recall@5 of 0.87, and end-to-end pilot scores of 83.3% coverage, 81.4% structural completeness, and 80.0% risk recall. Ablations further suggest that punctuation restoration and belief stabilization may improve downstream extraction, retrieval, and action selection within this pilot. These results were obtained under a controlled simulated pilot setting rather than broad deployment claims, and they should not be read as evidence of clinical deployment readiness, clinical safety, or real-world clinical utility. Instead, they suggest that the proposed online architecture may be technically coherent and directionally supportive under tightly controlled pilot conditions. The present study should be read as a pilot concept demonstration under tightly controlled pilot conditions rather than as evidence of clinical deployment readiness or clinical generalizability.
Related papers
- ResidencyRL: Reinforcement Learning in Simulated Clinical Environments [53.76751756107077]
We present ResidencyRL, a reinforcement learning (RL) method for training clinical artificial intelligence (AI) agents through simulated multi-turn clinical encounters.<n>On heldout evaluations, the ResidencyRL agent improves diagnostic accuracy by 7.0% under adversarial conditions.<n>Blinded expert clinicians validated these gains, preferring the trained agent in 87.6% of side-by-side comparisons.
arXiv Detail & Related papers (2026-08-07T17:04:41Z) - PhaseAware: Interpretable Human-in-the-Loop Rehabilitation Scoring with Boundary Monitoring [18.918947215697205]
This study presents a compact framework for continuous rehabilitation quality assessment that combines a temporal backbone with phase- and body-group descriptors.<n>PhaseAware achieved an RMSE of 0.0230, corresponding to an 88.9% reduction relative to the accepted baseline.<n>It also maintained favorable performance on KIMORE, suggesting that the phase-aware design transfers across related squatting protocols.
arXiv Detail & Related papers (2026-07-22T14:57:42Z) - MedCTA: A Benchmark for Clinical Tool Agents [47.47354499871572]
We introduce MedCTA, a benchmark for evaluating medical tool agents on clinician-validated, step-implicit tasks.<n>MedCTA comprises 107 real-world clinical tasks with clinician-verified executable trajectories over 5 deployed tools.<n>We benchmark 18 open- and closed-source multimodal models and find that even frontier systems remain brittle in multi-step clinical tool use.
arXiv Detail & Related papers (2026-06-10T06:26:52Z) - A Breast Vision Pathology Foundation Model for Real-world Clinical Utility [65.57568187389113]
We present bfBRAVE, a breast-adaptive pathology foundation model developed and evaluated using a total resource of 101,638 breast wholeslide images.<n>BRAVE supported practical roles in the clinical workflow, including safe exclusion of low-risk cases from routine AI-assisted second-review rescue of initially missed positives and prioritization of cases for further assessment.
arXiv Detail & Related papers (2026-05-06T07:44:39Z) - Detecting Clinical Discrepancies in Health Coaching Agents: A Dual-Stream Memory and Reconciliation Architecture [71.46525715889656]
General-purpose agent memory systems optimize for coherence by overwriting older facts with the user's latest statement.<n>We introduce a Dual-Stream Memory Architecture that strictly separates the patient narrative from the structured clinical record.<n>We evaluate this architecture on 26 patients across 675 longitudinal wellness coaching sessions.
arXiv Detail & Related papers (2026-04-29T17:59:28Z) - Benchmarking Multi-turn Medical Diagnosis: Hold, Lure, and Self-Correction [72.89352076103889]
Large language models (LLMs) achieve high accuracy in medical diagnosis when all clinical information is provided in a single turn.<n>We introduce MINT, a high-fidelity, multi-turn medical diagnosis benchmark comprising 1,035 cases.<n>We uncover three persistent behavioral patterns that significantly impact diagnostic decisions.
arXiv Detail & Related papers (2026-04-06T00:23:10Z) - Secure On-Premise Deployment of Open-Weights Large Language Models in Radiology: An Isolation-First Architecture with Prospective Pilot Evaluation [29.427162122010216]
The proposed isolation-first on-premise architecture enabled overcoming regulatory borders.<n>The system served the open-weights DeepSeek-R1 model via vLLM.
arXiv Detail & Related papers (2026-03-25T17:38:20Z) - EviSearch: A Human in the Loop System for Extracting and Auditing Clinical Evidence for Systematic Reviews [7.325762712182949]
EviSearch is a multi-agent extraction system for clinical evidence tables.<n>The pipeline is designed for high-precision extraction across multimodal evidence sources.<n>EviSearch is intended to accelerate living systematic review, reduce manual curation burden, and provide a safe, auditable path for integrating LLM-based extraction into evidence synthesis pipelines.
arXiv Detail & Related papers (2026-03-23T22:36:54Z) - Cerebra: A Multidisciplinary AI Board for Multimodal Dementia Characterization and Risk Assessment [56.62016795093786]
Cerebra is an interactive multi-agent AI team that coordinates specialized agents for EHR, clinical notes, and medical imaging analysis.<n>It supports privacy-preserving deployment by operating on structured representations and remains robust when modalities are incomplete.<n>Cerebra significantly improved expert performance, increasing accuracy by 17.5 percentage points in prospective dementia risk estimation.
arXiv Detail & Related papers (2026-03-23T05:46:45Z) - Proactive Knowledge Inquiry in Doctor-Patient Dialogue: Stateful Extraction, Belief Updating, and Path-Aware Action Planning [4.321699303483216]
We formulate doctor-patient dialogue as a proactive knowledge-inquiry problem under partial observability.<n>The proposed framework combines stateful extraction, sequential belief updating, gap-aware state modeling, hybrid retrieval over objectified medical knowledge, and a POMDP-lite action planner.
arXiv Detail & Related papers (2026-03-18T07:03:50Z) - Building Safe and Deployable Clinical Natural Language Processing under Temporal Leakage Constraints [39.44014654945035]
This study focuses on system-level design choices required to build safe and deployable clinical NLP under temporal leakage constraints.<n>We present a lightweight auditing pipeline that integrates interpretability into the model development process to identify and suppress leakage-prone signals prior to final training.<n>Results show that audited models exhibit more conservative and better-calibrated probability estimates, with reduced reliance on discharge-related lexical cues.
arXiv Detail & Related papers (2026-01-24T01:46:46Z) - AgentsEval: Clinically Faithful Evaluation of Medical Imaging Reports via Multi-Agent Reasoning [73.50200033931148]
We introduce AgentsEval, a multi-agent stream reasoning framework that emulates the collaborative diagnostic workflow of radiologists.<n>By dividing the evaluation process into interpretable steps including criteria definition, evidence extraction, alignment, and consistency scoring, AgentsEval provides explicit reasoning traces and structured clinical feedback.<n> Experimental results demonstrate that AgentsEval delivers clinically aligned, semantically faithful, and interpretable evaluations that remain robust under paraphrastic, semantic, and stylistic perturbations.
arXiv Detail & Related papers (2026-01-23T11:59:13Z) - A DeepSeek-Powered AI System for Automated Chest Radiograph Interpretation in Clinical Practice [83.11942224668127]
Janus-Pro-CXR (1B) is a chest X-ray interpretation system based on DeepSeek Janus-Pro model.<n>Our system outperforms state-of-the-art X-ray report generation models in automated report generation.
arXiv Detail & Related papers (2025-12-23T13:26:13Z) - CLIN-LLM: A Safety-Constrained Hybrid Framework for Clinical Diagnosis and Treatment Generation [0.31984926651189866]
Large language model (LLM)-based systems often lack medical grounding and fail to quantify uncertainty.<n>We propose CLIN-LLM, a safety-constrained hybrid pipeline that integrates multimodal patient encoding, uncertainty-calibrated disease classification, and retrieval-augmented treatment generation.
arXiv Detail & Related papers (2025-10-26T10:11:53Z) - DispatchMAS: Fusing taxonomy and artificial intelligence agents for emergency medical services [49.70819009392778]
Large Language Models (LLMs) and Multi-Agent Systems (MAS) offer opportunities to augment dispatchers.<n>This study aimed to develop and evaluate a taxonomy-grounded, multi-agent system for simulating realistic scenarios.
arXiv Detail & Related papers (2025-10-24T08:01:21Z) - An Unsupervised Natural Language Processing Pipeline for Assessing Referral Appropriateness [0.0]
We propose a fully unsupervised Natural Language Processing pipeline capable of extracting and evaluating referral reasons.<n>Our pipeline leverages Transformer-based embeddings pre-trained on Italian medical texts to cluster referral reasons.<n>It operates in an unsupervised setting and is designed to generalize across different examination types.
arXiv Detail & Related papers (2025-01-24T18:24:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.