SmartAlert: Implementing Machine Learning-Driven Clinical Decision Support for Inpatient Lab Utilization Reduction

• URL: http://arxiv.org/abs/2512.04354v1
• Date: Thu, 04 Dec 2025 00:59:41 GMT
• Title: SmartAlert: Implementing Machine Learning-Driven Clinical Decision Support for Inpatient Lab Utilization Reduction
• Authors: April S. Liang, Fatemeh Amrollahi, Yixing Jiang, Conor K. Corbin, Grace Y. E. Kim, David Mui, Trevor Crowell, Aakash Acharya, Sreedevi Mony, Soumya Punnathanam, Jack McKeown, Margaret Smith, Steven Lin, Arnold Milstein, Kevin Schulman, Jason Hom, Michael A. Pfeffer, Tho D. Pham, David Svec, Weihan Chu, Lisa Shieh, Christopher Sharp, Stephen P. Ma, Jonathan H. Chen,
• Abstract summary: This case study describes the implementation process, challenges, and lessons learned from deploying SmartAlert.<n>SmartAlert is a machine learning-driven clinical decision support system integrated into the electronic health record.<n>Results show significant decrease in number of CBC results within 52 hours of SmartAlert display.
• Score: 4.9712826535880925
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Repetitive laboratory testing unlikely to yield clinically useful information is a common practice that burdens patients and increases healthcare costs. Education and feedback interventions have limited success, while general test ordering restrictions and electronic alerts impede appropriate clinical care. We introduce and evaluate SmartAlert, a machine learning (ML)-driven clinical decision support (CDS) system integrated into the electronic health record that predicts stable laboratory results to reduce unnecessary repeat testing. This case study describes the implementation process, challenges, and lessons learned from deploying SmartAlert targeting complete blood count (CBC) utilization in a randomized controlled pilot across 9270 admissions in eight acute care units across two hospitals between August 15, 2024, and March 15, 2025. Results show significant decrease in number of CBC results within 52 hours of SmartAlert display (1.54 vs 1.82, p <0.01) without adverse effect on secondary safety outcomes, representing a 15% relative reduction in repetitive testing. Implementation lessons learned include interpretation of probabilistic model predictions in clinical contexts, stakeholder engagement to define acceptable model behavior, governance processes for deploying a complex model in a clinical environment, user interface design considerations, alignment with clinical operational priorities, and the value of qualitative feedback from end users. In conclusion, a machine learning-driven CDS system backed by a deliberate implementation and governance process can provide precision guidance on inpatient laboratory testing to safely reduce unnecessary repetitive testing.

Related papers

• AI-assisted Protocol Information Extraction For Improved Accuracy and Efficiency in Clinical Trial Workflows [0.0]
  Structuring protocol content into standard formats has the potential to improve efficiency, support documentation quality, and strengthen compliance.<n>We evaluate an Artificial Intelligence (AI) system using generative LLMs with RetrievalAugmented Generation (RAG) for automated clinical trial protocol information extraction.
  arXiv  Detail & Related papers  (2026-01-19T18:38:36Z)
• Evolving Diagnostic Agents in a Virtual Clinical Environment [75.59389103511559]
  We present a framework for training large language models (LLMs) as diagnostic agents with reinforcement learning.<n>Our method acquires diagnostic strategies through interactive exploration and outcome-based feedback.<n>DiagAgent significantly outperforms 10 state-of-the-art LLMs, including DeepSeek-v3 and GPT-4o.
  arXiv  Detail & Related papers  (2025-10-28T17:19:47Z)
• Timely Clinical Diagnosis through Active Test Selection [49.091903570068155]
  We propose ACTMED (Adaptive Clinical Test selection via Model-based Experimental Design) to better emulate real-world diagnostic reasoning.<n>LLMs act as flexible simulators, generating plausible patient state distributions and supporting belief updates without requiring structured, task-specific training data.<n>We evaluate ACTMED on real-world datasets and show it can optimize test selection to improve diagnostic accuracy, interpretability, and resource use.
  arXiv  Detail & Related papers  (2025-10-21T18:10:45Z)
• Attention-enabled Explainable AI for Bladder Cancer Recurrence Prediction [0.4369058206183195]
  Non-muscle-invasive bladder cancer (NMIBC) recurrence rates soar as high as 70-80%.<n>Each recurrence triggers a cascade of invasive procedures, lifelong surveillance, and escalating healthcare costs.<n>Existing clinical prediction tools remain fundamentally flawed, often overestimating recurrence risk.
  arXiv  Detail & Related papers  (2025-04-30T20:39:33Z)
• ExOSITO: Explainable Off-Policy Learning with Side Information for Intensive Care Unit Blood Test Orders [13.090586660373775]
  This paper develops a novel method that combines off-policy learning with privileged information to identify the optimal set of ICU lab tests to order.<n>We pose this problem as a causal bandit trained using offline data and a reward function derived from clinically-approved rules.<n>The learned policy function provides interpretable clinical information and reduces costs without omitting any vital lab orders.
  arXiv  Detail & Related papers  (2025-04-24T06:07:14Z)
• SepsisCalc: Integrating Clinical Calculators into Early Sepsis Prediction via Dynamic Temporal Graph Construction [27.020030731672477]
  Sepsis is an organ dysfunction caused by a deregulated immune response to an infection.<n>Clinical calculators play a vital role in sepsis identification within clinicians' workflow.
  arXiv  Detail & Related papers  (2024-12-31T00:02:07Z)
• TrialBench: Multi-Modal Artificial Intelligence-Ready Clinical Trial Datasets [54.98321887435557]
  This paper presents a suite of 23 meticulously curated AI-ready datasets covering multi-modal input features and 8 crucial prediction challenges in clinical trial design.<n>We provide basic validation methods for each task to ensure the datasets' usability and reliability.<n>We anticipate that the availability of such open-access datasets will catalyze the development of advanced AI approaches for clinical trial design.
  arXiv  Detail & Related papers  (2024-06-30T09:13:10Z)
• A machine learning framework for interpretable predictions in patient pathways: The case of predicting ICU admission for patients with symptoms of sepsis [3.5280004326441365]
  PatWay-Net is an ML framework designed for interpretable predictions of admission to the intensive care unit for patients with sepsis. We propose a novel type of recurrent neural network and combine it with multi-layer perceptrons to process the patient pathways. We demonstrate its utility through a comprehensive dashboard that visualizes patient health trajectories, predictive outcomes, and associated risks.
  arXiv  Detail & Related papers  (2024-05-21T20:31:42Z)
• U-PASS: an Uncertainty-guided deep learning Pipeline for Automated Sleep Staging [61.6346401960268]
  We propose a machine learning pipeline called U-PASS tailored for clinical applications that incorporates uncertainty estimation at every stage of the process. We apply our uncertainty-guided deep learning pipeline to the challenging problem of sleep staging and demonstrate that it systematically improves performance at every stage.
  arXiv  Detail & Related papers  (2023-06-07T08:27:36Z)
• Detecting Shortcut Learning for Fair Medical AI using Shortcut Testing [62.9062883851246]
  Machine learning holds great promise for improving healthcare, but it is critical to ensure that its use will not propagate or amplify health disparities. One potential driver of algorithmic unfairness, shortcut learning, arises when ML models base predictions on improper correlations in the training data. Using multi-task learning, we propose the first method to assess and mitigate shortcut learning as a part of the fairness assessment of clinical ML systems.
  arXiv  Detail & Related papers  (2022-07-21T09:35:38Z)
• COVID-Net Clinical ICU: Enhanced Prediction of ICU Admission for COVID-19 Patients via Explainability and Trust Quantification [71.80459780697956]
  We introduce COVID-Net Clinical ICU, a neural network for ICU admission prediction based on patient clinical data. The proposed COVID-Net Clinical ICU was built using a clinical dataset from Hospital Sirio-Libanes comprising of 1,925 COVID-19 patients. We conducted system-level insight discovery using a quantitative explainability strategy to study the decision-making impact of different clinical features.
  arXiv  Detail & Related papers  (2021-09-14T14:16:32Z)
• Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration [55.88616573143478]
  Outcome prediction from clinical text can prevent doctors from overlooking possible risks. Diagnoses at discharge, procedures performed, in-hospital mortality and length-of-stay prediction are four common outcome prediction targets. We propose clinical outcome pre-training to integrate knowledge about patient outcomes from multiple public sources.
  arXiv  Detail & Related papers  (2021-02-08T10:26:44Z)
• A Knowledge Distillation Ensemble Framework for Predicting Short and Long-term Hospitalisation Outcomes from Electronic Health Records Data [5.844828229178025]
  Existing outcome prediction models suffer from a low recall of infrequent positive outcomes. We present a highly-scalable and robust machine learning framework to automatically predict adversity represented by mortality and ICU admission.
  arXiv  Detail & Related papers  (2020-11-18T15:56:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.