DeltaSHAP: Explaining Prediction Evolutions in Online Patient Monitoring with Shapley Values

• URL: http://arxiv.org/abs/2507.02342v2
• Date: Sat, 12 Jul 2025 07:51:21 GMT
• Title: DeltaSHAP: Explaining Prediction Evolutions in Online Patient Monitoring with Shapley Values
• Authors: Changhun Kim, Yechan Mun, Sangchul Hahn, Eunho Yang,
• Abstract summary: This study proposes DeltaSHAP, a novel explainable artificial intelligence (XAI) algorithm specifically designed for online patient monitoring systems.<n>By adapting Shapley values to temporal settings, our approach accurately captures feature coalition effects.<n>It further attributes prediction changes using only the actually observed feature combinations, making it efficient and practical for time-sensitive clinical applications.
• Score: 28.105209213061386
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This study proposes DeltaSHAP, a novel explainable artificial intelligence (XAI) algorithm specifically designed for online patient monitoring systems. In clinical environments, discovering the causes driving patient risk evolution is critical for timely intervention, yet existing XAI methods fail to address the unique requirements of clinical time series explanation tasks. To this end, DeltaSHAP addresses three key clinical needs: explaining the changes in the consecutive predictions rather than isolated prediction scores, providing both magnitude and direction of feature attributions, and delivering these insights in real time. By adapting Shapley values to temporal settings, our approach accurately captures feature coalition effects. It further attributes prediction changes using only the actually observed feature combinations, making it efficient and practical for time-sensitive clinical applications. We also introduce new evaluation metrics to evaluate the faithfulness of the attributions for online time series, and demonstrate through experiments on online patient monitoring tasks that DeltaSHAP outperforms state-of-the-art XAI methods in both explanation quality as 62% and computational efficiency as 33% time reduction on the MIMIC-III decompensation benchmark. We release our code at https://github.com/AITRICS/DeltaSHAP.

Related papers

• The hidden risks of temporal resampling in clinical reinforcement learning [0.0]
  We show that temporal resampling significantly degrades the performance of offline reinforcement learning algorithms during live deployment.<n>We propose three mechanisms that drive this failure: the generation of counterfactual trajectories, the distortion of temporal expectations, and the compounding of generalisation errors.
  arXiv  Detail & Related papers  (2026-02-06T11:02:06Z)
• Delta-XAI: A Unified Framework for Explaining Prediction Changes in Online Time Series Monitoring [32.292736279133436]
  Time series monitoring is crucial across sensitive domains such as healthcare and finance.<n>Recent XAI methods have improved the explainability of time series models, but they mostly analyze each time step independently.<n>We propose Delta-XAI, which adapts 14 existing XAI methods through a wrapper function and introduces a principled evaluation suite for the online setting.
  arXiv  Detail & Related papers  (2025-11-28T09:57:44Z)
• SurgeryLSTM: A Time-Aware Neural Model for Accurate and Explainable Length of Stay Prediction After Spine Surgery [44.119171920037196]
  We develop and evaluate machine learning (ML) models for predicting length of stay (LOS) in elective spine surgery.<n>We compare traditional ML models with our developed model, SurgeryLSTM, a masked bidirectional long short-term memory (BiLSTM) with an attention.<n>Performance was evaluated using the coefficient of determination (R2) and key predictors were identified using explainable AI.
  arXiv  Detail & Related papers  (2025-07-15T01:18:28Z)
• Machine Learning for ALSFRS-R Score Prediction: Making Sense of the Sensor Data [44.99833362998488]
  Amyotrophic Lateral Sclerosis (ALS) is a rapidly progressive neurodegenerative disease that presents individuals with limited treatment options. The present investigation, spearheaded by the iDPP@CLEF 2024 challenge, focuses on utilizing sensor-derived data obtained through an app.
  arXiv  Detail & Related papers  (2024-07-10T19:17:23Z)
• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• New Epochs in AI Supervision: Design and Implementation of an Autonomous Radiology AI Monitoring System [5.50085484902146]
  We introduce novel methods for monitoring the performance of radiology AI classification models in practice. We propose two metrics - predictive divergence and temporal stability - to be used for preemptive alerts of AI performance changes.
  arXiv  Detail & Related papers  (2023-11-24T06:29:04Z)
• Clairvoyance: A Pipeline Toolkit for Medical Time Series [95.22483029602921]
  Time-series learning is the bread and butter of data-driven *clinical decision support* Clairvoyance proposes a unified, end-to-end, autoML-friendly pipeline that serves as a software toolkit. Clairvoyance is the first to demonstrate viability of a comprehensive and automatable pipeline for clinical time-series ML.
  arXiv  Detail & Related papers  (2023-10-28T12:08:03Z)
• QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systems [9.29069202652354]
  An Explainable AI for Quantitative analysis (QXAI) framework is proposed with post-hoc model explainability and intrinsic explainability for regression and classification tasks. We adopted the artificial neural networks (ANN) and attention-based Bidirectional LSTM (BiLSTM) models for the prediction of heart rate and classification of physical activities based on sensor data.
  arXiv  Detail & Related papers  (2023-09-19T03:50:30Z)
• Scheduling with Predictions [0.0]
  Modern learning techniques have made it possible to detect abnormalities in medical images within minutes. Machine-assisted diagnoses cannot yet reliably replace human reviews of images by a radiologist. We study this scenario by formulating it as a learning-augmented online scheduling problem.
  arXiv  Detail & Related papers  (2022-12-20T17:10:06Z)
• Forecasting Patient Flows with Pandemic Induced Concept Drift using Explainable Machine Learning [0.0]
  This study investigates how a suite of novel quasi-real-time variables can improve the forecasting models of patient flows. The prevailing COVID-19 Alert Level feature together with Google search terms and pedestrian traffic were effective at producing generalisable forecasts.
  arXiv  Detail & Related papers  (2022-11-01T20:42:26Z)
• What Do You See in this Patient? Behavioral Testing of Clinical NLP Models [69.09570726777817]
  We introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. We show that model behavior varies drastically even when fine-tuned on the same data and that allegedly best-performing models have not always learned the most medically plausible patterns.
  arXiv  Detail & Related papers  (2021-11-30T15:52:04Z)
• Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network [51.44506007844284]
  We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery. We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
  arXiv  Detail & Related papers  (2021-11-08T07:57:30Z)
• Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration [55.88616573143478]
  Outcome prediction from clinical text can prevent doctors from overlooking possible risks. Diagnoses at discharge, procedures performed, in-hospital mortality and length-of-stay prediction are four common outcome prediction targets. We propose clinical outcome pre-training to integrate knowledge about patient outcomes from multiple public sources.
  arXiv  Detail & Related papers  (2021-02-08T10:26:44Z)
• Real-time Prediction for Mechanical Ventilation in COVID-19 Patients using A Multi-task Gaussian Process Multi-objective Self-attention Network [9.287068570192057]
  We propose a robust in-time predictor for in-hospital COVID-19 patient's probability of requiring mechanical ventilation. A challenge in the risk prediction for COVID-19 patients lies in the great variability and irregular sampling of patient's vitals and labs observed in the clinical setting. We frame the prediction task into a multi-objective learning framework, and the risk scores at all time points are optimized altogether.
  arXiv  Detail & Related papers  (2021-02-01T20:35:22Z)
• BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes [53.163089893876645]
  We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey. An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys. We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
  arXiv  Detail & Related papers  (2020-09-24T00:42:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.