No Black Box Anymore: Demystifying Clinical Predictive Modeling with Temporal-Feature Cross Attention Mechanism

• URL: http://arxiv.org/abs/2503.19285v2
• Date: Wed, 26 Mar 2025 22:09:44 GMT
• Title: No Black Box Anymore: Demystifying Clinical Predictive Modeling with Temporal-Feature Cross Attention Mechanism
• Authors: Yubo Li, Xinyu Yao, Rema Padman,
• Abstract summary: Temporal-Feature Cross Attention Mechanism (TFCAM) is a novel deep learning framework designed to capture dynamic interactions among clinical features across time.<n>In an experiment with 1,422 patients with Chronic Kidney Disease, TFCAM outperformed LSTM and RETAIN baselines, achieving an AUROC of 0.95 and an F1-score of 0.69.
• Score: 7.510165488300369
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite the outstanding performance of deep learning models in clinical prediction tasks, explainability remains a significant challenge. Inspired by transformer architectures, we introduce the Temporal-Feature Cross Attention Mechanism (TFCAM), a novel deep learning framework designed to capture dynamic interactions among clinical features across time, enhancing both predictive accuracy and interpretability. In an experiment with 1,422 patients with Chronic Kidney Disease, predicting progression to End-Stage Renal Disease, TFCAM outperformed LSTM and RETAIN baselines, achieving an AUROC of 0.95 and an F1-score of 0.69. Beyond performance gains, TFCAM provides multi-level explainability by identifying critical temporal periods, ranking feature importance, and quantifying how features influence each other across time before affecting predictions. Our approach addresses the "black box" limitations of deep learning in healthcare, offering clinicians transparent insights into disease progression mechanisms while maintaining state-of-the-art predictive performance.

Related papers

• Attention-enabled Explainable AI for Bladder Cancer Recurrence Prediction [0.4369058206183195]
  Non-muscle-invasive bladder cancer (NMIBC) recurrence rates soar as high as 70-80%. Each recurrence triggers a cascade of invasive procedures, lifelong surveillance, and escalating healthcare costs. Existing clinical prediction tools remain fundamentally flawed, often overestimating recurrence risk.
  arXiv  Detail & Related papers  (2025-04-30T20:39:33Z)
• MELON: Multimodal Mixture-of-Experts with Spectral-Temporal Fusion for Long-Term Mobility Estimation in Critical Care [1.5237145555729716]
  We introduce MELON, a novel framework designed to predict 12-hour mobility status in the critical care setting. We trained and evaluated the MELON model on the multimodal dataset of 126 patients recruited from nine Intensive Care Units at the University of Florida Health Shands Hospital main campus in Gainesville, Florida. Results showed that MELON outperforms conventional approaches for 12-hour mobility status estimation.
  arXiv  Detail & Related papers  (2025-03-10T19:47:46Z)
• Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
  We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events. Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
  arXiv  Detail & Related papers  (2024-07-28T02:42:36Z)
• Explainable Artificial Intelligence Techniques for Irregular Temporal Classification of Multidrug Resistance Acquisition in Intensive Care Unit Patients [7.727213847237959]
  This study introduces a novel methodology that integrates Gated Recurrent Units (GRUs) with advanced intrinsic and post-hoc interpretability techniques. Our methodology aims to identify specific risk factors associated with Multidrug-Resistant (MDR) infections in ICU patients.
  arXiv  Detail & Related papers  (2024-07-24T11:12:01Z)
• Interpretable Vital Sign Forecasting with Model Agnostic Attention Maps [5.354055742467353]
  This paper introduces a framework that combines a deep learning model with an attention mechanism that highlights the critical time steps in the forecasting process. We show that the attention mechanism could be adapted to various black box time series forecasting models such as N-HiTS and N-BEATS.
  arXiv  Detail & Related papers  (2024-05-02T20:19:07Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• Benchmarking Heterogeneous Treatment Effect Models through the Lens of Interpretability [82.29775890542967]
  Estimating personalized effects of treatments is a complex, yet pervasive problem. Recent developments in the machine learning literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but opaque, tools. We use post-hoc feature importance methods to identify features that influence the model's predictions.
  arXiv  Detail & Related papers  (2022-06-16T17:59:05Z)
• Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over Time [71.30985926640659]
  We introduce the Disentangled Counterfactual Recurrent Network (DCRN), a sequence-to-sequence architecture that estimates treatment outcomes over time. With an architecture that is completely inspired by the causal structure of treatment influence over time, we advance forecast accuracy and disease understanding. We demonstrate that DCRN outperforms current state-of-the-art methods in forecasting treatment responses, on both real and simulated data.
  arXiv  Detail & Related papers  (2021-12-07T16:40:28Z)
• A Knowledge Distillation Ensemble Framework for Predicting Short and Long-term Hospitalisation Outcomes from Electronic Health Records Data [5.844828229178025]
  Existing outcome prediction models suffer from a low recall of infrequent positive outcomes. We present a highly-scalable and robust machine learning framework to automatically predict adversity represented by mortality and ICU admission.
  arXiv  Detail & Related papers  (2020-11-18T15:56:28Z)
• MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
  This paper aims at a unified deep learning approach to predict patient prognosis and therapy response. We formalize the prognosis modeling as a multi-modal asynchronous time series classification task. Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
  arXiv  Detail & Related papers  (2020-10-08T15:30:17Z)
• Prediction of the onset of cardiovascular diseases from electronic health records using multi-task gated recurrent units [51.14334174570822]
  We propose a multi-task recurrent neural network with attention mechanism for predicting cardiovascular events from electronic health records. The proposed approach is compared to a standard clinical risk predictor (QRISK) and machine learning alternatives using 5-year data from a NHS Foundation Trust.
  arXiv  Detail & Related papers  (2020-07-16T17:43:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.