MATA-Former & SIICU: Semantic Aware Temporal Alignment for High-Fidelity ICU Risk Prediction
- URL: http://arxiv.org/abs/2604.01727v1
- Date: Thu, 02 Apr 2026 07:45:52 GMT
- Title: MATA-Former & SIICU: Semantic Aware Temporal Alignment for High-Fidelity ICU Risk Prediction
- Abstract summary: We propose a framework to align predictive modeling with clinical logic.<n>We introduce Plateau-Gaussian Soft Labeling (PSL) to reformulating binary classification into continuous multi-horizon regression.<n>Our framework demonstrates superior efficacy and robust generalization in capturing risks from text-intensive, irregular clinical time series.
- Score: 8.92515305370631
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Forecasting evolving clinical risks relies on intrinsic pathological dependencies rather than mere chronological proximity, yet current methods struggle with coarse binary supervision and physical timestamps. To align predictive modeling with clinical logic, we propose the Medical-semantics Aware Time-ALiBi Transformer (MATA-Former), utilizing event semantics to dynamically parameterize attention weights to prioritize causal validity over time lags. Furthermore, we introduce Plateau-Gaussian Soft Labeling (PSL), reformulating binary classification into continuous multi-horizon regression for full-trajectory risk modeling. Evaluated on SIICU -- a newly constructed dataset featuring over 506k events with rigorous expert-verified, fine-grained annotations -- and the MIMIC-IV dataset, our framework demonstrates superior efficacy and robust generalization in capturing risks from text-intensive, irregular clinical time series.
Related papers
- Beyond Time Series: Spatial Reasoning for Epidemic Forecasting via Multimodal Learning [50.948271066372826]
We introduce a spatially structured multimodal epidemic forecasting setting that integrates region-level temporal surveillance data with spatially localized auxiliary signals.<n>We evaluate our approach on real-world COVID-19, influenza, and influenza-like illness (IIL) forecasting tasks under realistic real-time evaluation protocols.
arXiv Detail & Related papers (2026-06-20T17:58:17Z) - ReTAMamba: Reliability-Aware Temporal Aggregation with Mamba for Irregular Clinical Time Series Prediction [3.5795275871379704]
Clinical time-series data are difficult to model because they exhibit irregular sampling, frequent missing values, and heterogeneous observation patterns.<n>Existing approaches commonly use observation masks and time-gap information, but they do not continuously capture the decaying reliability of past observations.<n>We propose Reliability-aware Temporal Aggregation with Mamba, which reconstructs clinical time series as time-variable token sequences.
arXiv Detail & Related papers (2026-05-11T02:39:33Z) - Clinically Interpretable Sepsis Early Warning via LLM-Guided Simulation of Temporal Physiological Dynamics [24.96692273948327]
Timely and interpretable early warning of sepsis remains a clinical challenge.<n>Traditional data-driven models provide accurate yet opaque predictions.<n>We propose a Large Language Model (LLM)-guided temporal simulation framework.
arXiv Detail & Related papers (2026-04-22T06:30:54Z) - TA-RNN-Medical-Hybrid: A Time-Aware and Interpretable Framework for Mortality Risk Prediction [0.9558392439655014]
The proposed framework bridges the gap between predictive accuracy and clinical interpretability.<n>It provides clinically meaningful explanations aligned with established medical knowledge.<n>Overall, the proposed framework offers a scalable and transparent solution for high-stakes ICU decision support systems.
arXiv Detail & Related papers (2026-03-09T11:49:42Z) - Time-to-Event Transformer to Capture Timing Attention of Events in EHR Time Series [15.049813932448112]
LITT is a novel Timing-Transformer architecture that enables temporary alignment of sequential events on a virtual relative timeline''<n>Its interpretability and effectiveness are validated on real-world longitudinal EHR data from 3,276 breast cancer patients.
arXiv Detail & Related papers (2026-02-11T00:13:08Z) - Machine Learning Approaches to Clinical Risk Prediction: Multi-Scale Temporal Alignment in Electronic Health Records [2.9576397177561087]
This study proposes a risk prediction method based on a Multi-Scale Temporal Alignment Network (MSTAN)<n>It addresses the challenges of temporal irregularity, sampling interval differences, and multi-scale dynamic dependencies in Electronic Health Records (EHR)<n> Experiments conducted on publicly available EHR datasets show that the proposed model outperforms mainstream baselines in accuracy, recall, precision, and F1-Score.
arXiv Detail & Related papers (2025-11-26T16:33:59Z) - MEET-Sepsis: Multi-Endogenous-View Enhanced Time-Series Representation Learning for Early Sepsis Prediction [50.74903497515021]
Sepsis is a life-threatening infectious syndrome associated with high mortality in intensive care units (ICUs)<n>Early and accurate sepsis prediction (SP) is critical for timely intervention, yet remains challenging due to subtle early manifestations and rapidly escalating mortality.<n>This paper introduces a Multi-Endogenous-view Representation Enhancement (MERE) mechanism to construct enriched feature views, coupled with a Cascaded Dual-convolution Time-series Attention (CDTA) module for temporal representation learning.<n>The proposed MEET-Sepsis framework achieves competitive prediction accuracy using only 20% of the ICU monitoring time required by SOTA methods, significantly advancing
arXiv Detail & Related papers (2025-10-13T13:38:29Z) - Time-Aware Attention for Enhanced Electronic Health Records Modeling [8.4225455796455]
TALE-EHR is a Transformer-based framework featuring a novel time-aware attention mechanism that explicitly models continuous temporal gaps.<n>Our approach outperforms state-of-the-art baselines on tasks such as disease progression forecasting.
arXiv Detail & Related papers (2025-07-20T07:32:41Z) - CTPD: Cross-Modal Temporal Pattern Discovery for Enhanced Multimodal Electronic Health Records Analysis [50.56875995511431]
We introduce a Cross-Modal Temporal Pattern Discovery (CTPD) framework, designed to efficiently extract meaningful cross-modal temporal patterns from multimodal EHR data.<n>Our approach introduces shared initial temporal pattern representations which are refined using slot attention to generate temporal semantic embeddings.
arXiv Detail & Related papers (2024-11-01T15:54:07Z) - Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events.
Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
arXiv Detail & Related papers (2024-07-28T02:42:36Z) - Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records [1.6609516435725236]
We introduce a dynamic embedding and tokenization framework for precise representation of multimodal clinical time series.
Our framework outperformed baseline approaches on the task of predicting the occurrence of nine postoperative complications.
arXiv Detail & Related papers (2024-03-06T19:46:44Z) - A Poisson-Gamma Dynamic Factor Model with Time-Varying Transition Dynamics [51.147876395589925]
A non-stationary PGDS is proposed to allow the underlying transition matrices to evolve over time.
A fully-conjugate and efficient Gibbs sampler is developed to perform posterior simulation.
Experiments show that, in comparison with related models, the proposed non-stationary PGDS achieves improved predictive performance.
arXiv Detail & Related papers (2024-02-26T04:39:01Z) - MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
This paper aims at a unified deep learning approach to predict patient prognosis and therapy response.
We formalize the prognosis modeling as a multi-modal asynchronous time series classification task.
Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
arXiv Detail & Related papers (2020-10-08T15:30:17Z) - Statistical control for spatio-temporal MEG/EEG source imaging with
desparsified multi-task Lasso [102.84915019938413]
Non-invasive techniques like magnetoencephalography (MEG) or electroencephalography (EEG) offer promise of non-invasive techniques.
The problem of source localization, or source imaging, poses however a high-dimensional statistical inference challenge.
We propose an ensemble of desparsified multi-task Lasso (ecd-MTLasso) to deal with this problem.
arXiv Detail & Related papers (2020-09-29T21:17:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.