Ensemble-Based Survival Models with the Self-Attended Beran Estimator Predictions

• URL: http://arxiv.org/abs/2506.07933v1
• Date: Mon, 09 Jun 2025 16:53:25 GMT
• Title: Ensemble-Based Survival Models with the Self-Attended Beran Estimator Predictions
• Authors: Lev V. Utkin, Semen P. Khomets, Vlada A. Efremenko, Andrei V. Konstantinov, Natalya M. Verbova,
• Abstract summary: We propose SurvBESA (Survival Beran Estimators Self-Attended), a novel ensemble model that combines Beran estimators with a self-attention mechanism.<n>Unlike traditional methods, SurvBESA applies self-attention to predicted survival functions, smoothing out noise by adjusting each survival function.<n> Numerical experiments show that SurvBESA outperforms state-of-the-art models.
• Score: 1.88743314507114
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Survival analysis predicts the time until an event of interest, such as failure or death, but faces challenges due to censored data, where some events remain unobserved. Ensemble-based models, like random survival forests and gradient boosting, are widely used but can produce unstable predictions due to variations in bootstrap samples. To address this, we propose SurvBESA (Survival Beran Estimators Self-Attended), a novel ensemble model that combines Beran estimators with a self-attention mechanism. Unlike traditional methods, SurvBESA applies self-attention to predicted survival functions, smoothing out noise by adjusting each survival function based on its similarity to neighboring survival functions. We also explore a special case using Huber's contamination model to define attention weights, simplifying training to a quadratic or linear optimization problem. Numerical experiments show that SurvBESA outperforms state-of-the-art models. The implementation of SurvBESA is publicly available.

Related papers

• Survival Analysis as Imprecise Classification with Trainable Kernels [2.2120851074630177]
  iSurvM, iSurvQ, and iSurvJ combine imprecise probability theory with attention mechanisms to handle censored data without parametric assumptions.<n>Experiments on synthetic and real datasets demonstrate that the proposed models consistently outperform the Beran estimator from the accuracy and computational complexity points of view.
  arXiv  Detail & Related papers  (2025-06-11T19:40:09Z)
• Rashomon perspective for measuring uncertainty in the survival predictive maintenance models [0.0]
  The prediction of the Remaining Useful Life of aircraft engines is a critical area in high-reliability sectors such as aerospace and defense.<n>Traditional regression models struggle with censored data, which can lead to biased predictions.<n>Survival models, on the other hand, effectively handle censored data, improving predictive accuracy in maintenance processes.
  arXiv  Detail & Related papers  (2025-02-16T13:36:56Z)
• SurvBETA: Ensemble-Based Survival Models Using Beran Estimators and Several Attention Mechanisms [2.024925013349319]
  We propose a new ensemble-based model called SurvBETA (the Survival Beran estimator Ensemble using Three Attention mechanisms)<n>The proposed model is presented in two forms: in a general form requiring to solve a complex optimization problem for its training; and in a simplified form by considering a special representation of the attention weights.
  arXiv  Detail & Related papers  (2024-12-10T16:17:38Z)
• Predictive Churn with the Set of Good Models [61.00058053669447]
  This paper explores connections between two seemingly unrelated concepts of predictive inconsistency.<n>The first, known as predictive multiplicity, occurs when models that perform similarly produce conflicting predictions for individual samples.<n>The second concept, predictive churn, examines the differences in individual predictions before and after model updates.
  arXiv  Detail & Related papers  (2024-02-12T16:15:25Z)
• Interpretable Survival Analysis for Heart Failure Risk Prediction [50.64739292687567]
  We propose a novel survival analysis pipeline that is both interpretable and competitive with state-of-the-art survival models. Our pipeline achieves state-of-the-art performance and provides interesting and novel insights about risk factors for heart failure.
  arXiv  Detail & Related papers  (2023-10-24T02:56:05Z)
• Copula-Based Deep Survival Models for Dependent Censoring [10.962520289040336]
  This paper presents a parametric model of survival that extends modern non-linear survival analysis by relaxing the assumption of conditional independence. On synthetic and semi-synthetic data, our approach significantly improves estimates of survival distributions compared to the standard that assumes conditional independence in the data.
  arXiv  Detail & Related papers  (2023-06-20T21:51:13Z)
• Learning Survival Distribution with Implicit Survival Function [15.588273962274393]
  We propose Implicit Survival Function (ISF) based on Implicit Neural Representation for survival distribution estimation without strong assumptions. Experimental results show ISF outperforms the state-of-the-art methods in three public datasets.
  arXiv  Detail & Related papers  (2023-05-24T02:51:29Z)
• SurvivalGAN: Generating Time-to-Event Data for Survival Analysis [121.84429525403694]
  Imbalances in censoring and time horizons cause generative models to experience three new failure modes specific to survival analysis. We propose SurvivalGAN, a generative model that handles survival data by addressing the imbalance in the censoring and event horizons. We evaluate this method via extensive experiments on medical datasets.
  arXiv  Detail & Related papers  (2023-02-24T17:03:51Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)
• Improving Maximum Likelihood Training for Text Generation with Density Ratio Estimation [51.091890311312085]
  We propose a new training scheme for auto-regressive sequence generative models, which is effective and stable when operating at large sample space encountered in text generation. Our method stably outperforms Maximum Likelihood Estimation and other state-of-the-art sequence generative models in terms of both quality and diversity.
  arXiv  Detail & Related papers  (2020-07-12T15:31:24Z)
• A General Framework for Survival Analysis and Multi-State Modelling [70.31153478610229]
  We use neural ordinary differential equations as a flexible and general method for estimating multi-state survival models. We show that our model exhibits state-of-the-art performance on popular survival data sets and demonstrate its efficacy in a multi-state setting.
  arXiv  Detail & Related papers  (2020-06-08T19:24:54Z)
• Uncertainty Estimation in Cancer Survival Prediction [8.827764645115955]
  Survival models are used in various fields, such as the development of cancer treatment protocols. We propose a Bayesian framework for survival models that not only gives more accurate survival predictions but also quantifies the survival uncertainty better. Our approach is a novel combination of variational inference for uncertainty estimation, neural multi-task logistic regression for estimating nonlinear and time-varying risk models, and an additional sparsity-inducing prior to work with high dimensional data.
  arXiv  Detail & Related papers  (2020-03-19T05:08:01Z)
• Survival Cluster Analysis [93.50540270973927]
  There is an unmet need in survival analysis for identifying subpopulations with distinct risk profiles. An approach that addresses this need is likely to improve characterization of individual outcomes.
  arXiv  Detail & Related papers  (2020-02-29T22:41:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.