From Hazard Functions to Language Space: Cox-Supervised Distillation of Survival Risk into a Large Language Model

• URL: http://arxiv.org/abs/2606.08945v1
• Date: Mon, 08 Jun 2026 02:47:05 GMT
• Title: From Hazard Functions to Language Space: Cox-Supervised Distillation of Survival Risk into a Large Language Model
• Abstract summary: We investigate whether information about time-to-event risk can be transferred into a generative large language model.<n>We propose a text-based survival modelling pipeline and a Qwen-based large language model is fine-tuned to generate patient-specific survival risk.
• Score: 0.7537475180985093
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We investigate whether information about time-to-event risk estimated by a Cox proportional hazards model can be transferred into a generative large language model. We propose a text-based survival modelling pipeline in which structured clinical covariates are converted into text prompts and a Qwen-based large language model is fine-tuned to generate patient-specific survival risk using Cox model predictions as a training target. Across GBSG2, ACTG320, and WHAS500, the model achieves competitive held-out discrimination and calibration despite being trained as a text-generation task rather than with a conventional survival-analysis loss. We further analyse the geometry of the model's hidden states, where t-SNE visualisations reveal smooth risk gradients in latent space, suggesting that the model represents survival risk as a continuous structure rather than isolated risk categories. Together, these findings suggest that large language models can internalise survival-risk structure while supporting calibrated prediction, providing a route towards time-to-event reasoning in language models.

Related papers

• Deep Survival Analysis for Competing Risk Modeling with Functional Covariates and Missing Data Imputation [13.108896747775063]
  We introduce the Functional Competing Risk Net (FCRN), a unified deep-learning framework for discrete-time survival analysis under competing risks.<n>By combining a micro-network Basis Layer for functional data representation with a gradient-based imputation module, FCRN simultaneously learns to impute missing values and predict event-specific hazards.
  arXiv  Detail & Related papers  (2025-09-29T18:33:00Z)
• Adaptable Cardiovascular Disease Risk Prediction from Heterogeneous Data using Large Language Models [70.64969663547703]
  AdaCVD is an adaptable CVD risk prediction framework built on large language models extensively fine-tuned on over half a million participants from the UK Biobank.<n>It addresses key clinical challenges across three dimensions: it flexibly incorporates comprehensive yet variable patient information; it seamlessly integrates both structured data and unstructured text; and it rapidly adapts to new patient populations using minimal additional data.
  arXiv  Detail & Related papers  (2025-05-30T14:42:02Z)
• CRISP-NAM: Competing Risks Interpretable Survival Prediction with Neural Additive Models [0.22940141855172033]
  CRISP-NAM is an interpretable neural additive model for competing risks survival analysis.<n>Each feature contributes independently to risk estimation through dedicated neural networks.<n>We demonstrate competitive performance on multiple datasets compared to existing approaches.
  arXiv  Detail & Related papers  (2025-05-27T15:52:15Z)
• Uncertainty-Aware Decoding with Minimum Bayes Risk [70.6645260214115]
  We show how Minimum Bayes Risk decoding, which selects model generations according to an expected risk, can be generalized into a principled uncertainty-aware decoding method.<n>We show that this modified expected risk is useful for both choosing outputs and deciding when to abstain from generation and can provide improvements without incurring overhead.
  arXiv  Detail & Related papers  (2025-03-07T10:55:12Z)
• DPP-Based Adversarial Prompt Searching for Lanugage Models [56.73828162194457]
  Auto-regressive Selective Replacement Ascent (ASRA) is a discrete optimization algorithm that selects prompts based on both quality and similarity with determinantal point process (DPP) Experimental results on six different pre-trained language models demonstrate the efficacy of ASRA for eliciting toxic content.
  arXiv  Detail & Related papers  (2024-03-01T05:28:06Z)
• Interpretable Survival Analysis for Heart Failure Risk Prediction [50.64739292687567]
  We propose a novel survival analysis pipeline that is both interpretable and competitive with state-of-the-art survival models. Our pipeline achieves state-of-the-art performance and provides interesting and novel insights about risk factors for heart failure.
  arXiv  Detail & Related papers  (2023-10-24T02:56:05Z)
• SurvLatent ODE : A Neural ODE based time-to-event model with competing risks for longitudinal data improves cancer-associated Deep Vein Thrombosis (DVT) prediction [68.8204255655161]
  We propose a generative time-to-event model, SurvLatent ODE, which parameterizes a latent representation under irregularly sampled data. Our model then utilizes the latent representation to flexibly estimate survival times for multiple competing events without specifying shapes of event-specific hazard function. SurvLatent ODE outperforms the current clinical standard Khorana Risk scores for stratifying DVT risk groups.
  arXiv  Detail & Related papers  (2022-04-20T17:28:08Z)
• Surrogate Assisted Semi-supervised Inference for High Dimensional Risk Prediction [3.10560974227074]
  We develop a surrogate assisted semi-supervised-learning (SAS) approach to risk modeling with high dimensional predictors. We demonstrate that the SAS procedure provides valid inference for the predicted risk derived from a high dimensional working model.
  arXiv  Detail & Related papers  (2021-05-04T03:08:51Z)
• DeepHazard: neural network for time-varying risks [0.6091702876917281]
  We propose a new flexible method for survival prediction: DeepHazard, a neural network for time-varying risks. Our approach is tailored for a wide range of continuous hazards forms, with the only restriction of being additive in time. Numerical examples illustrate that our approach outperforms existing state-of-the-art methodology in terms of predictive capability evaluated through the C-index metric.
  arXiv  Detail & Related papers  (2020-07-26T21:01:49Z)
• A General Framework for Survival Analysis and Multi-State Modelling [70.31153478610229]
  We use neural ordinary differential equations as a flexible and general method for estimating multi-state survival models. We show that our model exhibits state-of-the-art performance on popular survival data sets and demonstrate its efficacy in a multi-state setting.
  arXiv  Detail & Related papers  (2020-06-08T19:24:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.