Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning

• URL: http://arxiv.org/abs/2506.02327v1
• Date: Mon, 02 Jun 2025 23:50:40 GMT
• Title: Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning
• Authors: Yijun Yang, Zhao-Yang Wang, Qiuping Liu, Shuwen Sun, Kang Wang, Rama Chellappa, Zongwei Zhou, Alan Yuille, Lei Zhu, Yu-Dong Zhang, Jieneng Chen,
• Abstract summary: We introduce the Medical World Model (MeWM), the first world model in medicine that visually predicts future disease states based on clinical decisions.<n>MeWM comprises (i) vision-language models to serve as policy models, and (ii) tumor generative models as dynamics models.<n>We propose the inverse dynamics model that applies survival analysis to the simulated post-treatment tumor, enabling the evaluation of treatment efficacy and the selection of the optimal clinical action plan.
• Score: 50.16114813279694
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Providing effective treatment and making informed clinical decisions are essential goals of modern medicine and clinical care. We are interested in simulating disease dynamics for clinical decision-making, leveraging recent advances in large generative models. To this end, we introduce the Medical World Model (MeWM), the first world model in medicine that visually predicts future disease states based on clinical decisions. MeWM comprises (i) vision-language models to serve as policy models, and (ii) tumor generative models as dynamics models. The policy model generates action plans, such as clinical treatments, while the dynamics model simulates tumor progression or regression under given treatment conditions. Building on this, we propose the inverse dynamics model that applies survival analysis to the simulated post-treatment tumor, enabling the evaluation of treatment efficacy and the selection of the optimal clinical action plan. As a result, the proposed MeWM simulates disease dynamics by synthesizing post-treatment tumors, with state-of-the-art specificity in Turing tests evaluated by radiologists. Simultaneously, its inverse dynamics model outperforms medical-specialized GPTs in optimizing individualized treatment protocols across all metrics. Notably, MeWM improves clinical decision-making for interventional physicians, boosting F1-score in selecting the optimal TACE protocol by 13%, paving the way for future integration of medical world models as the second readers.

Related papers

• Transforming Multimodal Models into Action Models for Radiotherapy [39.682133213072554]
  Radiotherapy a crucial cancer treatment demands precise planning to balance tumor preservation and eradication of healthy tissue.<n>Traditional treatment planning (TP) is iterative, time-consuming, and reliant on human expertise.<n>We propose a novel framework to transform a multimodal foundation model (MLM) into an action model for using a few-shot reinforcement learning approach.
  arXiv  Detail & Related papers  (2025-02-06T09:51:28Z)
• Modality-Projection Universal Model for Comprehensive Full-Body Medical Imaging Segmentation [11.395596488197098]
  This study introduces and evaluate a Modality Projection Universal Model (MPUM)<n>MPUM employs a novel modality-projection strategy, which allows the model to dynamically adjust its parameters to optimize performance across different imaging modalities.<n>MPUM's unique controller-based convolution layer enables visualization of saliency maps across all network layers, significantly enhancing the model's interpretability.
  arXiv  Detail & Related papers  (2024-12-26T02:23:27Z)
• Physics-Regularized Multi-Modal Image Assimilation for Brain Tumor Localization [3.666412718346211]
  We introduce a novel method that integrates data-driven and physics-based cost functions. We propose a unique discretization scheme that quantifies how well the learned distributions of tumor and brain tissues adhere to their respective growth and elasticity equations.
  arXiv  Detail & Related papers  (2024-09-30T15:36:14Z)
• Integration of Graph Neural Network and Neural-ODEs for Tumor Dynamic Prediction [4.850774880198265]
  We propose a graph encoder that utilizes a bipartite Graph Convolutional Neural network (GCN) combined with Neural Ordinary Differential Equations (Neural-ODEs) We first show that the methodology is able to discover a tumor dynamic model that significantly improves upon an empirical model. Our findings indicate that the methodology holds significant promise and offers potential applications in pre-clinical settings.
  arXiv  Detail & Related papers  (2023-10-02T06:39:08Z)
• Patient-specific, mechanistic models of tumor growth incorporating artificial intelligence and big data [2.6144463801364375]
  Malignant tumors remain a major public health problem. Design of personalized therapies requires patient-specific information integrated into an appropriate mathematical model. Current lack of a rigorous, yet practical, mathematical theory of tumor initiation, development, invasion, and response to therapy.
  arXiv  Detail & Related papers  (2023-08-28T22:52:17Z)
• Prediction of Post-Operative Renal and Pulmonary Complications Using Transformers [69.81176740997175]
  We evaluate the performance of transformer-based models in predicting postoperative acute renal failure, pulmonary complications, and postoperative in-hospital mortality. Our results demonstrate that transformer-based models can achieve superior performance in predicting postoperative complications and outperform traditional machine learning models.
  arXiv  Detail & Related papers  (2023-06-01T14:08:05Z)
• A multi-stage machine learning model on diagnosis of esophageal manometry [50.591267188664666]
  The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage. This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
  arXiv  Detail & Related papers  (2021-06-25T20:09:23Z)
• Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records [57.75125067744978]
  We propose a data augmentation method to facilitate domain adaptation. adversarially generated samples are used during domain adaptation. Results confirm the effectiveness of our method and the generality on different tasks.
  arXiv  Detail & Related papers  (2021-01-13T03:20:20Z)
• An Optimal Control Approach to Learning in SIDARTHE Epidemic model [67.22168759751541]
  We propose a general approach for learning time-variant parameters of dynamic compartmental models from epidemic data. We forecast the epidemic evolution in Italy and France.
  arXiv  Detail & Related papers  (2020-10-28T10:58:59Z)
• MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
  This paper aims at a unified deep learning approach to predict patient prognosis and therapy response. We formalize the prognosis modeling as a multi-modal asynchronous time series classification task. Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
  arXiv  Detail & Related papers  (2020-10-08T15:30:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.