Multimodal Deep Learning for Prediction of Progression-Free Survival in Patients with Neuroendocrine Tumors Undergoing 177Lu-based Peptide Receptor Radionuclide Therapy

• URL: http://arxiv.org/abs/2511.05169v1
• Date: Fri, 07 Nov 2025 11:39:21 GMT
• Title: Multimodal Deep Learning for Prediction of Progression-Free Survival in Patients with Neuroendocrine Tumors Undergoing 177Lu-based Peptide Receptor Radionuclide Therapy
• Authors: Simon Baur, Tristan Ruhwedel, Ekin Böke, Zuzanna Kobus, Gergana Lishkova, Christoph Wetz, Holger Amthauer, Christoph Roderburg, Frank Tacke, Julian M. Rogasch, Wojciech Samek, Henning Jann, Jackie Ma, Johannes Eschrich,
• Abstract summary: This study evaluates laboratory, imaging, and multimodal deep learning models for progression-free survival prediction.<n>Deep learning combining SR-PET, CT, and laboratory biomarkers outperformed unimodal approaches for PFS prediction after PRRT.
• Score: 10.117950929876303
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Peptide receptor radionuclide therapy (PRRT) is an established treatment for metastatic neuroendocrine tumors (NETs), yet long-term disease control occurs only in a subset of patients. Predicting progression-free survival (PFS) could support individualized treatment planning. This study evaluates laboratory, imaging, and multimodal deep learning models for PFS prediction in PRRT-treated patients. In this retrospective, single-center study 116 patients with metastatic NETs undergoing 177Lu-DOTATOC were included. Clinical characteristics, laboratory values, and pretherapeutic somatostatin receptor positron emission tomography/computed tomographies (SR-PET/CT) were collected. Seven models were trained to classify low- vs. high-PFS groups, including unimodal (laboratory, SR-PET, or CT) and multimodal fusion approaches. Explainability was evaluated by feature importance analysis and gradient maps. Forty-two patients (36%) had short PFS (< 1 year), 74 patients long PFS (>1 year). Groups were similar in most characteristics, except for higher baseline chromogranin A (p = 0.003), elevated gamma-GT (p = 0.002), and fewer PRRT cycles (p < 0.001) in short-PFS patients. The Random Forest model trained only on laboratory biomarkers reached an AUROC of 0.59 +- 0.02. Unimodal three-dimensional convolutional neural networks using SR-PET or CT performed worse (AUROC 0.42 +- 0.03 and 0.54 +- 0.01, respectively). A multimodal fusion model laboratory values, SR-PET, and CT -augmented with a pretrained CT branch - achieved the best results (AUROC 0.72 +- 0.01, AUPRC 0.80 +- 0.01). Multimodal deep learning combining SR-PET, CT, and laboratory biomarkers outperformed unimodal approaches for PFS prediction after PRRT. Upon external validation, such models may support risk-adapted follow-up strategies.

Related papers

• Predicting Neoadjuvant Chemotherapy Response in Triple-Negative Breast Cancer Using Pre-Treatment Histopathologic Images [2.23127246021293]
  Triple-negative breast cancer (TNBC) remains a major clinical challenge due to its aggressive behavior and lack of targeted therapies.<n>We present an attention-based multiple instance learning framework designed to predict pathologic complete response (pCR) directly from pre-treatment hematoxylin and eosin (H&E)-stained biopsy slides.
  arXiv  Detail & Related papers  (2025-05-20T02:06:34Z)
• Semi-Supervised Learning for Dose Prediction in Targeted Radionuclide: A Synthetic Data Study [42.75913504373651]
  Targeted Radionuclide Therapy (TRT) is a modern strategy in radiation oncology that aims to administer a potent radiation dose specifically to cancer cells.<n>Deep learning holds promise for personalizing TRT doses.<n>Current methods require large time series of SPECT imaging, which is hardly achievable in routine clinical practice.
  arXiv  Detail & Related papers  (2025-03-07T12:21:09Z)
• Recurrence-Free Survival Prediction for Anal Squamous Cell Carcinoma Chemoradiotherapy using Planning CT-based Radiomics Model [5.485361086613949]
  Approximately 30% of non-metastatic anal squamous cell carcinoma (A SCC) patients will experience recurrence after chemotherapy (CRT) We developed a model leveraging information extracted from radiation pretreatment planning CT to predict recurrence-free survival (RFS) in A SCC patients after CRT.
  arXiv  Detail & Related papers  (2023-09-05T20:22:26Z)
• Neural Network-Based Histologic Remission Prediction In Ulcerative Colitis [38.150634108667774]
  Histologic remission is a new therapeutic target in ulcerative colitis (UC) Endocytoscopy (EC) is a novel ultra-high magnification endoscopic technique. We propose a neural network model that can assess histological disease activity in EC images.
  arXiv  Detail & Related papers  (2023-08-28T15:54:14Z)
• Improved Prognostic Prediction of Pancreatic Cancer Using Multi-Phase CT by Integrating Neural Distance and Texture-Aware Transformer [37.55853672333369]
  This paper proposes a novel learnable neural distance that describes the precise relationship between the tumor and vessels in CT images of different patients. The developed risk marker was the strongest predictor of overall survival among preoperative factors.
  arXiv  Detail & Related papers  (2023-08-01T12:46:02Z)
• Prediction of Rapid Early Progression and Survival Risk with Pre-Radiation MRI in WHO Grade 4 Glioma Patients [0.5365740459403827]
  We investigate the potential of ra-diomics, sophisticated multi-resolution fractal texture features, and different molecular features as a diagnostic and prognostic tool for prediction of REP from non-REP cases. The prediction of survival for the patients cohort produces precision of 0.881 with standard deviation of 0.056. The experimental result further shows that mul-ti-resolution fractal texture features perform better than conventional radiomics features for REP and survival outcomes.
  arXiv  Detail & Related papers  (2023-06-28T20:03:18Z)
• Risk Classification of Brain Metastases via Radiomics, Delta-Radiomics and Machine Learning [7.165205048529115]
  We hypothesized that using radiomics and machine learning (ML), metastases at high risk for subsequent progression could be identified during follow-up prior to the onset of significant tumor growth. The classification is realized via the maximum-relevance minimal-redundancy (MRMR) technique and support vector machines (SVM) The results indicate that risk stratification of BM based on radiomics and machine learning during post-SRT follow-up is possible with good accuracy and should be further pursued to personalize and improve post-SRT follow-up.
  arXiv  Detail & Related papers  (2023-02-17T10:55:18Z)
• Deep-Learning Tool for Early Identifying Non-Traumatic Intracranial Hemorrhage Etiology based on CT Scan [40.51754649947294]
  The deep learning model was developed with 1868 eligible NCCT scans with non-traumatic ICH collected between January 2011 and April 2018. The model's diagnostic performance was compared with clinicians's performance. The clinicians achieve significant improvements in the sensitivity, specificity, and accuracy of diagnoses of certain hemorrhage etiologies with proposed system augmentation.
  arXiv  Detail & Related papers  (2023-02-02T08:45:17Z)
• Modeling of Textures to Predict Immune Cell Status and Survival of Brain Tumour Patients [4.542148087324063]
  Radiomics has shown a capability for different types of cancers such as glioma to predict the clinical outcome. We aim to predict the immune marker status (low versus high) and overall survival for glioma patients using deep radiomic features (DRFs) Our experiments are performed to assess the relationship between the proposed DRFs, three immune cell markers (Macrophage M1, Neutrophils and T Cells Follicular Helper) and measure their association with overall survival.
  arXiv  Detail & Related papers  (2022-06-04T03:52:12Z)
• Controlling False Positive/Negative Rates for Deep-Learning-Based Prostate Cancer Detection on Multiparametric MR images [58.85481248101611]
  We propose a novel PCa detection network that incorporates a lesion-level cost-sensitive loss and an additional slice-level loss based on a lesion-to-slice mapping function. Our experiments based on 290 clinical patients concludes that 1) The lesion-level FNR was effectively reduced from 0.19 to 0.10 and the lesion-level FPR was reduced from 1.03 to 0.66 by changing the lesion-level cost.
  arXiv  Detail & Related papers  (2021-06-04T09:51:27Z)
• Prediction of 5-year Progression-Free Survival in Advanced Nasopharyngeal Carcinoma with Pretreatment PET/CT using Multi-Modality Deep Learning-based Radiomics [15.386240118882569]
  We developed an end-to-end multi-modality DLR model to predict 5-year Progression-Free Survival in advanced NPC. A 3D Convolutional Neural Network (CNN) was optimized to extract deep features from pretreatment multi-modality PET/CT images. Our study identified potential radiomics-based prognostic model for survival prediction in advanced NPC, and suggests that DLR could serve as a tool for aiding in cancer management.
  arXiv  Detail & Related papers  (2021-03-09T04:43:33Z)
• Automated Quantification of CT Patterns Associated with COVID-19 from Chest CT [48.785596536318884]
  The proposed method takes as input a non-contrasted chest CT and segments the lesions, lungs, and lobes in three dimensions. The method outputs two combined measures of the severity of lung and lobe involvement, quantifying both the extent of COVID-19 abnormalities and presence of high opacities. Evaluation of the algorithm is reported on CTs of 200 participants (100 COVID-19 confirmed patients and 100 healthy controls) from institutions from Canada, Europe and the United States.
  arXiv  Detail & Related papers  (2020-04-02T21:49:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.