Multimodal classification of Radiation-Induced Contrast Enhancements and tumor recurrence using deep learning

• URL: http://arxiv.org/abs/2603.11827v1
• Date: Thu, 12 Mar 2026 11:48:22 GMT
• Title: Multimodal classification of Radiation-Induced Contrast Enhancements and tumor recurrence using deep learning
• Abstract summary: RICE-NET is a multimodal 3D deep learning model that integrates longitudinal MRI data with radiotherapy dose distributions for automated lesion classification.<n>During ablation experiments, we quantified the contribution of each timepoint and modality and showed that reliable classification largely depends on the radiation map.
• Score: 0.23179411766464517
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The differentiation between tumor recurrence and radiation-induced contrast enhancements in post-treatment glioblastoma patients remains a major clinical challenge. Existing approaches rely on clinically sparsely available diffusion MRI or do not consider radiation maps, which are gaining increasing interest in the tumor board for this differentiation. We introduce RICE-NET, a multimodal 3D deep learning model that integrates longitudinal MRI data with radiotherapy dose distributions for automated lesion classification using conventional T1-weighted MRI data. Using a cohort of 92 patients, the model achieved an F1 score of 0.92 on an independent test set. During extensive ablation experiments, we quantified the contribution of each timepoint and modality and showed that reliable classification largely depends on the radiation map. Occlusion-based interpretability analyses further confirmed the model's focus on clinically relevant regions. These findings highlight the potential of multimodal deep learning to enhance diagnostic accuracy and support clinical decision-making in neuro-oncology.

Related papers

• A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data [50.52606847963128]
  We developed BrainVLM to classify all 12 World Health Organization (WHO) 2021 brain tumor types.<n>BrainVLM was trained on multi-modal data (MRI scans, demographics, and radiology reports) from 40,043 individuals.<n>It was validated on 5,211 patients with pathologically confirmed brain tumors.
  arXiv  Detail & Related papers  (2026-09-15T03:46:03Z)
• Dual-Modal Lung Cancer AI: Interpretable Radiology and Microscopy with Clinical Risk Integration [0.0]
  This study proposes a dual-modal artificial intelligence framework that integrates CT radiology with hematoxylin and eosin histopathology for lung cancer diagnosis and subtype classification.<n>The system employs convolutional neural networks to extract radiologic and histopathologic features and incorporates clinical metadata to improve robustness.<n> Experimental results show strong performance with accuracy up to 0.87, AUROC above 0.97, and macro F1-score of 0.88.
  arXiv  Detail & Related papers  (2026-04-17T14:37:54Z)
• Closing the Performance Gap Between AI and Radiologists in Chest X-Ray Reporting [40.40577855417923]
  We introduce MAIRA-X, a clinically evaluated multimodal AI model for longitudinal chest X-ray report generation.<n>A novel L&T-specific metrics framework was developed to assess accuracy in reporting attributes such as type, longitudinal change and placement.<n>Our results suggest MAIRA-X can effectively assist radiologists, particularly in high-volume clinical settings.
  arXiv  Detail & Related papers  (2025-11-21T10:53:26Z)
• Towards Label-Free Brain Tumor Segmentation: Unsupervised Learning with Multimodal MRI [7.144319861722029]
  Unsupervised anomaly detection (UAD) presents a complementary alternative to supervised learning for brain tumor segmentation in MRI.<n>We propose a novel Multimodal Vision Transformer Autoencoder (MViT-AE) trained exclusively on healthy brain MRIs to detect and localize tumors.<n>Our method achieves clinically meaningful tumor localization, with lesion-wise Dice Similarity Coefficient of 0.437 (Whole Tumor), 0.316 (Tumor Core), and 0.350 (Enhancing Tumor) on the test set, and an anomaly Detection Rate of 89.4% on the validation set.
  arXiv  Detail & Related papers  (2025-10-17T14:26:30Z)
• AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scans [43.06293430764841]
  This study presents an innovative method for Alzheimer's disease diagnosis using 3D MRI designed to enhance the explainability of model decisions. Our approach adopts a soft attention mechanism, enabling 2D CNNs to extract volumetric representations. With voxel-level precision, our method identified which specific areas are being paid attention to, identifying these predominant brain regions.
  arXiv  Detail & Related papers  (2024-07-02T16:44:00Z)
• Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading [47.50733518140625]
  Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
  arXiv  Detail & Related papers  (2024-01-17T07:54:49Z)
• Radiomics Boosts Deep Learning Model for IPMN Classification [3.4659499358648675]
  Intraductal Papillary Mucinous Neoplasm (IPMN) cysts are pre-malignant pancreas lesions, and they can progress into pancreatic cancer. In this study, we propose a novel computer-aided diagnosis pipeline for IPMN risk classification from MRI scans.
  arXiv  Detail & Related papers  (2023-09-11T22:41:52Z)
• Improved Prognostic Prediction of Pancreatic Cancer Using Multi-Phase CT by Integrating Neural Distance and Texture-Aware Transformer [37.55853672333369]
  This paper proposes a novel learnable neural distance that describes the precise relationship between the tumor and vessels in CT images of different patients. The developed risk marker was the strongest predictor of overall survival among preoperative factors.
  arXiv  Detail & Related papers  (2023-08-01T12:46:02Z)
• Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification [42.75911994044675]
  We present a novel approach for unpaired image-to-image translation of prostate MRIs and an uncertainty-aware training approach for classifying clinically significant PCa. Our approach involves a novel pipeline for translating unpaired 3.0T multi-parametric prostate MRIs to 1.5T, thereby augmenting the available training data. Our experiments demonstrate that the proposed method significantly improves the Area Under ROC Curve (AUC) by over 20% compared to the previous work.
  arXiv  Detail & Related papers  (2023-07-02T05:26:54Z)
• Risk Classification of Brain Metastases via Radiomics, Delta-Radiomics and Machine Learning [7.165205048529115]
  We hypothesized that using radiomics and machine learning (ML), metastases at high risk for subsequent progression could be identified during follow-up prior to the onset of significant tumor growth. The classification is realized via the maximum-relevance minimal-redundancy (MRMR) technique and support vector machines (SVM) The results indicate that risk stratification of BM based on radiomics and machine learning during post-SRT follow-up is possible with good accuracy and should be further pursued to personalize and improve post-SRT follow-up.
  arXiv  Detail & Related papers  (2023-02-17T10:55:18Z)
• Deep-Learning Tool for Early Identifying Non-Traumatic Intracranial Hemorrhage Etiology based on CT Scan [40.51754649947294]
  The deep learning model was developed with 1868 eligible NCCT scans with non-traumatic ICH collected between January 2011 and April 2018. The model's diagnostic performance was compared with clinicians's performance. The clinicians achieve significant improvements in the sensitivity, specificity, and accuracy of diagnoses of certain hemorrhage etiologies with proposed system augmentation.
  arXiv  Detail & Related papers  (2023-02-02T08:45:17Z)
• RadioPathomics: Multimodal Learning in Non-Small Cell Lung Cancer for Adaptive Radiotherapy [1.8161758803237067]
  We develop a multimodal late fusion approach to predict radiation therapy outcomes for non-small-cell lung cancer patients. Experiments show that the proposed multimodal paradigm with an AUC equal to $90.9%$ outperforms each unimodal approach.
  arXiv  Detail & Related papers  (2022-04-26T16:32:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.