Multimodal Deep Learning for Personalized Renal Cell Carcinoma Prognosis: Integrating CT Imaging and Clinical Data

• URL: http://arxiv.org/abs/2307.03575v1
• Date: Fri, 7 Jul 2023 13:09:07 GMT
• Title: Multimodal Deep Learning for Personalized Renal Cell Carcinoma Prognosis: Integrating CT Imaging and Clinical Data
• Authors: Maryamalsadat Mahootiha, Hemin Ali Qadir, Jacob Bergsland and Ilangko Balasingham
• Abstract summary: Renal cell carcinoma represents a significant global health challenge with a low survival rate. This research aimed to devise a comprehensive deep-learning model capable of predicting survival probabilities in patients with renal cell carcinoma. The proposed framework comprises three modules: a 3D image feature extractor, clinical variable selection, and survival prediction.
• Score: 3.790959613880792
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Renal cell carcinoma represents a significant global health challenge with a low survival rate. This research aimed to devise a comprehensive deep-learning model capable of predicting survival probabilities in patients with renal cell carcinoma by integrating CT imaging and clinical data and addressing the limitations observed in prior studies. The aim is to facilitate the identification of patients requiring urgent treatment. The proposed framework comprises three modules: a 3D image feature extractor, clinical variable selection, and survival prediction. The feature extractor module, based on the 3D CNN architecture, predicts the ISUP grade of renal cell carcinoma tumors linked to mortality rates from CT images. A selection of clinical variables is systematically chosen using the Spearman score and random forest importance score as criteria. A deep learning-based network, trained with discrete LogisticHazard-based loss, performs the survival prediction. Nine distinct experiments are performed, with varying numbers of clinical variables determined by different thresholds of the Spearman and importance scores. Our findings demonstrate that the proposed strategy surpasses the current literature on renal cancer prognosis based on CT scans and clinical factors. The best-performing experiment yielded a concordance index of 0.84 and an area under the curve value of 0.8 on the test cohort, which suggests strong predictive power. The multimodal deep-learning approach developed in this study shows promising results in estimating survival probabilities for renal cell carcinoma patients using CT imaging and clinical data. This may have potential implications in identifying patients who require urgent treatment, potentially improving patient outcomes. The code created for this project is available for the public on: \href{https://github.com/Balasingham-AI-Group/Survival_CTplusClinical}{GitHub}

Related papers

• Lung-CADex: Fully automatic Zero-Shot Detection and Classification of Lung Nodules in Thoracic CT Images [45.29301790646322]
  Computer-aided diagnosis can help with early lung nodul detection and facilitate subsequent nodule characterization. We propose CADe, for segmenting lung nodules in a zero-shot manner using a variant of the Segment Anything Model called MedSAM. We also propose, CADx, a method for the nodule characterization as benign/malignant by making a gallery of radiomic features and aligning image-feature pairs through contrastive learning.
  arXiv  Detail & Related papers  (2024-07-02T19:30:25Z)
• Survival Prediction Across Diverse Cancer Types Using Neural Networks [40.392772795903795]
  Gastric cancer and Colon adenocarcinoma represent widespread and challenging malignancies. Medical community has embraced the 5-year survival rate as a vital metric for estimating patient outcomes. This study introduces a pioneering approach to enhance survival prediction models for gastric and Colon adenocarcinoma patients.
  arXiv  Detail & Related papers  (2024-04-11T21:47:13Z)
• Predicting risk of cardiovascular disease using retinal OCT imaging [40.71667870702634]
  We investigated the potential of optical coherence tomography as an additional imaging technique to predict future cardiovascular disease (CVD) We utilised a self-supervised deep learning approach based on Variational Autoencoders (VAE) to learn low-dimensional representations of high-dimensional 3D OCT images. The choroidal layer visible in OCT images was identified as an important predictor of future CVD events using a novel approach to model explanability.
  arXiv  Detail & Related papers  (2024-03-26T14:42:46Z)
• Improved Prognostic Prediction of Pancreatic Cancer Using Multi-Phase CT by Integrating Neural Distance and Texture-Aware Transformer [37.55853672333369]
  This paper proposes a novel learnable neural distance that describes the precise relationship between the tumor and vessels in CT images of different patients. The developed risk marker was the strongest predictor of overall survival among preoperative factors.
  arXiv  Detail & Related papers  (2023-08-01T12:46:02Z)
• Pathology-and-genomics Multimodal Transformer for Survival Outcome Prediction [43.1748594898772]
  We propose a multimodal transformer (PathOmics) integrating pathology and genomics insights into colon-related cancer survival prediction. We emphasize the unsupervised pretraining to capture the intrinsic interaction between tissue microenvironments in gigapixel whole slide images. We evaluate our approach on both TCGA colon and rectum cancer cohorts, showing that the proposed approach is competitive and outperforms state-of-the-art studies.
  arXiv  Detail & Related papers  (2023-07-22T00:59:26Z)
• Penalized Deep Partially Linear Cox Models with Application to CT Scans of Lung Cancer Patients [42.09584755334577]
  Lung cancer is a leading cause of cancer mortality globally, highlighting the importance of understanding its mortality risks to design effective therapies. The National Lung Screening Trial (NLST) employed computed tomography texture analysis to quantify the mortality risks of lung cancer patients. We propose a novel Penalized Deep Partially Linear Cox Model (Penalized DPLC), which incorporates the SCAD penalty to select important texture features and employs a deep neural network to estimate the nonparametric component of the model.
  arXiv  Detail & Related papers  (2023-03-09T15:38:16Z)
• Domain-specific transfer learning in the automated scoring of tumor-stroma ratio from histopathological images of colorectal cancer [1.2264932946286657]
  Tumor-stroma ratio (TSR) is a prognostic factor for many types of solid tumors. The method is based on convolutional neural networks which were trained to classify colorectal cancer tissue.
  arXiv  Detail & Related papers  (2022-12-30T12:27:27Z)
• Using Deep Learning-based Features Extracted from CT scans to Predict Outcomes in COVID-19 Patients [0.4841303207359715]
  A novel methodology is proposed by combining multi-modal features, extracted from Computed Tomography (CT) scans and Electronic Health Record (EHR) data. Deep learning models are leveraged to extract quantitative features from CT scans. These features combined with those directly read from the EHR database are fed into machine learning models to eventually output the probabilities of patient outcomes.
  arXiv  Detail & Related papers  (2022-05-10T16:22:16Z)
• Survival Analysis for Idiopathic Pulmonary Fibrosis using CT Images and Incomplete Clinical Data [17.162038700963418]
  Idiopathic Pulmonary Fibrosis (IPF) is an inexorably progressive fibrotic lung disease with a variable and unpredictable rate of progression. CT scans of the lungs inform clinical assessment of IPF patients and contain pertinent information related to disease progression. We propose a multi-modal method that uses neural networks and memory banks to predict the survival of IPF patients using clinical and imaging data.
  arXiv  Detail & Related papers  (2022-03-21T23:48:47Z)
• Integrative Analysis for COVID-19 Patient Outcome Prediction [53.11258640541513]
  We combine radiomics of lung opacities and non-imaging features from demographic data, vital signs, and laboratory findings to predict need for intensive care unit admission. Our methods may also be applied to other lung diseases including but not limited to community acquired pneumonia.
  arXiv  Detail & Related papers  (2020-07-20T19:08:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.