DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis

• URL: http://arxiv.org/abs/2106.06744v1
• Date: Sat, 12 Jun 2021 11:02:14 GMT
• Title: DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis
• Authors: Yujiao Wu, Jie Ma, Xiaoshui Huang, Sai Ho Ling, and Steven Weidong Su
• Abstract summary: We propose a multimodal deep learning method for non-small cell lung cancer (NSCLC) survival analysis, named DeepMMSA. This method leverages CT images in combination with clinical data, enabling the abundant information hold within medical images to be associate with lung cancer survival information.
• Score: 8.78724404464036
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied extensively in many real-world applications, including health sectors such as medical image interpretation and disease diagnosis. By combining more modalities that being engaged in the processing of information, multimodal learning can extract better features and improve predictive ability. The conventional methods for lung cancer survival analysis normally utilize clinical data and only provide a statistical probability. To improve the survival prediction accuracy and help prognostic decision-making in clinical practice for medical experts, we for the first time propose a multimodal deep learning method for non-small cell lung cancer (NSCLC) survival analysis, named DeepMMSA. This method leverages CT images in combination with clinical data, enabling the abundant information hold within medical images to be associate with lung cancer survival information. We validate our method on the data of 422 NSCLC patients from The Cancer Imaging Archive (TCIA). Experimental results support our hypothesis that there is an underlying relationship between prognostic information and radiomic images. Besides, quantitative results showing that the established multimodal model can be applied to traditional method and has the potential to break bottleneck of existing methods and increase the the percentage of concordant pairs(right predicted pairs) in overall population by 4%.

Related papers

• xCG: Explainable Cell Graphs for Survival Prediction in Non-Small Cell Lung Cancer [10.515405477496735]
  We present an explainable cell graph (xCG) approach for survival prediction. We validate our model on a public cohort of imaging mass (IMC) data for 416 cases of lung adenocarcinoma.
  arXiv  Detail & Related papers  (2024-11-12T08:53:49Z)
• Improving Lung Cancer Diagnosis and Survival Prediction with Deep Learning and CT Imaging [12.276877277186284]
  Lung cancer is a major cancer-related deaths, and early diagnosis and treatment are crucial for improving patients' survival outcomes. We propose to employ neural convolutional networks of networks obtained between the risk of lung cancer and the lungs in CT experiments. Results demonstrate the effectiveness of both the mini-batched loss and binary cross-entropy to predict both lung cancer and the risk of the occurrence.
  arXiv  Detail & Related papers  (2024-08-18T05:45:08Z)
• Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reports [68.39938936308023]
  We propose a novel text-guided learning method to achieve highly accurate cancer detection results. Our approach can leverage clinical knowledge by large-scale pre-trained VLM to enhance generalization ability.
  arXiv  Detail & Related papers  (2024-05-23T07:03:38Z)
• MMFusion: Multi-modality Diffusion Model for Lymph Node Metastasis Diagnosis in Esophageal Cancer [13.74067035373274]
  We introduce a multi-modal heterogeneous graph-based conditional feature-guided diffusion model for lymph node metastasis diagnosis based on CT images. We propose a masked relational representation learning strategy, aiming to uncover the latent prognostic correlations and priorities of primary tumor and lymph node image representations.
  arXiv  Detail & Related papers  (2024-05-15T17:52:00Z)
• Deep Reinforcement Learning Framework for Thoracic Diseases Classification via Prior Knowledge Guidance [49.87607548975686]
  The scarcity of labeled data for related diseases poses a huge challenge to an accurate diagnosis. We propose a novel deep reinforcement learning framework, which introduces prior knowledge to direct the learning of diagnostic agents. Our approach's performance was demonstrated using the well-known NIHX-ray 14 and CheXpert datasets.
  arXiv  Detail & Related papers  (2023-06-02T01:46:31Z)
• Deep learning methods for drug response prediction in cancer: predominant and emerging trends [50.281853616905416]
  Exploiting computational predictive models to study and treat cancer holds great promise in improving drug development and personalized design of treatment plans. A wave of recent papers demonstrates promising results in predicting cancer response to drug treatments while utilizing deep learning methods. This review allows to better understand the current state of the field and identify major challenges and promising solution paths.
  arXiv  Detail & Related papers  (2022-11-18T03:26:31Z)
• Multimodal Learning for Non-small Cell Lung Cancer Prognosis [10.321835786169894]
  This paper focuses on the task of survival time analysis for lung cancer. Traditional and some deep learning-based survival time analyses for lung cancer are mostly based on textual clinical information. We contribute a smart cross-modality network for survival analysis network named Lite-ProSENet.
  arXiv  Detail & Related papers  (2022-11-07T03:09:47Z)
• Breast Cancer Induced Bone Osteolysis Prediction Using Temporal Variational Auto-Encoders [65.95959936242993]
  We develop a deep learning framework that can accurately predict and visualize the progression of osteolytic bone lesions. It will assist in planning and evaluating treatment strategies to prevent skeletal related events (SREs) in breast cancer patients.
  arXiv  Detail & Related papers  (2022-03-20T21:00:10Z)
• Deep-CR MTLR: a Multi-Modal Approach for Cancer Survival Prediction with Competing Risks [0.4189643331553922]
  We present Deep-CR MTLR -- a novel machine learning approach for accurate cancer survival prediction. We demonstrate improved prognostic performance of the multi-modal approach over single modality predictors in a cohort of 2552 head and neck cancer patients.
  arXiv  Detail & Related papers  (2020-12-10T15:51:47Z)
• Integrative Analysis for COVID-19 Patient Outcome Prediction [53.11258640541513]
  We combine radiomics of lung opacities and non-imaging features from demographic data, vital signs, and laboratory findings to predict need for intensive care unit admission. Our methods may also be applied to other lung diseases including but not limited to community acquired pneumonia.
  arXiv  Detail & Related papers  (2020-07-20T19:08:50Z)
• Diagnosis of Coronavirus Disease 2019 (COVID-19) with Structured Latent Multi-View Representation Learning [48.05232274463484]
  Recently, the outbreak of Coronavirus Disease 2019 (COVID-19) has spread rapidly across the world. Due to the large number of affected patients and heavy labor for doctors, computer-aided diagnosis with machine learning algorithm is urgently needed. In this study, we propose to conduct the diagnosis of COVID-19 with a series of features extracted from CT images.
  arXiv  Detail & Related papers  (2020-05-06T15:19:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.