Radiomics-enhanced Deep Multi-task Learning for Outcome Prediction in
Head and Neck Cancer
- URL: http://arxiv.org/abs/2211.05409v1
- Date: Thu, 10 Nov 2022 08:28:56 GMT
- Title: Radiomics-enhanced Deep Multi-task Learning for Outcome Prediction in
Head and Neck Cancer
- Authors: Mingyuan Meng, Lei Bi, Dagan Feng, and Jinman Kim
- Abstract summary: We propose a radiomics-enhanced deep multi-task framework for outcome prediction from PET/CT images.
Our novelty is to incorporate radiomics as an enhancement to our recently proposed Deep Multi-task Survival model (DeepMTS)
Our method achieved a C-index of 0.681 on the testing set, placing the 2nd on the leaderboard with only 0.00068 lower in C-index than the 1st place.
- Score: 11.795108660250843
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Outcome prediction is crucial for head and neck cancer patients as it can
provide prognostic information for early treatment planning. Radiomics methods
have been widely used for outcome prediction from medical images. However,
these methods are limited by their reliance on intractable manual segmentation
of tumor regions. Recently, deep learning methods have been proposed to perform
end-to-end outcome prediction so as to remove the reliance on manual
segmentation. Unfortunately, without segmentation masks, these methods will
take the whole image as input, such that makes them difficult to focus on tumor
regions and potentially unable to fully leverage the prognostic information
within the tumor regions. In this study, we propose a radiomics-enhanced deep
multi-task framework for outcome prediction from PET/CT images, in the context
of HEad and neCK TumOR segmentation and outcome prediction challenge (HECKTOR
2022). In our framework, our novelty is to incorporate radiomics as an
enhancement to our recently proposed Deep Multi-task Survival model (DeepMTS).
The DeepMTS jointly learns to predict the survival risk scores of patients and
the segmentation masks of tumor regions. Radiomics features are extracted from
the predicted tumor regions and combined with the predicted survival risk
scores for final outcome prediction, through which the prognostic information
in tumor regions can be further leveraged. Our method achieved a C-index of
0.681 on the testing set, placing the 2nd on the leaderboard with only 0.00068
lower in C-index than the 1st place.
Related papers
- Brain Tumor Segmentation (BraTS) Challenge 2024: Meningioma Radiotherapy Planning Automated Segmentation [47.119513326344126]
The BraTS-MEN-RT challenge aims to advance automated segmentation algorithms using the largest known multi-institutional dataset of radiotherapy planning brain MRIs.
Each case includes a defaced 3D post-contrast T1-weighted radiotherapy planning MRI in its native acquisition space.
Target volume annotations adhere to established radiotherapy planning protocols.
arXiv Detail & Related papers (2024-05-28T17:25:43Z) - Improving Breast Cancer Grade Prediction with Multiparametric MRI Created Using Optimized Synthetic Correlated Diffusion Imaging [71.91773485443125]
Grading plays a vital role in breast cancer treatment planning.
The current tumor grading method involves extracting tissue from patients, leading to stress, discomfort, and high medical costs.
This paper examines using optimized CDI$s$ to improve breast cancer grade prediction.
arXiv Detail & Related papers (2024-05-13T15:48:26Z) - Brain Tumor Segmentation Based on Deep Learning, Attention Mechanisms, and Energy-Based Uncertainty Prediction [0.0]
Brain tumors are one of the deadliest forms of cancer with a mortality rate of over 80%.
In medical analysis, the manual annotation and segmentation of a brain tumor can be a complicated task.
This paper proposes a region of interest detection algorithm that is implemented during data preprocessing to locate salient features and remove extraneous MRI data.
A fully convolutional autoencoder with soft attention segments the different brain MRIs.
arXiv Detail & Related papers (2023-12-31T20:42:52Z) - Post-Hoc Explainability of BI-RADS Descriptors in a Multi-task Framework
for Breast Cancer Detection and Segmentation [48.08423125835335]
MT-BI-RADS is a novel explainable deep learning approach for tumor detection in Breast Ultrasound (BUS) images.
It offers three levels of explanations to enable radiologists to comprehend the decision-making process in predicting tumor malignancy.
arXiv Detail & Related papers (2023-08-27T22:07:42Z) - Towards Tumour Graph Learning for Survival Prediction in Head & Neck
Cancer Patients [0.0]
Nearly one million new cases of head & neck cancer diagnosed worldwide in 2020.
automated segmentation and prognosis estimation approaches can help ensure each patient gets the most effective treatment.
This paper presents a framework to perform these functions on arbitrary field of view (FoV) PET and CT registered scans.
arXiv Detail & Related papers (2023-04-17T09:32:06Z) - Cancer-Net BCa-S: Breast Cancer Grade Prediction using Volumetric Deep
Radiomic Features from Synthetic Correlated Diffusion Imaging [82.74877848011798]
The prevalence of breast cancer continues to grow, affecting about 300,000 females in the United States in 2023.
The gold-standard Scarff-Bloom-Richardson (SBR) grade has been shown to consistently indicate a patient's response to chemotherapy.
In this paper, we study the efficacy of deep learning for breast cancer grading based on synthetic correlated diffusion (CDI$s$) imaging.
arXiv Detail & Related papers (2023-04-12T15:08:34Z) - Prediction of brain tumor recurrence location based on multi-modal
fusion and nonlinear correlation learning [55.789874096142285]
We present a deep learning-based brain tumor recurrence location prediction network.
We first train a multi-modal brain tumor segmentation network on the public dataset BraTS 2021.
Then, the pre-trained encoder is transferred to our private dataset for extracting the rich semantic features.
Two decoders are constructed to jointly segment the present brain tumor and predict its future tumor recurrence location.
arXiv Detail & Related papers (2023-04-11T02:45:38Z) - Recurrence-free Survival Prediction under the Guidance of Automatic
Gross Tumor Volume Segmentation for Head and Neck Cancers [8.598790229614071]
We developed an automated primary tumor (GTVp) and lymph nodes (GTVn) segmentation method.
We extracted radiomics features from the segmented tumor volume and constructed a multi-modality tumor recurrence-free survival (RFS) prediction model.
arXiv Detail & Related papers (2022-09-22T18:44:57Z) - Automated Segmentation and Recurrence Risk Prediction of Surgically
Resected Lung Tumors with Adaptive Convolutional Neural Networks [3.5413688566798096]
Lung cancer is the leading cause of cancer related mortality by a significant margin.
In this paper, we explore the use of convolutional neural networks (CNNs) for the segmentation and recurrence risk prediction of lung tumors.
To the best of our knowledge, it is the first fully automated segmentation and recurrence risk prediction system.
arXiv Detail & Related papers (2022-09-17T23:06:22Z) - Brain Tumor Survival Prediction using Radiomics Features [5.556008014747938]
Surgery planning in patients diagnosed with brain tumor is dependent on their survival prognosis.
Deep learning approaches have been used extensively for brain tumor segmentation.
Radiomics-based studies have shown more promise using engineered/hand-crafted features.
arXiv Detail & Related papers (2020-09-07T06:14:40Z) - Stan: Small tumor-aware network for breast ultrasound image segmentation [68.8204255655161]
We propose a novel deep learning architecture called Small Tumor-Aware Network (STAN) to improve the performance of segmenting tumors with different size.
The proposed approach outperformed the state-of-the-art approaches in segmenting small breast tumors.
arXiv Detail & Related papers (2020-02-03T22:25:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.