Transfer Learning for Brain Tumor Segmentation
- URL: http://arxiv.org/abs/1912.12452v2
- Date: Thu, 26 Nov 2020 22:12:40 GMT
- Title: Transfer Learning for Brain Tumor Segmentation
- Authors: Jonas Wacker, Marcelo Ladeira, Jos\'e Eduardo Vaz Nascimento
- Abstract summary: Gliomas are the most common malignant brain tumors that are treated with chemoradiotherapy and surgery.
Recent advances in deep learning have led to convolutional neural network architectures that excel at various visual recognition tasks.
In this work, we construct FCNs with pretrained convolutional encoders. We show that we can stabilize the training process this way and achieve an improvement with respect to dice scores and Hausdorff distances.
- Score: 0.6408773096179187
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Gliomas are the most common malignant brain tumors that are treated with
chemoradiotherapy and surgery. Magnetic Resonance Imaging (MRI) is used by
radiotherapists to manually segment brain lesions and to observe their
development throughout the therapy. The manual image segmentation process is
time-consuming and results tend to vary among different human raters.
Therefore, there is a substantial demand for automatic image segmentation
algorithms that produce a reliable and accurate segmentation of various brain
tissue types. Recent advances in deep learning have led to convolutional neural
network architectures that excel at various visual recognition tasks. They have
been successfully applied to the medical context including medical image
segmentation. In particular, fully convolutional networks (FCNs) such as the
U-Net produce state-of-the-art results in the automatic segmentation of brain
tumors. MRI brain scans are volumetric and exist in various co-registered
modalities that serve as input channels for these FCN architectures. Training
algorithms for brain tumor segmentation on this complex input requires large
amounts of computational resources and is prone to overfitting. In this work,
we construct FCNs with pretrained convolutional encoders. We show that we can
stabilize the training process this way and achieve an improvement with respect
to dice scores and Hausdorff distances. We also test our method on a privately
obtained clinical dataset.
Related papers
- Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation [53.70131202548981]
We present a two-step segmentation framework employing Knowledge-Guided Prompt Learning (KGPL) for brain MRI.
Specifically, we first pre-train segmentation models on large-scale datasets with sub-optimal labels.
The introduction of knowledge-wise prompts captures semantic relationships between anatomical variability and biological processes.
arXiv Detail & Related papers (2024-07-31T04:32:43Z) - On Enhancing Brain Tumor Segmentation Across Diverse Populations with Convolutional Neural Networks [0.9304666952022026]
This work proposes a brain tumor segmentation method as part of the BraTS-GoAT challenge.
The task is to segment tumors in brain MRI scans automatically from various populations, such as adults, pediatrics, and underserved sub-Saharan Africa.
Our experiments show that our method performs well on the unseen validation set with an average DSC of 85.54% and HD95 of 27.88.
arXiv Detail & Related papers (2024-05-05T08:55:00Z) - fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for
Multi-Subject Brain Activity Decoding [54.17776744076334]
We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training.
Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns.
Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
arXiv Detail & Related papers (2023-11-01T07:24:22Z) - 3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation [6.127298607534532]
Deep learning has recently emerged to improve brain tumor segmentation.
Transformers have been leveraged to address the limitations of convolutional networks.
We propose a 3D Transformer-based segmentation approach.
arXiv Detail & Related papers (2023-04-28T02:11:29Z) - Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks.
In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics.
Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
arXiv Detail & Related papers (2022-09-19T09:43:19Z) - CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer with
Modality-Correlated Cross-Attention for Brain Tumor Segmentation [37.39921484146194]
Brain tumor segmentation in magnetic resonance image (MRI) is crucial for brain tumor diagnosis, cancer management and research purposes.
With the great success of the ten-year BraTS challenges, a lot of outstanding BTS models have been proposed to tackle the difficulties of BTS in different technical aspects.
We propose a clinical knowledge-driven brain tumor segmentation model, called CKD-TransBTS.
arXiv Detail & Related papers (2022-07-15T09:35:29Z) - Improving Across-Dataset Brain Tissue Segmentation Using Transformer [10.838458766450989]
This study introduces a novel CNN-Transformer hybrid architecture designed for brain tissue segmentation.
We validate our model's performance across four multi-site T1w MRI datasets.
arXiv Detail & Related papers (2022-01-21T15:16:39Z) - Cross-Modality Deep Feature Learning for Brain Tumor Segmentation [158.8192041981564]
This paper proposes a novel cross-modality deep feature learning framework to segment brain tumors from the multi-modality MRI data.
The core idea is to mine rich patterns across the multi-modality data to make up for the insufficient data scale.
Comprehensive experiments are conducted on the BraTS benchmarks, which show that the proposed cross-modality deep feature learning framework can effectively improve the brain tumor segmentation performance.
arXiv Detail & Related papers (2022-01-07T07:46:01Z) - Medulloblastoma Tumor Classification using Deep Transfer Learning with
Multi-Scale EfficientNets [63.62764375279861]
We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions.
Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
arXiv Detail & Related papers (2021-09-10T13:07:11Z) - Neural Architecture Search for Gliomas Segmentation on Multimodal
Magnetic Resonance Imaging [2.66512000865131]
We propose a neural architecture search (NAS) based solution to brain tumor segmentation tasks on multimodal MRI scans.
The developed solution also integrates normalization and patching strategies tailored for brain MRI processing.
arXiv Detail & Related papers (2020-05-13T14:32:00Z) - Region of Interest Identification for Brain Tumors in Magnetic Resonance
Images [8.75217589103206]
We propose a fast, automated method, with light computational complexity, to find the smallest bounding box around the tumor region.
This region-of-interest can be used as a preprocessing step in training networks for subregion tumor segmentation.
The proposed method is evaluated on the BraTS 2015 dataset, and the average gained DICE score is 0.73, which is an acceptable result for this application.
arXiv Detail & Related papers (2020-02-26T14:10:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.