Classification of Brain Tumours in MR Images using Deep Spatiospatial
Models
- URL: http://arxiv.org/abs/2105.14071v1
- Date: Fri, 28 May 2021 19:27:51 GMT
- Title: Classification of Brain Tumours in MR Images using Deep Spatiospatial
Models
- Authors: Soumick Chatterjee, Faraz Ahmed Nizamani, Andreas N\"urnberger and
Oliver Speck
- Abstract summary: This paper uses twotemporal models, ResNet (2+1)D and ResNet Mixed Convolution, to classify different types of brain tumours.
It was observed that both these models performed superior to the pure 3D convolutional model, ResNet18.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A brain tumour is a mass or cluster of abnormal cells in the brain, which has
the possibility of becoming life-threatening because of its ability to invade
neighbouring tissues and also form metastases. An accurate diagnosis is
essential for successful treatment planning and magnetic resonance imaging is
the principal imaging modality for diagnostic of brain tumours and their
extent. Deep Learning methods in computer vision applications have shown
significant improvement in recent years, most of which can be credited to the
fact that a sizeable amount of data is available to train models on, and the
improvements in the model architectures yielding better approximations in a
supervised setting. Classifying tumours using such deep learning methods has
made significant progress with the availability of open datasets with reliable
annotations. Typically those methods are either 3D models, which use 3D
volumetric MRIs or even 2D models considering each slice separately. However,
by treating the slice spatial dimension separately, spatiotemporal models can
be employed as spatiospatial models for this task. These models have the
capabilities of learning specific spatial and temporal relationship, while
reducing computational costs. This paper uses two spatiotemporal models, ResNet
(2+1)D and ResNet Mixed Convolution, to classify different types of brain
tumours. It was observed that both these models performed superior to the pure
3D convolutional model, ResNet18. Furthermore, it was also observed that
pre-training the models on a different, even unrelated dataset before training
them for the task of tumour classification improves the performance. Finally,
Pre-trained ResNet Mixed Convolution was observed to be the best model in these
experiments, achieving a macro F1-score of 0.93 and a test accuracy of 96.98\%,
while at the same time being the model with the least computational cost.
Related papers
- Brain Tumor Classification on MRI in Light of Molecular Markers [61.77272414423481]
Co-deletion of the 1p/19q gene is associated with clinical outcomes in low-grade gliomas.
This study aims to utilize a specially MRI-based convolutional neural network for brain cancer detection.
arXiv Detail & Related papers (2024-09-29T07:04:26Z) - Latent 3D Brain MRI Counterfactual [25.598362396064367]
We propose a two-stage method that constructs a Structural Causal Model (SCM) within the latent space.
In the first stage, we employ a VQ-VAE to learn a compact embedding of the MRI volume.
Subsequently, we integrate our causal model into this latent space and execute a three-step counterfactual procedure.
arXiv Detail & Related papers (2024-09-09T13:15:03Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - DeepAD: A Robust Deep Learning Model of Alzheimer's Disease Progression
for Real-World Clinical Applications [0.9999629695552196]
We propose a novel multi-task deep learning model to predict Alzheimer's disease progression.
Our model integrates high dimensional MRI features from a 3D convolutional neural network with other data modalities.
arXiv Detail & Related papers (2022-03-17T05:42:00Z) - A Novel Framework for Brain Tumor Detection Based on Convolutional
Variational Generative Models [6.726255259929498]
This paper introduces a novel framework for brain tumor detection and classification.
The proposed framework acquires an overall detection accuracy of 96.88%.
It highlights the promise of the proposed framework as an accurate low-overhead brain tumor detection system.
arXiv Detail & Related papers (2022-02-20T16:14:01Z) - A multi-stage machine learning model on diagnosis of esophageal
manometry [50.591267188664666]
The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage.
This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
arXiv Detail & Related papers (2021-06-25T20:09:23Z) - Transfer Learning Enhanced Generative Adversarial Networks for
Multi-Channel MRI Reconstruction [3.5765797841178597]
Deep learning based generative adversarial networks (GAN) can effectively perform image reconstruction with under-sampled MR data.
It is difficult to obtain tens of thousands of raw patient data to train the model since saving k-space data is not in the routine clinical flow.
In this study, three novel applications were explored based on parallel imaging combined with the GAN model (PI-GAN) and transfer learning.
arXiv Detail & Related papers (2021-05-17T21:28:00Z) - Automated Model Design and Benchmarking of 3D Deep Learning Models for
COVID-19 Detection with Chest CT Scans [72.04652116817238]
We propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification.
We also exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results.
arXiv Detail & Related papers (2021-01-14T03:45:01Z) - Modelling the Distribution of 3D Brain MRI using a 2D Slice VAE [66.63629641650572]
We propose a method to model 3D MR brain volumes distribution by combining a 2D slice VAE with a Gaussian model that captures the relationships between slices.
We also introduce a novel evaluation method for generated volumes that quantifies how well their segmentations match those of true brain anatomy.
arXiv Detail & Related papers (2020-07-09T13:23:15Z) - M2Net: Multi-modal Multi-channel Network for Overall Survival Time
Prediction of Brain Tumor Patients [151.4352001822956]
Early and accurate prediction of overall survival (OS) time can help to obtain better treatment planning for brain tumor patients.
Existing prediction methods rely on radiomic features at the local lesion area of a magnetic resonance (MR) volume.
We propose an end-to-end OS time prediction model; namely, Multi-modal Multi-channel Network (M2Net)
arXiv Detail & Related papers (2020-06-01T05:21:37Z) - Predictive modeling of brain tumor: A Deep learning approach [0.0]
This paper presents a Convolutional Neural Network (CNN) based transfer learning approach to classify the brain MRI scans into two classes using three pre-trained models.
Experimental results show that the Resnet-50 model achieves the highest accuracy and least false negative rates as 95% and zero respectively.
arXiv Detail & Related papers (2019-11-06T09:27:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.