DINs: Deep Interactive Networks for Neurofibroma Segmentation in
Neurofibromatosis Type 1 on Whole-Body MRI
- URL: http://arxiv.org/abs/2106.03388v1
- Date: Mon, 7 Jun 2021 07:29:29 GMT
- Title: DINs: Deep Interactive Networks for Neurofibroma Segmentation in
Neurofibromatosis Type 1 on Whole-Body MRI
- Authors: Jian-Wei Zhang, Wei Chen, K. Ina Ly, Xubin Zhang, Fan Yan, Justin
Jordan, Gordon Harris, Scott Plotkin, Pengyi Hao, and Wenli Cai
- Abstract summary: We propose deep interactive networks (DINs) to address the limitations of automatic convolutional neural networks (CNNs)
We introduce a simple but effective Exponential Distance Transform (ExpDT) that converts user interactions into guide maps regarded as the spatial and appearance prior.
Experiment results yield significant improvements of 44% and 14% in DSC comparing with automated and other interactive methods.
- Score: 7.760497213052019
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Neurofibromatosis type 1 (NF1) is an autosomal dominant tumor predisposition
syndrome that involves the central and peripheral nervous systems. Accurate
detection and segmentation of neurofibromas are essential for assessing tumor
burden and longitudinal tumor size changes. Automatic convolutional neural
networks (CNNs) are sensitive and vulnerable as tumors' variable anatomical
location and heterogeneous appearance on MRI. In this study, we propose deep
interactive networks (DINs) to address the above limitations. User interactions
guide the model to recognize complicated tumors and quickly adapt to
heterogeneous tumors. We introduce a simple but effective Exponential Distance
Transform (ExpDT) that converts user interactions into guide maps regarded as
the spatial and appearance prior. Comparing with popular Euclidean and geodesic
distances, ExpDT is more robust to various image sizes, which reserves the
distribution of interactive inputs. Furthermore, to enhance the tumor-related
features, we design a deep interactive module to propagate the guides into
deeper layers. We train and evaluate DINs on three MRI data sets from NF1
patients. The experiment results yield significant improvements of 44% and 14%
in DSC comparing with automated and other interactive methods, respectively. We
also experimentally demonstrate the efficiency of DINs in reducing user burden
when comparing with conventional interactive methods. The source code of our
method is available at \url{https://github.com/Jarvis73/DINs}.
Related papers
- Hybrid Spiking Neural Networks for Low-Power Intra-Cortical Brain-Machine Interfaces [42.72938925647165]
Intra-cortical brain-machine interfaces (iBMIs) have the potential to dramatically improve the lives of people with paraplegia.
Current iBMIs suffer from scalability and mobility limitations due to bulky hardware and wiring.
We are investigating hybrid spiking neural networks for embedded neural decoding in wireless iBMIs.
arXiv Detail & Related papers (2024-09-06T17:48:44Z) - Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI [58.809276442508256]
We propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers.
The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network superior performance than the state-of-the-art methods.
arXiv Detail & Related papers (2024-08-11T15:46:00Z) - Cross-modality Guidance-aided Multi-modal Learning with Dual Attention
for MRI Brain Tumor Grading [47.50733518140625]
Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly.
We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
arXiv Detail & Related papers (2024-01-17T07:54:49Z) - Integration of Graph Neural Network and Neural-ODEs for Tumor Dynamic Prediction [4.850774880198265]
We propose a graph encoder that utilizes a bipartite Graph Convolutional Neural network (GCN) combined with Neural Ordinary Differential Equations (Neural-ODEs)
We first show that the methodology is able to discover a tumor dynamic model that significantly improves upon an empirical model.
Our findings indicate that the methodology holds significant promise and offers potential applications in pre-clinical settings.
arXiv Detail & Related papers (2023-10-02T06:39:08Z) - FastSurfer-HypVINN: Automated sub-segmentation of the hypothalamus and
adjacent structures on high-resolutional brain MRI [3.869627124798774]
We introduce a novel, fast, and fully automated deep learning method named HypVINN for sub-segmentation of the hypothalamus.
We extensively validate our model with respect to segmentation accuracy, generalizability, in-session test-retest reliability, and sensitivity to replicate hypothalamic volume effects.
arXiv Detail & Related papers (2023-08-24T12:26:38Z) - Brain Imaging-to-Graph Generation using Adversarial Hierarchical Diffusion Models for MCI Causality Analysis [44.45598796591008]
Brain imaging-to-graph generation (BIGG) framework is proposed to map functional magnetic resonance imaging (fMRI) into effective connectivity for mild cognitive impairment analysis.
The hierarchical transformers in the generator are designed to estimate the noise at multiple scales.
Evaluations of the ADNI dataset demonstrate the feasibility and efficacy of the proposed model.
arXiv Detail & Related papers (2023-05-18T06:54:56Z) - Prediction of brain tumor recurrence location based on multi-modal
fusion and nonlinear correlation learning [55.789874096142285]
We present a deep learning-based brain tumor recurrence location prediction network.
We first train a multi-modal brain tumor segmentation network on the public dataset BraTS 2021.
Then, the pre-trained encoder is transferred to our private dataset for extracting the rich semantic features.
Two decoders are constructed to jointly segment the present brain tumor and predict its future tumor recurrence location.
arXiv Detail & Related papers (2023-04-11T02:45:38Z) - Multi-modal learning for predicting the genotype of glioma [14.93152817415408]
The isocitrate dehydrogenase (IDH) gene mutation is an essential biomarker for the diagnosis and prognosis of glioma.
It is promising to better predict glioma genotype by integrating focal tumor image and geometric features with brain network features derived from MRI.
We propose a multi-modal learning framework using three separate encoders to extract features of focal tumor image, tumor geometrics and global brain networks.
arXiv Detail & Related papers (2022-03-21T10:20:04Z) - A New Deep Hybrid Boosted and Ensemble Learning-based Brain Tumor
Analysis using MRI [0.28675177318965034]
Two-phase deep learning-based framework is proposed to detect and categorize brain tumors in magnetic resonance images (MRIs)
In the first phase, a novel deep boosted features and ensemble classifiers (DBF-EC) scheme is proposed to detect tumor MRI images from healthy individuals effectively.
In the second phase, a new hybrid features fusion-based brain tumor classification approach is proposed, comprised of dynamic-static feature and ML classifier to categorize different tumor types.
arXiv Detail & Related papers (2022-01-14T10:24:47Z) - Feature-enhanced Generation and Multi-modality Fusion based Deep Neural
Network for Brain Tumor Segmentation with Missing MR Modalities [2.867517731896504]
The main problem is that not all types of MRIs are always available in clinical exams.
We propose a novel brain tumor segmentation network in the case of missing one or more modalities.
The proposed network consists of three sub-networks: a feature-enhanced generator, a correlation constraint block and a segmentation network.
arXiv Detail & Related papers (2021-11-08T10:59:40Z) - Medulloblastoma Tumor Classification using Deep Transfer Learning with
Multi-Scale EfficientNets [63.62764375279861]
We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions.
Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
arXiv Detail & Related papers (2021-09-10T13:07:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.