Improving Across-Dataset Brain Tissue Segmentation Using Transformer

• URL: http://arxiv.org/abs/2201.08741v1
• Date: Fri, 21 Jan 2022 15:16:39 GMT
• Title: Improving Across-Dataset Brain Tissue Segmentation Using Transformer
• Authors: Vishwanatha M. Rao, Zihan Wan, David J. Ma, Pin-Yu Lee, Ye Tian, Andrew F. Laine, Jia Guo
• Abstract summary: This study introduces a novel CNN-Transformer hybrid architecture designed for brain tissue segmentation. We validate our model's performance across four multi-site T1w MRI datasets.
• Score: 10.838458766450989
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Brain tissue segmentation has demonstrated great utility in quantifying MRI data through Voxel-Based Morphometry and highlighting subtle structural changes associated with various conditions within the brain. However, manual segmentation is highly labor-intensive, and automated approaches have struggled due to properties inherent to MRI acquisition, leaving a great need for an effective segmentation tool. Despite the recent success of deep convolutional neural networks (CNNs) for brain tissue segmentation, many such solutions do not generalize well to new datasets, which is critical for a reliable solution. Transformers have demonstrated success in natural image segmentation and have recently been applied to 3D medical image segmentation tasks due to their ability to capture long-distance relationships in the input where the local receptive fields of CNNs struggle. This study introduces a novel CNN-Transformer hybrid architecture designed for brain tissue segmentation. We validate our model's performance across four multi-site T1w MRI datasets, covering different vendors, field strengths, scan parameters, time points, and neuropsychiatric conditions. In all situations, our model achieved the greatest generality and reliability. Out method is inherently robust and can serve as a valuable tool for brain-related T1w MRI studies. The code for the TABS network is available at: https://github.com/raovish6/TABS.

Related papers

• Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation [53.70131202548981]
  We present a two-step segmentation framework employing Knowledge-Guided Prompt Learning (KGPL) for brain MRI. Specifically, we first pre-train segmentation models on large-scale datasets with sub-optimal labels. The introduction of knowledge-wise prompts captures semantic relationships between anatomical variability and biological processes.
  arXiv  Detail & Related papers  (2024-07-31T04:32:43Z)
• 3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation [6.127298607534532]
  Deep learning has recently emerged to improve brain tumor segmentation. Transformers have been leveraged to address the limitations of convolutional networks. We propose a 3D Transformer-based segmentation approach.
  arXiv  Detail & Related papers  (2023-04-28T02:11:29Z)
• Investigating certain choices of CNN configurations for brain lesion segmentation [5.148195106469231]
  Deep learning models, in particular CNNs, have been a methodology of choice in many applications of medical image analysis including brain tumor segmentation. We investigated the main design aspects of CNN models for the specific task of MRI-based brain tumor segmentation.
  arXiv  Detail & Related papers  (2022-12-02T15:24:44Z)
• Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
  In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network. We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module. Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
  arXiv  Detail & Related papers  (2022-12-01T07:32:56Z)
• Learning from partially labeled data for multi-organ and tumor segmentation [102.55303521877933]
  We propose a Transformer based dynamic on-demand network (TransDoDNet) that learns to segment organs and tumors on multiple datasets. A dynamic head enables the network to accomplish multiple segmentation tasks flexibly. We create a large-scale partially labeled Multi-Organ and Tumor benchmark, termed MOTS, and demonstrate the superior performance of our TransDoDNet over other competitors.
  arXiv  Detail & Related papers  (2022-11-13T13:03:09Z)
• MISSU: 3D Medical Image Segmentation via Self-distilling TransUNet [55.16833099336073]
  We propose to self-distill a Transformer-based UNet for medical image segmentation. It simultaneously learns global semantic information and local spatial-detailed features. Our MISSU achieves the best performance over previous state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-06-02T07:38:53Z)
• Cross-Modality Deep Feature Learning for Brain Tumor Segmentation [158.8192041981564]
  This paper proposes a novel cross-modality deep feature learning framework to segment brain tumors from the multi-modality MRI data. The core idea is to mine rich patterns across the multi-modality data to make up for the insufficient data scale. Comprehensive experiments are conducted on the BraTS benchmarks, which show that the proposed cross-modality deep feature learning framework can effectively improve the brain tumor segmentation performance.
  arXiv  Detail & Related papers  (2022-01-07T07:46:01Z)
• SynthSeg: Domain Randomisation for Segmentation of Brain MRI Scans of any Contrast and Resolution [7.070890465817133]
  Convolutional neural networks (CNNs) have difficulties generalising to unseen target domains. We introduce SynthSeg, the first segmentation CNN to brain MRI scans of any contrast and resolution. We demonstrate SynthSeg on 5,500 scans of 6 modalities and 10 resolutions, where it exhibits unparalleled generalisation.
  arXiv  Detail & Related papers  (2021-07-20T15:22:16Z)
• DeepSeg: Deep Neural Network Framework for Automatic Brain Tumor Segmentation using Magnetic Resonance FLAIR Images [0.0]
  Gliomas are the most common and aggressive type of brain tumors. Fluid-Attenuated Inversion Recovery (FLAIR) MRI can provide the physician with information about tumor infiltration. This paper proposes a new generic deep learning architecture; namely DeepSeg for fully automated detection and segmentation of the brain lesion.
  arXiv  Detail & Related papers  (2020-04-26T09:50:02Z)
• MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Data [75.73881040581767]
  We propose a novel multi-site network (MS-Net) for improving prostate segmentation by learning robust representations. Our MS-Net improves the performance across all datasets consistently, and outperforms state-of-the-art methods for multi-site learning.
  arXiv  Detail & Related papers  (2020-02-09T14:11:50Z)
• Transfer Learning for Brain Tumor Segmentation [0.6408773096179187]
  Gliomas are the most common malignant brain tumors that are treated with chemoradiotherapy and surgery. Recent advances in deep learning have led to convolutional neural network architectures that excel at various visual recognition tasks. In this work, we construct FCNs with pretrained convolutional encoders. We show that we can stabilize the training process this way and achieve an improvement with respect to dice scores and Hausdorff distances.
  arXiv  Detail & Related papers  (2019-12-28T12:45:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.