Semi-Supervised Hybrid Spine Network for Segmentation of Spine MR Images
- URL: http://arxiv.org/abs/2203.12151v1
- Date: Wed, 23 Mar 2022 02:57:14 GMT
- Title: Semi-Supervised Hybrid Spine Network for Segmentation of Spine MR Images
- Authors: Meiyan Huang, Shuoling Zhou, Xiumei Chen, Haoran Lai, Qianjin Feng
- Abstract summary: We propose a two-stage algorithm, named semi-supervised hybrid spine network (SSHSNet) to achieve simultaneous vertebral bodies (VBs) and intervertebral discs (IVDs) segmentation.
In the first stage, we constructed a 2D semi-supervised DeepLabv3+ by using cross pseudo supervision to obtain intra-slice features and coarse segmentation.
In the second stage, a 3D full-resolution patch-based DeepLabv3+ was built to extract inter-slice information.
Results show that the proposed method has great potential in dealing with the data imbalance problem
- Score: 14.190504802866288
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic segmentation of vertebral bodies (VBs) and intervertebral discs
(IVDs) in 3D magnetic resonance (MR) images is vital in diagnosing and treating
spinal diseases. However, segmenting the VBs and IVDs simultaneously is not
trivial. Moreover, problems exist, including blurry segmentation caused by
anisotropy resolution, high computational cost, inter-class similarity and
intra-class variability, and data imbalances. We proposed a two-stage
algorithm, named semi-supervised hybrid spine network (SSHSNet), to address
these problems by achieving accurate simultaneous VB and IVD segmentation. In
the first stage, we constructed a 2D semi-supervised DeepLabv3+ by using cross
pseudo supervision to obtain intra-slice features and coarse segmentation. In
the second stage, a 3D full-resolution patch-based DeepLabv3+ was built. This
model can be used to extract inter-slice information and combine the coarse
segmentation and intra-slice features provided from the first stage. Moreover,
a cross tri-attention module was applied to compensate for the loss of
inter-slice and intra-slice information separately generated from 2D and 3D
networks, thereby improving feature representation ability and achieving
satisfactory segmentation results. The proposed SSHSNet was validated on a
publicly available spine MR image dataset, and remarkable segmentation
performance was achieved. Moreover, results show that the proposed method has
great potential in dealing with the data imbalance problem. Based on previous
reports, few studies have incorporated a semi-supervised learning strategy with
a cross attention mechanism for spine segmentation. Therefore, the proposed
method may provide a useful tool for spine segmentation and aid clinically in
spinal disease diagnoses and treatments. Codes are publicly available at:
https://github.com/Meiyan88/SSHSNet.
Related papers
- SDR-Former: A Siamese Dual-Resolution Transformer for Liver Lesion
Classification Using 3D Multi-Phase Imaging [59.78761085714715]
This study proposes a novel Siamese Dual-Resolution Transformer (SDR-Former) framework for liver lesion classification.
The proposed framework has been validated through comprehensive experiments on two clinical datasets.
To support the scientific community, we are releasing our extensive multi-phase MR dataset for liver lesion analysis to the public.
arXiv Detail & Related papers (2024-02-27T06:32:56Z) - Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation [49.57907601086494]
Medical image segmentation plays a crucial role in computer-aided diagnosis.
We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised medical image (DEC-Seg)
arXiv Detail & Related papers (2023-12-26T12:56:31Z) - CORPS: Cost-free Rigorous Pseudo-labeling based on Similarity-ranking
for Brain MRI Segmentation [3.1657395760137406]
We propose a semi-supervised segmentation framework built upon a novel atlas-based pseudo-labeling method and a 3D deep convolutional neural network (DCNN) for 3D brain MRI segmentation.
The experimental results demonstrate the superiority of the proposed framework over the baseline method both qualitatively and quantitatively.
arXiv Detail & Related papers (2022-05-19T14:42:49Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - Conquering Data Variations in Resolution: A Slice-Aware Multi-Branch
Decoder Network [28.946037652152395]
We identify the wide variation in the ratio between intra- and inter-slice resolutions as a crucial obstacle to the performance.
We propose a slice-aware 2.5D network that emphasizes extracting discnative features utilizing not only in-plane semantics but also out-of-plane for each separate slice.
arXiv Detail & Related papers (2022-03-07T14:31:26Z) - Multi-Slice Dense-Sparse Learning for Efficient Liver and Tumor
Segmentation [4.150096314396549]
Deep convolutional neural network (DCNNs) has obtained tremendous success in 2D and 3D medical image segmentation.
We propose a novel dense-sparse training flow from a data perspective, in which, densely adjacent slices and sparsely adjacent slices are extracted as inputs for regularizing DCNNs.
We also design a 2.5D light-weight nnU-Net from a network perspective, in which, depthwise separable convolutions are adopted to improve the efficiency.
arXiv Detail & Related papers (2021-08-15T15:29:48Z) - TSGCNet: Discriminative Geometric Feature Learning with Two-Stream
GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes.
We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
arXiv Detail & Related papers (2020-12-26T08:02:56Z) - Volumetric Medical Image Segmentation: A 3D Deep Coarse-to-fine
Framework and Its Adversarial Examples [74.92488215859991]
We propose a novel 3D-based coarse-to-fine framework to efficiently tackle these challenges.
The proposed 3D-based framework outperforms their 2D counterparts by a large margin since it can leverage the rich spatial information along all three axes.
We conduct experiments on three datasets, the NIH pancreas dataset, the JHMI pancreas dataset and the JHMI pathological cyst dataset.
arXiv Detail & Related papers (2020-10-29T15:39:19Z) - Fully Automatic Intervertebral Disc Segmentation Using Multimodal 3D
U-Net [12.619402990144922]
This paper proposes a novel convolutional framework based on 3D U-Net to segment IVDs from MRI images.
We first localize the centers of intervertebral discs in each spine sample and then train the network based on the cropped small volumes centered at the localized intervertebral discs.
arXiv Detail & Related papers (2020-09-28T18:58:24Z) - DDU-Nets: Distributed Dense Model for 3D MRI Brain Tumor Segmentation [27.547646527286886]
Three patterns of distributed dense connections (DDCs) are proposed to enhance feature reuse and propagation of CNNs.
For better detecting and segmenting brain tumors from 3D MR images, CNN-based models embedded with DDCs (DDU-Nets) are trained efficiently from pixel to pixel.
The proposed method is evaluated on the BraTS 2019 dataset with results demonstrating the effectiveness of the DDU-Nets.
arXiv Detail & Related papers (2020-03-03T05:08:34Z) - VerSe: A Vertebrae Labelling and Segmentation Benchmark for
Multi-detector CT Images [121.31355003451152]
Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020.
We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
arXiv Detail & Related papers (2020-01-24T21:09:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.