SpineCLUE: Automatic Vertebrae Identification Using Contrastive Learning
and Uncertainty Estimation
- URL: http://arxiv.org/abs/2401.07271v1
- Date: Sun, 14 Jan 2024 12:02:39 GMT
- Title: SpineCLUE: Automatic Vertebrae Identification Using Contrastive Learning
and Uncertainty Estimation
- Authors: Sheng Zhang, Minheng Chen, Junxian Wu, Ziyue Zhang, Tonglong Li, Cheng
Xue, Youyong Kong
- Abstract summary: Vertebrae identification in arbitrary fields-of-view plays a crucial role in diagnosing spine disease.
Existing methods at the spine-level are unable to meet this challenge.
We propose a three-stage method to address the challenges in 3D CT vertebrae identification at vertebrae-level.
- Score: 12.427024671144869
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Vertebrae identification in arbitrary fields-of-view plays a crucial role in
diagnosing spine disease. Most spine CT contain only local regions, such as the
neck, chest, and abdomen. Therefore, identification should not depend on
specific vertebrae or a particular number of vertebrae being visible. Existing
methods at the spine-level are unable to meet this challenge. In this paper, we
propose a three-stage method to address the challenges in 3D CT vertebrae
identification at vertebrae-level. By sequentially performing the tasks of
vertebrae localization, segmentation, and identification, the anatomical prior
information of the vertebrae is effectively utilized throughout the process.
Specifically, we introduce a dual-factor density clustering algorithm to
acquire localization information for individual vertebra, thereby facilitating
subsequent segmentation and identification processes. In addition, to tackle
the issue of interclass similarity and intra-class variability, we pre-train
our identification network by using a supervised contrastive learning method.
To further optimize the identification results, we estimated the uncertainty of
the classification network and utilized the message fusion module to combine
the uncertainty scores, while aggregating global information about the spine.
Our method achieves state-of-the-art results on the VerSe19 and VerSe20
challenge benchmarks. Additionally, our approach demonstrates outstanding
generalization performance on an collected dataset containing a wide range of
abnormal cases.
Related papers
- Panoptic Segmentation and Labelling of Lumbar Spine Vertebrae using Modified Attention Unet [2.8730926763860687]
We propose a modified attention U-Net architecture for panoptic segmentation of 3D sliced MRI data of the lumbar spine.
Our method achieves an impressive accuracy of 99.5% by incorporating novel masking logic.
arXiv Detail & Related papers (2024-04-28T19:35:00Z) - Shape Matters: Detecting Vertebral Fractures Using Differentiable
Point-Based Shape Decoding [51.38395069380457]
Degenerative spinal pathologies are highly prevalent among the elderly population.
Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability.
In this study, we specifically explore the use of shape auto-encoders for vertebrae.
arXiv Detail & Related papers (2023-12-08T18:11:22Z) - Multi-task Explainable Skin Lesion Classification [54.76511683427566]
We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data.
The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
arXiv Detail & Related papers (2023-10-11T05:49:47Z) - Robust vertebra identification using simultaneous node and edge
predicting Graph Neural Networks [0.0]
We introduce a simple pipeline that employs a standard prediction with a U-Net, followed by a single graph neural network to associate and classify vertebrae with full orientation.
Our method is able to accurately associate the correct body and pedicle landmarks, ignore false positives and classify vertebrae in a simple, fully trainable pipeline.
arXiv Detail & Related papers (2023-07-27T09:10:27Z) - Multi-View Vertebra Localization and Identification from CT Images [57.56509107412658]
We propose a multi-view vertebra localization and identification from CT images.
We convert the 3D problem into a 2D localization and identification task on different views.
Our method can learn the multi-view global information naturally.
arXiv Detail & Related papers (2023-07-24T14:43:07Z) - SpineOne: A One-Stage Detection Framework for Degenerative Discs and
Vertebrae [54.751251046196494]
We propose a one-stage detection framework termed SpineOne to simultaneously localize and classify degenerative discs and vertebrae from MRI slices.
SpineOne is built upon the following three key techniques: 1) a new design of the keypoint heatmap to facilitate simultaneous keypoint localization and classification; 2) the use of attention modules to better differentiate the representations between discs and vertebrae; and 3) a novel gradient-guided objective association mechanism to associate multiple learning objectives at the later training stage.
arXiv Detail & Related papers (2021-10-28T12:59:06Z) - Automatic Vertebra Localization and Identification in CT by Spine
Rectification and Anatomically-constrained Optimization [23.84364494308767]
This paper proposes a robust and accurate method that exploits the anatomical knowledge of the spine to facilitate vertebra localization and identification.
A key point localization model is trained to produce activation maps of vertebra centers.
They are then re-sampled along the spine centerline to produce spine-rectified activation maps, which are further aggregated into 1-D activation signals.
An anatomically-constrained optimization module is introduced to jointly search for the optimal vertebra centers under a soft constraint that regulates the distance between vertebrae and a hard constraint on the consecutive vertebra indices.
arXiv Detail & Related papers (2020-12-14T21:26:48Z) - A Convolutional Approach to Vertebrae Detection and Labelling in Whole
Spine MRI [70.04389979779195]
We propose a novel convolutional method for the detection and identification of vertebrae in whole spine MRIs.
This involves using a learnt vector field to group detected vertebrae corners together into individual vertebral bodies.
We demonstrate the clinical applicability of this method, using it for automated scoliosis detection in both lumbar and whole spine MR scans.
arXiv Detail & Related papers (2020-07-06T09:37:12Z) - VerSe: A Vertebrae Labelling and Segmentation Benchmark for
Multi-detector CT Images [121.31355003451152]
Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020.
We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
arXiv Detail & Related papers (2020-01-24T21:09:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.