Residual Block-based Multi-Label Classification and Localization Network
with Integral Regression for Vertebrae Labeling
- URL: http://arxiv.org/abs/2001.00170v1
- Date: Wed, 1 Jan 2020 09:16:10 GMT
- Title: Residual Block-based Multi-Label Classification and Localization Network
with Integral Regression for Vertebrae Labeling
- Authors: Chunli Qin, Demin Yao, Han Zhuang, Hui Wang, Yonghong Shi, and Zhijian
Song
- Abstract summary: Existing methods are mainly based on the integration of multiple neural networks, and most of them use the Gaussian heat map to locate the vertebrae's centroid.
For end-to-end differential training of vertebra coordinates on CT scans, a robust and accurate automatic vertebral labeling algorithm is proposed in this study.
The proposed method is evaluated on a challenging dataset and the results are significantly better than the state-of-the-art methods.
- Score: 4.867669606257232
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate identification and localization of the vertebrae in CT scans is a
critical and standard preprocessing step for clinical spinal diagnosis and
treatment. Existing methods are mainly based on the integration of multiple
neural networks, and most of them use the Gaussian heat map to locate the
vertebrae's centroid. However, the process of obtaining the vertebrae's
centroid coordinates using heat maps is non-differentiable, so it is impossible
to train the network to label the vertebrae directly. Therefore, for end-to-end
differential training of vertebra coordinates on CT scans, a robust and
accurate automatic vertebral labeling algorithm is proposed in this study.
Firstly, a novel residual-based multi-label classification and localization
network is developed, which can capture multi-scale features, but also utilize
the residual module and skip connection to fuse the multi-level features.
Secondly, to solve the problem that the process of finding coordinates is
non-differentiable and the spatial structure is not destructible, integral
regression module is used in the localization network. It combines the
advantages of heat map representation and direct regression coordinates to
achieve end-to-end training, and can be compatible with any key point detection
methods of medical image based on heat map. Finally, multi-label classification
of vertebrae is carried out, which use bidirectional long short term memory
(Bi-LSTM) to enhance the learning of long contextual information to improve the
classification performance. The proposed method is evaluated on a challenging
dataset and the results are significantly better than the state-of-the-art
methods (mean localization error <3mm).
Related papers
- Deep Homography Estimation for Visual Place Recognition [49.235432979736395]
We propose a transformer-based deep homography estimation (DHE) network.
It takes the dense feature map extracted by a backbone network as input and fits homography for fast and learnable geometric verification.
Experiments on benchmark datasets show that our method can outperform several state-of-the-art methods.
arXiv Detail & Related papers (2024-02-25T13:22:17Z) - Shape Matters: Detecting Vertebral Fractures Using Differentiable
Point-Based Shape Decoding [51.38395069380457]
Degenerative spinal pathologies are highly prevalent among the elderly population.
Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability.
In this study, we specifically explore the use of shape auto-encoders for vertebrae.
arXiv Detail & Related papers (2023-12-08T18:11:22Z) - Domain Adaptive Synapse Detection with Weak Point Annotations [63.97144211520869]
We present AdaSyn, a framework for domain adaptive synapse detection with weak point annotations.
In the WASPSYN challenge at I SBI 2023, our method ranks the 1st place.
arXiv Detail & Related papers (2023-08-31T05:05:53Z) - Multilayer Multiset Neuronal Networks -- MMNNs [55.2480439325792]
The present work describes multilayer multiset neuronal networks incorporating two or more layers of coincidence similarity neurons.
The work also explores the utilization of counter-prototype points, which are assigned to the image regions to be avoided.
arXiv Detail & Related papers (2023-08-28T12:55:13Z) - Robust vertebra identification using simultaneous node and edge
predicting Graph Neural Networks [0.0]
We introduce a simple pipeline that employs a standard prediction with a U-Net, followed by a single graph neural network to associate and classify vertebrae with full orientation.
Our method is able to accurately associate the correct body and pedicle landmarks, ignore false positives and classify vertebrae in a simple, fully trainable pipeline.
arXiv Detail & Related papers (2023-07-27T09:10:27Z) - Localized Perturbations For Weakly-Supervised Segmentation of Glioma
Brain Tumours [0.5801621787540266]
This work proposes the use of localized perturbations as a weakly-supervised solution to extract segmentation masks of brain tumours from a pretrained 3D classification model.
We also propose a novel optimal perturbation method that exploits 3D superpixels to find the most relevant area for a given classification using a U-net architecture.
arXiv Detail & Related papers (2021-11-29T21:01:20Z) - Feature Aggregation and Refinement Network for 2D AnatomicalLandmark
Detection [0.0]
We propose a novel deep network, named feature aggregation and refinement network (FARNet) for the automatic detection of anatomical landmarks.
Our network has been evaluated on three publicly available anatomical landmark detection datasets.
arXiv Detail & Related papers (2021-11-01T02:16:13Z) - Dense Regression Activation Maps For Lesion Segmentation in CT scans of
COVID-19 patients [9.313053265087262]
We propose a weakly-supervised segmentation method based on dense regression activation maps (dRAM)
Our method substantially improves the intersection over union from 0.335 in the CAM-based weakly supervised segmentation method to 0.495.
arXiv Detail & Related papers (2021-05-25T08:29:35Z) - Learn Fine-grained Adaptive Loss for Multiple Anatomical Landmark
Detection in Medical Images [15.7026400415269]
We propose a novel learning-to-learn framework for landmark detection.
Our proposed framework is general and shows the potential to improve the efficiency of anatomical landmark detection.
arXiv Detail & Related papers (2021-05-19T13:39:18Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - VerSe: A Vertebrae Labelling and Segmentation Benchmark for
Multi-detector CT Images [121.31355003451152]
Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020.
We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
arXiv Detail & Related papers (2020-01-24T21:09:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.