Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine

• URL: http://arxiv.org/abs/2205.07568v1
• Date: Mon, 16 May 2022 10:59:55 GMT
• Title: Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine
• Authors: Bailiang Jian, Mohammad Farid Azampour, Francesca De Benetti, Johannes Oberreuter, Christina Bukas, Alexandra S. Gersing, Sarah C. Foreman, Anna-Sophia Dietrich, Jon Rischewski, Jan S. Kirschke, Nassir Navab, Thomas Wendler
• Abstract summary: We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration. We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI. Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
• Score: 72.85011943179894
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: CT and MRI are two of the most informative modalities in spinal diagnostics and treatment planning. CT is useful when analysing bony structures, while MRI gives information about the soft tissue. Thus, fusing the information of both modalities can be very beneficial. Registration is the first step for this fusion. While the soft tissues around the vertebra are deformable, each vertebral body is constrained to move rigidly. We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration. To achieve this goal, we introduce anatomy-aware losses for training the network. We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI. We evaluate our method on an in-house dataset of 167 patients. Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.

Related papers

• Anatomically Constrained Tractography of the Fetal Brain [6.112565873653592]
  We advocate for anatomically constrained tractography based on an accurate segmentation of the fetal brain tissue directly in the dMRI space. Experiments on independent test data show that this method can accurately segment the fetal brain tissue and drastically improve tractography results.
  arXiv  Detail & Related papers  (2024-03-04T19:56:19Z)
• Weakly-Supervised Detection of Bone Lesions in CT [48.34559062736031]
  The skeletal region is one of the common sites of metastatic spread of cancer in the breast and prostate. We developed a pipeline to detect bone lesions in CT volumes via a proxy segmentation task. Our method detected bone lesions in CT with a precision of 96.7% and recall of 47.3% despite the use of incomplete and partial training data.
  arXiv  Detail & Related papers  (2024-01-31T21:05:34Z)
• Shape Matters: Detecting Vertebral Fractures Using Differentiable Point-Based Shape Decoding [51.38395069380457]
  Degenerative spinal pathologies are highly prevalent among the elderly population. Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability. In this study, we specifically explore the use of shape auto-encoders for vertebrae.
  arXiv  Detail & Related papers  (2023-12-08T18:11:22Z)
• Meta-Analysis of Transfer Learning for Segmentation of Brain Lesions [0.0]
  Manual segmentation of stroke lesions from 3D magnetic resonance (MR) imaging volumes, the current gold standard, is not only very time-consuming, but its accuracy highly depends on the operator's experience. We have implemented and tested a fully automatic method for stroke lesion segmentation using eight different 2D-model architectures trained via transfer learning (TL) and mixed data approaches. Cross-validation results indicate that our new method can efficiently and automatically segment lesions fast and with high accuracy compared to ground truth.
  arXiv  Detail & Related papers  (2023-06-20T17:42:30Z)
• Context-Aware Transformers For Spinal Cancer Detection and Radiological Grading [70.04389979779195]
  This paper proposes a novel transformer-based model architecture for medical imaging problems involving analysis of vertebrae. It considers two applications of such models in MR images: (a) detection of spinal metastases and the related conditions of vertebral fractures and metastatic cord compression. We show that by considering the context of vertebral bodies in the image, SCT improves the accuracy for several gradings compared to previously published model.
  arXiv  Detail & Related papers  (2022-06-27T10:31:03Z)
• Assessment of Data Consistency through Cascades of Independently Recurrent Inference Machines for fast and robust accelerated MRI reconstruction [0.0]
  Data Consistency (DC) is crucial for generalization in multi-modal data and robustness in detecting pathology. This work proposes the Cascades of Independently Recurrent Inference Machines (CIRIM) to assess DC through unrolled optimization. We show that the CIRIM performs best when implicitly enforcing DC, while the E2EVN requires explicitly formulated DC.
  arXiv  Detail & Related papers  (2021-11-30T15:34:30Z)
• SpineOne: A One-Stage Detection Framework for Degenerative Discs and Vertebrae [54.751251046196494]
  We propose a one-stage detection framework termed SpineOne to simultaneously localize and classify degenerative discs and vertebrae from MRI slices. SpineOne is built upon the following three key techniques: 1) a new design of the keypoint heatmap to facilitate simultaneous keypoint localization and classification; 2) the use of attention modules to better differentiate the representations between discs and vertebrae; and 3) a novel gradient-guided objective association mechanism to associate multiple learning objectives at the later training stage.
  arXiv  Detail & Related papers  (2021-10-28T12:59:06Z)
• Unsupervised-learning-based method for chest MRI-CT transformation using structure constrained unsupervised generative attention networks [0.0]
  The integrated positron emission tomography/magnetic resonance imaging (PET/MRI) scanner facilitates the simultaneous acquisition of metabolic information via PET and morphological information using MRI. PET/MRI requires the generation of attenuation-correction maps from MRI owing to no direct relationship between the gamma-ray attenuation information and MRIs. This paper presents a means to minimise the anatomical structural changes without human annotation by adding structural constraints using a modality-independent neighbourhood descriptor (MIND) to a generative adversarial network (GAN) that can transform unpaired images.
  arXiv  Detail & Related papers  (2021-06-16T05:22:27Z)
• Three-dimensional Segmentation of the Scoliotic Spine from MRI using Unsupervised Volume-based MR-CT Synthesis [3.6273410177512275]
  We present an unsupervised, fully three-dimensional (3D) cross-modality synthesis method for segmenting scoliotic spines. A 3D CycleGAN model is trained for an unpaired volume-to-volume translation across MR and CT domains. The resulting segmentation is used to reconstruct a 3D model of the spine.
  arXiv  Detail & Related papers  (2020-11-25T18:34:52Z)
• 4D Deep Learning for Multiple Sclerosis Lesion Activity Segmentation [49.32653090178743]
  We investigate whether extending this problem to full 4D deep learning using a history of MRI volumes can improve performance. We find that our proposed architecture outperforms previous approaches with a lesion-wise true positive rate of 0.84 at a lesion-wise false positive rate of 0.19.
  arXiv  Detail & Related papers  (2020-04-20T11:41:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.