Dense Error Map Estimation for MRI-Ultrasound Registration in Brain
Tumor Surgery Using Swin UNETR
- URL: http://arxiv.org/abs/2308.10784v1
- Date: Mon, 21 Aug 2023 15:19:32 GMT
- Title: Dense Error Map Estimation for MRI-Ultrasound Registration in Brain
Tumor Surgery Using Swin UNETR
- Authors: Soorena Salari, Amirhossein Rasoulian, Hassan Rivaz, Yiming Xiao
- Abstract summary: Intra-operative ultrasound can track brain shift, and MRI-iUS registration techniques can update pre-surgical plans.
However, manual assessment of MRI-iUS registration results in real-time is difficult and prone to errors due to the 3D nature of the data.
We propose a novel deep-learning (DL) based framework with the Swin UNETR to automatically assess 3D-patch-wise dense error maps for MRI-iUS registration in iUS-guided brain tumor resection.
- Score: 2.64700310378485
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Early surgical treatment of brain tumors is crucial in reducing patient
mortality rates. However, brain tissue deformation (called brain shift) occurs
during the surgery, rendering pre-operative images invalid. As a cost-effective
and portable tool, intra-operative ultrasound (iUS) can track brain shift, and
accurate MRI-iUS registration techniques can update pre-surgical plans and
facilitate the interpretation of iUS. This can boost surgical safety and
outcomes by maximizing tumor removal while avoiding eloquent regions. However,
manual assessment of MRI-iUS registration results in real-time is difficult and
prone to errors due to the 3D nature of the data. Automatic algorithms that can
quantify the quality of inter-modal medical image registration outcomes can be
highly beneficial. Therefore, we propose a novel deep-learning (DL) based
framework with the Swin UNETR to automatically assess 3D-patch-wise dense error
maps for MRI-iUS registration in iUS-guided brain tumor resection and show its
performance with real clinical data for the first time.
Related papers
- Brain Tumor Segmentation Based on Deep Learning, Attention Mechanisms, and Energy-Based Uncertainty Prediction [0.0]
Brain tumors are one of the deadliest forms of cancer with a mortality rate of over 80%.
In medical analysis, the manual annotation and segmentation of a brain tumor can be a complicated task.
This paper proposes a region of interest detection algorithm that is implemented during data preprocessing to locate salient features and remove extraneous MRI data.
A fully convolutional autoencoder with soft attention segments the different brain MRIs.
arXiv Detail & Related papers (2023-12-31T20:42:52Z) - Automatic registration with continuous pose updates for marker-less
surgical navigation in spine surgery [52.63271687382495]
We present an approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner.
A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models.
An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system.
arXiv Detail & Related papers (2023-08-05T16:26:41Z) - FocalErrorNet: Uncertainty-aware focal modulation network for
inter-modal registration error estimation in ultrasound-guided neurosurgery [3.491999371287298]
Intra-operative tissue deformation (called brain shift) can move the surgical target and render the pre-surgical plan invalid.
We propose a novel deep learning technique based on 3D focal modulation in conjunction with uncertainty estimation to accurately assess MRI-iUS registration errors for brain tumor surgery.
arXiv Detail & Related papers (2023-07-26T21:42:22Z) - Brain Tumor Segmentation from MRI Images using Deep Learning Techniques [3.1498833540989413]
A public MRI dataset contains 3064 TI-weighted images from 233 patients with three variants of brain tumor, viz. meningioma, glioma, and pituitary tumor.
The dataset files were converted and preprocessed before indulging into the methodology which employs implementation and training of some well-known image segmentation deep learning models.
The experimental findings showed that among all the applied approaches, the recurrent residual U-Net which uses Adam reaches a Mean Intersection Over Union of 0.8665 and outperforms other compared state-of-the-art deep learning models.
arXiv Detail & Related papers (2023-04-29T13:33:21Z) - Live image-based neurosurgical guidance and roadmap generation using
unsupervised embedding [53.992124594124896]
We present a method for live image-only guidance leveraging a large data set of annotated neurosurgical videos.
A generated roadmap encodes the common anatomical paths taken in surgeries in the training set.
We trained and evaluated the proposed method with a data set of 166 transsphenoidal adenomectomy procedures.
arXiv Detail & Related papers (2023-03-31T12:52:24Z) - Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks.
In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics.
Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
arXiv Detail & Related papers (2022-09-19T09:43:19Z) - Weakly-supervised Biomechanically-constrained CT/MRI Registration of the
Spine [72.85011943179894]
We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration.
We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI.
Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
arXiv Detail & Related papers (2022-05-16T10:59:55Z) - A Long Short-term Memory Based Recurrent Neural Network for
Interventional MRI Reconstruction [50.1787181309337]
We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling.
The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
arXiv Detail & Related papers (2022-03-28T14:03:45Z) - A unified 3D framework for Organs at Risk Localization and Segmentation
for Radiation Therapy Planning [56.52933974838905]
Current medical workflow requires manual delineation of organs-at-risk (OAR)
In this work, we aim to introduce a unified 3D pipeline for OAR localization-segmentation.
Our proposed framework fully enables the exploitation of 3D context information inherent in medical imaging.
arXiv Detail & Related papers (2022-03-01T17:08:41Z) - 3D AGSE-VNet: An Automatic Brain Tumor MRI Data Segmentation Framework [3.0261170901794308]
Glioma is the most common brain malignant tumor, with a high morbidity rate and a mortality rate of more than three percent.
The main method of acquiring brain tumors in the clinic is MRI of brain tumor regions from multi-modal MRI scan images.
We propose an automatic brain tumor MRI data segmentation framework which is called AGSE-VNet.
arXiv Detail & Related papers (2021-07-26T09:04:59Z) - QuickTumorNet: Fast Automatic Multi-Class Segmentation of Brain Tumors [0.0]
Manual segmentation of brain tumors from 3D MRI volumes is a time-consuming task.
Our model, QuickTumorNet, demonstrated fast, reliable, and accurate brain tumor segmentation.
arXiv Detail & Related papers (2020-12-22T23:16:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.