Brain Tumor Sequence Registration with Non-iterative Coarse-to-fine
Networks and Dual Deep Supervision
- URL: http://arxiv.org/abs/2211.07876v1
- Date: Tue, 15 Nov 2022 03:58:47 GMT
- Title: Brain Tumor Sequence Registration with Non-iterative Coarse-to-fine
Networks and Dual Deep Supervision
- Authors: Mingyuan Meng, Lei Bi, Dagan Feng, and Jinman Kim
- Abstract summary: We focus on brain tumor sequence registration between pre-operative and follow-up MRI scans of brain glioma patients.
Brain tumor registration is a fundamental requirement in brain image analysis for quantifying tumor changes.
We adopt our recently proposed Non-Iterative Coarse-to-finE registration Networks (NICE-Net) - a deep learning-based method for coarse-to-fine registering images with large deformations.
- Score: 11.795108660250843
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: In this study, we focus on brain tumor sequence registration between
pre-operative and follow-up Magnetic Resonance Imaging (MRI) scans of brain
glioma patients, in the context of Brain Tumor Sequence Registration challenge
(BraTS-Reg 2022). Brain tumor registration is a fundamental requirement in
brain image analysis for quantifying tumor changes. This is a challenging task
due to large deformations and missing correspondences between pre-operative and
follow-up scans. For this task, we adopt our recently proposed Non-Iterative
Coarse-to-finE registration Networks (NICE-Net) - a deep learning-based method
for coarse-to-fine registering images with large deformations. To overcome
missing correspondences, we extend the NICE-Net by introducing dual deep
supervision, where a deep self-supervised loss based on image similarity and a
deep weakly-supervised loss based on manually annotated landmarks are deeply
embedded into the NICE-Net. At the BraTS-Reg 2022, our method achieved a
competitive result on the validation set (mean absolute error: 3.387) and
placed 4th in the final testing phase (Score: 0.3544).
Related papers
- An Integrated Deep Learning Framework for Effective Brain Tumor
Localization, Segmentation, and Classification from Magnetic Resonance Images [0.0]
Tumors in the brain result from abnormal cell growth within the brain tissue, arising from various types of brain cells.
Our research proposes DL frameworks for localizing, segmenting, and classifying the grade of these gliomas from MRI images to solve this critical issue.
Our proposed models demonstrated promising results, with the potential to advance medical AI by enabling early diagnosis and providing more accurate treatment options for patients.
arXiv Detail & Related papers (2024-09-25T18:38:57Z) - GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration [62.41725951450803]
Learning-based deformable registration relies on weighted objective functions trading off registration accuracy and smoothness of the field.
We construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyper parameter-free balance on multiple losses.
Our method is model-agnostic and can be merged into any deep registration network without introducing extra parameters or slowing down inference.
arXiv Detail & Related papers (2023-06-26T13:32:09Z) - The Brain Tumor Segmentation (BraTS) Challenge: Local Synthesis of Healthy Brain Tissue via Inpainting [50.01582455004711]
For brain tumor patients, the image acquisition time series typically starts with an already pathological scan.
Many algorithms are designed to analyze healthy brains and provide no guarantee for images featuring lesions.
Examples include, but are not limited to, algorithms for brain anatomy parcellation, tissue segmentation, and brain extraction.
Here, the participants explore inpainting techniques to synthesize healthy brain scans from lesioned ones.
arXiv Detail & Related papers (2023-05-15T20:17:03Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - Self-supervised iRegNet for the Registration of Longitudinal Brain MRI
of Diffuse Glioma Patients [0.0]
This paper describes our contribution to the Registration of the longitudinal brain MRI task of the Brain Tumor Sequence Registration Challenge 2022 (BraTS-Reg 2022)
We developed an enhanced unsupervised learning-based method that extends the iRegNet.
Experimental findings show that the enhanced self-supervised model is able to improve the initial mean median registration absolute error (MAE) from 8.20 (7.62) mm to the lowest value of 3.51 (3.50) mm.
arXiv Detail & Related papers (2022-11-20T17:02:52Z) - Robust Image Registration with Absent Correspondences in Pre-operative
and Follow-up Brain MRI Scans of Diffuse Glioma Patients [11.4219428942199]
We propose a 3-step registration pipeline for pre-operative and follow-up brain MRI scans.
Our method achieves a median absolute error of 1.64 mm and 88% of successful registration rate in the validation set of BraTS-Reg challenge.
arXiv Detail & Related papers (2022-10-20T06:37:40Z) - Automated SSIM Regression for Detection and Quantification of Motion
Artefacts in Brain MR Images [54.739076152240024]
Motion artefacts in magnetic resonance brain images are a crucial issue.
The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis.
An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
arXiv Detail & Related papers (2022-06-14T10:16:54Z) - Weakly-supervised Biomechanically-constrained CT/MRI Registration of the
Spine [72.85011943179894]
We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration.
We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI.
Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
arXiv Detail & Related papers (2022-05-16T10:59:55Z) - Modality Completion via Gaussian Process Prior Variational Autoencoders
for Multi-Modal Glioma Segmentation [75.58395328700821]
We propose a novel model, Multi-modal Gaussian Process Prior Variational Autoencoder (MGP-VAE), to impute one or more missing sub-modalities for a patient scan.
MGP-VAE can leverage the Gaussian Process (GP) prior on the Variational Autoencoder (VAE) to utilize the subjects/patients and sub-modalities correlations.
We show the applicability of MGP-VAE on brain tumor segmentation where either, two, or three of four sub-modalities may be missing.
arXiv Detail & Related papers (2021-07-07T19:06:34Z) - Symmetric-Constrained Irregular Structure Inpainting for Brain MRI
Registration with Tumor Pathology [33.90454917741234]
We propose a context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region.
A feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features.
The proposed method yielded results with increased signal-to-noise ratio, structural similarity index, peak signal-to-noise ratio, and reduced L1 error.
arXiv Detail & Related papers (2021-01-17T20:38:50Z) - Automatic Segmentation of Non-Tumor Tissues in Glioma MR Brain Images
Using Deformable Registration with Partial Convolutional Networks [0.0]
We propose a new registration approach that first segments brain tumor using a U-Net and then simulates missed normal tissues.
By comparing direct registration with the proposed algorithm, the results showed that the Dice coefficient for gray matters was significantly improved for surrounding normal brain tissues.
arXiv Detail & Related papers (2020-07-10T07:58:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.