Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology

• URL: http://arxiv.org/abs/2101.06775v1
• Date: Sun, 17 Jan 2021 20:38:50 GMT
• Title: Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology
• Authors: Xiaofeng Liu, Fangxu Xing, Chao Yang, C.-C. Jay Kuo, Georges ElFakhri, Jonghye Woo
• Abstract summary: We propose a context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. A feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. The proposed method yielded results with increased signal-to-noise ratio, structural similarity index, peak signal-to-noise ratio, and reduced L1 error.
• Score: 33.90454917741234
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deformable registration of magnetic resonance images between patients with brain tumors and healthy subjects has been an important tool to specify tumor geometry through location alignment and facilitate pathological analysis. Since tumor region does not match with any ordinary brain tissue, it has been difficult to deformably register a patients brain to a normal one. Many patient images are associated with irregularly distributed lesions, resulting in further distortion of normal tissue structures and complicating registration's similarity measure. In this work, we follow a multi-step context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. The coarse image-to-image translation is applied to make a rough inference of the missing parts. Then, a feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. A symmetry constraint reflecting a large degree of anatomical symmetry in the brain is further proposed to achieve better structure understanding. Deformable registration is applied between inpainted patient images and normal brains, and the resulting deformation field is eventually used to deform original patient data for the final alignment. The method was applied to the Multimodal Brain Tumor Segmentation (BraTS) 2018 challenge database and compared against three existing inpainting methods. The proposed method yielded results with increased peak signal-to-noise ratio, structural similarity index, inception score, and reduced L1 error, leading to successful patient-to-normal brain image registration.

Related papers

• Bayesian Intrinsic Groupwise Image Registration: Unsupervised Disentanglement of Anatomy and Geometry [53.645443644821306]
  This article presents a general Bayesian learning framework for groupwise registration on medical images. We propose a novel hierarchical variational auto-encoding architecture to realize the inference procedure of the latent variables. Experiments were conducted to validate the proposed framework, including four datasets from cardiac, brain and abdominal medical images.
  arXiv  Detail & Related papers  (2024-01-04T08:46:39Z)
• Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images [59.85702949046042]
  We present a weakly supervised method to generate a healthy version of a diseased image and then use it to obtain a pixel-wise anomaly map. We employ a diffusion model trained on healthy samples and combine Denoising Diffusion Probabilistic Model (DDPM) and Denoising Implicit Model (DDIM) at each step of the sampling process. We verify that when our method is applied to healthy samples, the input images are reconstructed without significant modifications.
  arXiv  Detail & Related papers  (2023-08-03T21:56:50Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• Robust Image Registration with Absent Correspondences in Pre-operative and Follow-up Brain MRI Scans of Diffuse Glioma Patients [11.4219428942199]
  We propose a 3-step registration pipeline for pre-operative and follow-up brain MRI scans. Our method achieves a median absolute error of 1.64 mm and 88% of successful registration rate in the validation set of BraTS-Reg challenge.
  arXiv  Detail & Related papers  (2022-10-20T06:37:40Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• Symmetry-Enhanced Attention Network for Acute Ischemic Infarct Segmentation with Non-Contrast CT Images [50.55978219682419]
  We propose a symmetry enhanced attention network (SEAN) for acute ischemic infarct segmentation. Our proposed network automatically transforms an input CT image into the standard space where the brain tissue is bilaterally symmetric. The proposed SEAN outperforms some symmetry-based state-of-the-art methods in terms of both dice coefficient and infarct localization.
  arXiv  Detail & Related papers  (2021-10-11T07:13:26Z)
• Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalities [2.867517731896504]
  Accurately segmenting brain tumor from MR images is the key to clinical diagnostics and treatment planning. It's common to miss some imaging modalities in clinical practice. We present a novel brain tumor segmentation algorithm with missing modalities.
  arXiv  Detail & Related papers  (2021-04-13T14:21:09Z)
• A Deep Network for Joint Registration and Reconstruction of Images with Pathologies [23.482220384665165]
  We propose a deep learning approach to register images with brain tumors to an atlas. Our model learns an appearance mapping from images with tumors to the atlas, while simultaneously predicting the transformation to atlas space. Results on both synthetic and real brain tumor scans show that our approach outperforms cost function masking for registration to the atlas.
  arXiv  Detail & Related papers  (2020-08-17T21:26:02Z)
• Automatic Segmentation of Non-Tumor Tissues in Glioma MR Brain Images Using Deformable Registration with Partial Convolutional Networks [0.0]
  We propose a new registration approach that first segments brain tumor using a U-Net and then simulates missed normal tissues. By comparing direct registration with the proposed algorithm, the results showed that the Dice coefficient for gray matters was significantly improved for surrounding normal brain tissues.
  arXiv  Detail & Related papers  (2020-07-10T07:58:23Z)
• Scale-Space Autoencoders for Unsupervised Anomaly Segmentation in Brain MRI [47.26574993639482]
  We show improved anomaly segmentation performance and the general capability to obtain much more crisp reconstructions of input data at native resolution. The modeling of the laplacian pyramid further enables the delineation and aggregation of lesions at multiple scales.
  arXiv  Detail & Related papers  (2020-06-23T09:20:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.