A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

• URL: http://arxiv.org/abs/2008.07628v1
• Date: Mon, 17 Aug 2020 21:26:02 GMT
• Title: A Deep Network for Joint Registration and Reconstruction of Images with Pathologies
• Authors: Xu Han, Zhengyang Shen, Zhenlin Xu, Spyridon Bakas, Hamed Akbari, Michel Bilello, Christos Davatzikos, Marc Niethammer
• Abstract summary: We propose a deep learning approach to register images with brain tumors to an atlas. Our model learns an appearance mapping from images with tumors to the atlas, while simultaneously predicting the transformation to atlas space. Results on both synthetic and real brain tumor scans show that our approach outperforms cost function masking for registration to the atlas.
• Score: 23.482220384665165
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Registration of images with pathologies is challenging due to tissue appearance changes and missing correspondences caused by the pathologies. Moreover, mass effects as observed for brain tumors may displace tissue, creating larger deformations over time than what is observed in a healthy brain. Deep learning models have successfully been applied to image registration to offer dramatic speed up and to use surrogate information (e.g., segmentations) during training. However, existing approaches focus on learning registration models using images from healthy patients. They are therefore not designed for the registration of images with strong pathologies for example in the context of brain tumors, and traumatic brain injuries. In this work, we explore a deep learning approach to register images with brain tumors to an atlas. Our model learns an appearance mapping from images with tumors to the atlas, while simultaneously predicting the transformation to atlas space. Using separate decoders, the network disentangles the tumor mass effect from the reconstruction of quasi-normal images. Results on both synthetic and real brain tumor scans show that our approach outperforms cost function masking for registration to the atlas and that reconstructed quasi-normal images can be used for better longitudinal registrations.

Related papers

• Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
  We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively. We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
  arXiv  Detail & Related papers  (2024-09-18T13:40:59Z)
• Deepfake Image Generation for Improved Brain Tumor Segmentation [0.0]
  This work investigates the feasibility of employing deep-fake image generation for effective brain tumor segmentation. A Generative Adversarial Network was used for image-to-image translation and image segmentation using a U-Net-based convolutional neural network trained with deepfake images. Results show improved performance in terms of image segmentation quality metrics, and could potentially assist when training with limited data.
  arXiv  Detail & Related papers  (2023-07-26T16:11:51Z)
• Joint fMRI Decoding and Encoding with Latent Embedding Alignment [77.66508125297754]
  We introduce a unified framework that addresses both fMRI decoding and encoding. Our model concurrently recovers visual stimuli from fMRI signals and predicts brain activity from images within a unified framework.
  arXiv  Detail & Related papers  (2023-03-26T14:14:58Z)
• MetaMorph: Learning Metamorphic Image Transformation With Appearance Changes [7.248454903977972]
  We present a novel predictive model, MetaMorph, for registration of images with appearance changes (i.e., caused by brain tumors) Our model introduces a new regularization that can effectively suppress the negative effects of appearance changing areas. We validate MetaMorph on real 3D human brain tumor magnetic resonance imaging (MRI) scans.
  arXiv  Detail & Related papers  (2023-03-08T19:30:58Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• Subject-Specific Lesion Generation and Pseudo-Healthy Synthesis for Multiple Sclerosis Brain Images [1.7328025136996081]
  We present a novel generative method for modelling the local lesion characteristics. It can generate synthetic lesions on healthy images and synthesize subject-specific pseudo-healthy images from pathological images. The proposed method can be used as a data augmentation module to generate synthetic images for training brain image segmentation networks.
  arXiv  Detail & Related papers  (2022-08-03T15:12:55Z)
• Triplet Contrastive Learning for Brain Tumor Classification [99.07846518148494]
  We present a novel approach of directly learning deep embeddings for brain tumor types, which can be used for downstream tasks such as classification. We evaluate our method on an extensive brain tumor dataset which consists of 27 different tumor classes, out of which 13 are defined as rare.
  arXiv  Detail & Related papers  (2021-08-08T11:26:34Z)
• A Deep Discontinuity-Preserving Image Registration Network [73.03885837923599]
  Most deep learning-based registration methods assume that the desired deformation fields are globally smooth and continuous. We propose a weakly-supervised Deep Discontinuity-preserving Image Registration network (DDIR) to obtain better registration performance and realistic deformation fields. We demonstrate that our method achieves significant improvements in registration accuracy and predicts more realistic deformations, in registration experiments on cardiac magnetic resonance (MR) images.
  arXiv  Detail & Related papers  (2021-07-09T13:35:59Z)
• Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology [33.90454917741234]
  We propose a context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. A feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. The proposed method yielded results with increased signal-to-noise ratio, structural similarity index, peak signal-to-noise ratio, and reduced L1 error.
  arXiv  Detail & Related papers  (2021-01-17T20:38:50Z)
• Learning Deformable Registration of Medical Images with Anatomical Constraints [4.397224870979238]
  Deformable image registration is a fundamental problem in the field of medical image analysis. We learn global non-linear representations of image anatomy using segmentation masks, and employ them to constraint the registration process. Our experiments show that the proposed anatomically constrained registration model produces more realistic and accurate results than state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-01-20T17:44:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.