SynthMorph: learning contrast-invariant registration without acquired images

• URL: http://arxiv.org/abs/2004.10282v4
• Date: Thu, 3 Mar 2022 14:46:48 GMT
• Title: SynthMorph: learning contrast-invariant registration without acquired images
• Authors: Malte Hoffmann, Benjamin Billot, Douglas N. Greve, Juan Eugenio Iglesias, Bruce Fischl, Adrian V. Dalca
• Abstract summary: We introduce a strategy for learning image registration without acquired imaging data. We show that this strategy enables robust and accurate registration of arbitrary MRI contrasts.
• Score: 8.0963891430422
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph.

Related papers

• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Autoregressive Sequence Modeling for 3D Medical Image Representation [48.706230961589924]
  We introduce a pioneering method for learning 3D medical image representations through an autoregressive sequence pre-training framework. Our approach various 3D medical images based on spatial, contrast, and semantic correlations, treating them as interconnected visual tokens within a token sequence.
  arXiv  Detail & Related papers  (2024-09-13T10:19:10Z)
• Anatomy-aware and acquisition-agnostic joint registration with SynthMorph [6.017634371712142]
  Affine image registration is a cornerstone of medical image analysis. Deep-learning (DL) methods learn a function that maps an image pair to an output transform. Most affine methods are agnostic to the anatomy the user wishes to align, meaning the registration will be inaccurate if algorithms consider all structures in the image. We address these shortcomings with SynthMorph, a fast, symmetric, diffeomorphic, and easy-to-use DL tool for joint affine-deformable registration of any brain image.
  arXiv  Detail & Related papers  (2023-01-26T18:59:33Z)
• Multi-scale Transformer Network with Edge-aware Pre-training for Cross-Modality MR Image Synthesis [52.41439725865149]
  Cross-modality magnetic resonance (MR) image synthesis can be used to generate missing modalities from given ones. Existing (supervised learning) methods often require a large number of paired multi-modal data to train an effective synthesis model. We propose a Multi-scale Transformer Network (MT-Net) with edge-aware pre-training for cross-modality MR image synthesis.
  arXiv  Detail & Related papers  (2022-12-02T11:40:40Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• SynthStrip: Skull-Stripping for Any Brain Image [7.846209440615028]
  We introduce SynthStrip, a rapid, learning-based brain-extraction tool. By leveraging anatomical segmentations, SynthStrip generates a synthetic training dataset with anatomies, intensity distributions, and artifacts that far exceed the realistic range of medical images. We show substantial improvements in accuracy over popular skull-stripping baselines - all with a single trained model.
  arXiv  Detail & Related papers  (2022-03-18T14:08:20Z)
• Deformable Image Registration using Neural ODEs [15.245085400790002]
  We present a generic, fast, and accurate diffeomorphic image registration framework that leverages neural ordinary differential equations (NODEs) Compared with traditional optimization-based methods, our framework reduces the running time from tens of minutes to tens of seconds. Our experiments show that the registration results of our method outperform state-of-the-arts under various metrics.
  arXiv  Detail & Related papers  (2021-08-07T12:54:17Z)
• Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation [60.663499381212425]
  We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique. In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
  arXiv  Detail & Related papers  (2021-04-05T13:05:22Z)
• Exploring Intensity Invariance in Deep Neural Networks for Brain Image Registration [0.0]
  We investigate the effect of intensity distribution among input image pairs for deep learning-based image registration methods. Deep learning models trained with structure similarity-based loss seems to perform better for both datasets.
  arXiv  Detail & Related papers  (2020-09-21T17:49:03Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)
• A Learning Strategy for Contrast-agnostic MRI Segmentation [8.264160978159634]
  We present a deep learning strategy that enables, for the first time, contrast-agnostic semantic segmentation of unpreprocessed brain MRI scans. Our proposed learning method, SynthSeg, generates synthetic sample images of widely varying contrasts on the fly during training. We evaluate our approach on four datasets comprising over 1,000 subjects and four types of MR contrast.
  arXiv  Detail & Related papers  (2020-03-04T11:00:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.