Conditional Deformable Image Registration with Convolutional Neural Network

• URL: http://arxiv.org/abs/2106.12673v1
• Date: Wed, 23 Jun 2021 22:25:28 GMT
• Title: Conditional Deformable Image Registration with Convolutional Neural Network
• Authors: Tony C. W. Mok and Albert C. S. Chung
• Abstract summary: We propose a conditional image registration method and a new self-supervised learning paradigm for deep deformable image registration. Our proposed method enables the precise control of the smoothness of the deformation field without sacrificing the runtime advantage or registration accuracy.
• Score: 15.83842747998493
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent deep learning-based methods have shown promising results and runtime advantages in deformable image registration. However, analyzing the effects of hyperparameters and searching for optimal regularization parameters prove to be too prohibitive in deep learning-based methods. This is because it involves training a substantial number of separate models with distinct hyperparameter values. In this paper, we propose a conditional image registration method and a new self-supervised learning paradigm for deep deformable image registration. By learning the conditional features that correlated with the regularization hyperparameter, we demonstrate that optimal solutions with arbitrary hyperparameters can be captured by a single deep convolutional neural network. In addition, the smoothness of the resulting deformation field can be manipulated with arbitrary strength of smoothness regularization during inference. Extensive experiments on a large-scale brain MRI dataset show that our proposed method enables the precise control of the smoothness of the deformation field without sacrificing the runtime advantage or registration accuracy.

Related papers

• HyperPredict: Estimating Hyperparameter Effects for Instance-Specific Regularization in Deformable Image Registration [2.2252684361733293]
  Methods for medical image registration infer geometric transformations that align pairs/groups of images by maximising an image similarity metric. Regularization terms are essential to obtain meaningful registration results. We propose a method for evaluating the influence of hyper parameters and subsequently selecting an optimal value for given image pairs.
  arXiv  Detail & Related papers  (2024-03-04T14:17:30Z)
• GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration [62.41725951450803]
  Learning-based deformable registration relies on weighted objective functions trading off registration accuracy and smoothness of the field. We construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyper parameter-free balance on multiple losses. Our method is model-agnostic and can be merged into any deep registration network without introducing extra parameters or slowing down inference.
  arXiv  Detail & Related papers  (2023-06-26T13:32:09Z)
• Learning the Effect of Registration Hyperparameters with HyperMorph [7.313453912494172]
  We introduce HyperMorph, a framework that facilitates efficient hyperparameter tuning in learning-based deformable image registration. We show that it enables fast, high-resolution hyperparameter search at test-time, reducing the inefficiency of traditional approaches.
  arXiv  Detail & Related papers  (2022-03-30T21:30:06Z)
• DiffuseMorph: Unsupervised Deformable Image Registration Along Continuous Trajectory Using Diffusion Models [31.826844124173984]
  We present a novel approach of diffusion model-based probabilistic image registration, called DiffuseMorph. Our model learns the score function of the deformation between moving and fixed images. Our method can provide flexible and accurate deformation with a capability of topology preservation.
  arXiv  Detail & Related papers  (2021-12-09T08:41:23Z)
• An Adaptive Framework for Learning Unsupervised Depth Completion [59.17364202590475]
  We present a method to infer a dense depth map from a color image and associated sparse depth measurements. We show that regularization and co-visibility are related via the fitness of the model to data and can be unified into a single framework.
  arXiv  Detail & Related papers  (2021-06-06T02:27:55Z)
• Learning a Model-Driven Variational Network for Deformable Image Registration [89.9830129923847]
  VR-Net is a novel cascaded variational network for unsupervised deformable image registration. It outperforms state-of-the-art deep learning methods on registration accuracy. It maintains the fast inference speed of deep learning and the data-efficiency of variational model.
  arXiv  Detail & Related papers  (2021-05-25T21:37:37Z)
• HyperMorph: Amortized Hyperparameter Learning for Image Registration [8.13669868327082]
  HyperMorph is a learning-based strategy for deformable image registration. We show that it can be used to optimize multiple hyper parameters considerably faster than existing search strategies.
  arXiv  Detail & Related papers  (2021-01-04T15:39:16Z)
• Deep Learning for Regularization Prediction in Diffeomorphic Image Registration [8.781861951759948]
  We introduce a novel framework that automatically determines the parameters controlling the smoothness of diffeomorphic transformations. We develop a predictive model based on deep convolutional neural networks (CNN) that learns the mapping between pairwise images and the regularization parameter of image registration. Experimental results show that our model not only predicts appropriate regularization parameters for image registration, but also improving the network training in terms of time and memory efficiency.
  arXiv  Detail & Related papers  (2020-11-28T22:56:44Z)
• Adaptive Gradient Method with Resilience and Momentum [120.83046824742455]
  We propose an Adaptive Gradient Method with Resilience and Momentum (AdaRem) AdaRem adjusts the parameter-wise learning rate according to whether the direction of one parameter changes in the past is aligned with the direction of the current gradient. Our method outperforms previous adaptive learning rate-based algorithms in terms of the training speed and the test error.
  arXiv  Detail & Related papers  (2020-10-21T14:49:00Z)
• Learning to Learn Parameterized Classification Networks for Scalable Input Images [76.44375136492827]
  Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. We employ meta learners to generate convolutional weights of main networks for various input scales. We further utilize knowledge distillation on the fly over model predictions based on different input resolutions.
  arXiv  Detail & Related papers  (2020-07-13T04:27:25Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.