Deformable Image Registration with Deep Network Priors: a Study on Longitudinal PET Images

• URL: http://arxiv.org/abs/2111.11873v1
• Date: Mon, 22 Nov 2021 10:58:14 GMT
• Title: Deformable Image Registration with Deep Network Priors: a Study on Longitudinal PET Images
• Authors: Constance Fourcadea, Ludovic Ferrer, Noemie Moreau, Gianmarco Santini, Aishlinn Brennan, Caroline Rousseau, Marie Lacombe, Vincent Fleury, Mathilde Colombi\'e, Pascal J\'ez\'equel, Mario Campone, Mathieu Rubeaux, Diana Mateus
• Abstract summary: Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers to tackle the image registration question. We propose a subject-specific deformable registration method called MIRRBA, relying on a deep pyramidal architecture to be the prior model constraining the deformation field. We demonstrate the regularizing power of deep architectures and present new elements to understand the role of the architecture in deep learning methods for registration.
• Score: 0.5949967357689445
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Longitudinal image registration is challenging and has not yet benefited from major performance improvements thanks to deep-learning. Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers to tackle the image registration question. We propose a subject-specific deformable registration method called MIRRBA, relying on a deep pyramidal architecture to be the prior parametric model constraining the deformation field. Diverging from the supervised learning paradigm, MIRRBA does not require a learning database, but only the pair of images to be registered to optimize the network's parameters and provide a deformation field. We demonstrate the regularizing power of deep architectures and present new elements to understand the role of the architecture in deep learning methods for registration. Hence, to study the impact of the network parameters, we ran our method with different architectural configurations on a private dataset of 110 metastatic breast cancer full-body PET images with manual segmentations of the brain, bladder and metastatic lesions. We compared it against conventional iterative registration approaches and supervised deep learning-based models. Global and local registration accuracies were evaluated using the detection rate and the Dice score respectively, while registration realism was evaluated using the Jacobian's determinant. Moreover, we computed the ability of the different methods to shrink vanishing lesions with the disappearing rate. MIRRBA significantly improves the organ and lesion Dice scores of supervised models. Regarding the disappearing rate, MIRRBA more than doubles the best performing conventional approach SyNCC score. Our work therefore proposes an alternative way to bridge the performance gap between conventional and deep learning-based methods and demonstrates the regularizing power of deep architectures.

Related papers

• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• Recurrent Inference Machine for Medical Image Registration [11.351457718409788]
  We propose a novel image registration method, termed Recurrent Inference Image Registration (RIIR) network. RIIR is formulated as a meta-learning solver to the registration problem in an iterative manner. Our experiments showed that RIIR outperformed a range of deep learning-based methods, even with only $5%$ of the training data.
  arXiv  Detail & Related papers  (2024-06-19T10:06:35Z)
• Adapting the Mean Teacher for keypoint-based lung registration under geometric domain shifts [75.51482952586773]
  deep neural networks generally require plenty of labeled training data and are vulnerable to domain shifts between training and test data. We present a novel approach to geometric domain adaptation for image registration, adapting a model from a labeled source to an unlabeled target domain. Our method consistently improves on the baseline model by 50%/47% while even matching the accuracy of models trained on target data.
  arXiv  Detail & Related papers  (2022-07-01T12:16:42Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• A Learning Framework for Diffeomorphic Image Registration based on Quasi-conformal Geometry [1.2891210250935146]
  We propose the quasi-conformal registration network (QCRegNet), an unsupervised learning framework, to obtain diffeomorphic 2D image registrations. QCRegNet consists of the estimator network and the Beltrami solver network (BSNet) Results show that the registration accuracy is comparable to state-of-the-art methods and diffeomorphism is to a great extent guaranteed.
  arXiv  Detail & Related papers  (2021-10-20T14:23:24Z)
• Test-Time Training for Deformable Multi-Scale Image Registration [15.523457398508263]
  Deep learning-based registration approaches such as VoxelMorph have been emerging and achieve competitive performance. We construct a test-time training for deep deformable image registration to improve the generalization ability of conventional learning-based registration model.
  arXiv  Detail & Related papers  (2021-03-25T03:22:59Z)
• Shared Prior Learning of Energy-Based Models for Image Reconstruction [69.72364451042922]
  We propose a novel learning-based framework for image reconstruction particularly designed for training without ground truth data. In the absence of ground truth data, we change the loss functional to a patch-based Wasserstein functional. In shared prior learning, both aforementioned optimal control problems are optimized simultaneously with shared learned parameters of the regularizer.
  arXiv  Detail & Related papers  (2020-11-12T17:56:05Z)
• Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networks [11.4219428942199]
  We propose a deep Laplacian Pyramid Image Registration Network to solve the image registration optimization problem. Our method outperforms the existing methods by a significant margin while maintaining desirable diffeomorphic properties and promising registration speed.
  arXiv  Detail & Related papers  (2020-06-29T16:10:40Z)
• An Auto-Context Deformable Registration Network for Infant Brain MRI [54.57017031561516]
  We propose an infant-dedicated deep registration network that uses the auto-context strategy to gradually refine the deformation fields. Our method estimates the deformation fields by invoking a single network multiple times for iterative deformation refinement. Experimental results in comparison with state-of-the-art registration methods indicate that our method achieves higher accuracy while at the same time preserves the smoothness of the deformation fields.
  arXiv  Detail & Related papers  (2020-05-19T06:00:13Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.