$\texttt{GradICON}$: Approximate Diffeomorphisms via Gradient Inverse Consistency

• URL: http://arxiv.org/abs/2206.05897v3
• Date: Tue, 4 Apr 2023 05:44:39 GMT
• Title: $\texttt{GradICON}$: Approximate Diffeomorphisms via Gradient Inverse Consistency
• Authors: Lin Tian, Hastings Greer, Fran\c{c}ois-Xavier Vialard, Roland Kwitt, Ra\'ul San Jos\'e Est\'epar, Richard Jarrett Rushmore, Nikolaos Makris, Sylvain Bouix, Marc Niethammer
• Abstract summary: We use a neural network to predict a map between a source and a target image as well as the map when swapping the source and target images. We achieve state-of-the-art registration performance on a variety of real-world medical image datasets.
• Score: 16.72466200341455
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: We present an approach to learning regular spatial transformations between image pairs in the context of medical image registration. Contrary to optimization-based registration techniques and many modern learning-based methods, we do not directly penalize transformation irregularities but instead promote transformation regularity via an inverse consistency penalty. We use a neural network to predict a map between a source and a target image as well as the map when swapping the source and target images. Different from existing approaches, we compose these two resulting maps and regularize deviations of the $\bf{Jacobian}$ of this composition from the identity matrix. This regularizer -- $\texttt{GradICON}$ -- results in much better convergence when training registration models compared to promoting inverse consistency of the composition of maps directly while retaining the desirable implicit regularization effects of the latter. We achieve state-of-the-art registration performance on a variety of real-world medical image datasets using a single set of hyperparameters and a single non-dataset-specific training protocol.

Related papers

• MsMorph: An Unsupervised pyramid learning network for brain image registration [4.000367245594772]
  MsMorph is an image registration framework aimed at mimicking the manual process of registering image pairs. It decodes semantic information at different scales and continuously compen-sates for the predicted deformation field. The proposed method simulates the manual approach to registration, focusing on different regions of the image pairs and their neighborhoods.
  arXiv  Detail & Related papers  (2024-10-23T19:20:57Z)
• SITReg: Multi-resolution architecture for symmetric, inverse consistent, and topology preserving image registration [7.5986411724707095]
  We propose a novel deep learning registration architecture based on extracting multi-resolution feature representations. Our method achieves state-of-the-art registration accuracy on two datasets.
  arXiv  Detail & Related papers  (2023-03-17T19:00:24Z)
• Robust One-shot Segmentation of Brain Tissues via Image-aligned Style Transformation [13.430851964063534]
  We propose a novel image-aligned style transformation to reinforce the dual-model iterative learning for one-shot segmentation of brain tissues. Experimental results on two public datasets demonstrate 1) a competitive segmentation performance of our method compared to the fully-supervised method, and 2) a superior performance over other state-of-the-art with an increase of average Dice by up to 4.67%.
  arXiv  Detail & Related papers  (2022-11-26T09:14:01Z)
• Smooth image-to-image translations with latent space interpolations [64.8170758294427]
  Multi-domain image-to-image (I2I) translations can transform a source image according to the style of a target domain. We show that our regularization techniques can improve the state-of-the-art I2I translations by a large margin.
  arXiv  Detail & Related papers  (2022-10-03T11:57:30Z)
• A training-free recursive multiresolution framework for diffeomorphic deformable image registration [6.929709872589039]
  We propose a novel diffeomorphic training-free approach for deformable image registration. The proposed architecture is simple in design. The moving image is warped successively at each resolution and finally aligned to the fixed image. The entire system is end-to-end and optimized for each pair of images from scratch.
  arXiv  Detail & Related papers  (2022-02-01T15:17:17Z)
• Dual-Flow Transformation Network for Deformable Image Registration with Region Consistency Constraint [95.30864269428808]
  Current deep learning (DL)-based image registration approaches learn the spatial transformation from one image to another by leveraging a convolutional neural network. We present a novel dual-flow transformation network with region consistency constraint which maximizes the similarity of ROIs within a pair of images. Experiments on four public 3D MRI datasets show that the proposed method achieves the best registration performance in accuracy and generalization.
  arXiv  Detail & Related papers  (2021-12-04T05:30:44Z)
• A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection [93.38607559281601]
  We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image. The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
  arXiv  Detail & Related papers  (2021-04-29T17:49:48Z)
• Seed the Views: Hierarchical Semantic Alignment for Contrastive Representation Learning [116.91819311885166]
  We propose a hierarchical semantic alignment strategy via expanding the views generated by a single image to textbfCross-samples and Multi-level representation. Our method, termed as CsMl, has the ability to integrate multi-level visual representations across samples in a robust way.
  arXiv  Detail & Related papers  (2020-12-04T17:26:24Z)
• FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning [64.32306537419498]
  We propose a novel learned feature-based refinement and augmentation method that produces a varied set of complex transformations. These transformations also use information from both within-class and across-class representations that we extract through clustering. We demonstrate that our method is comparable to current state of art for smaller datasets while being able to scale up to larger datasets.
  arXiv  Detail & Related papers  (2020-07-16T17:55:31Z)
• Image-to-image Mapping with Many Domains by Sparse Attribute Transfer [71.28847881318013]
  Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. Current convention is to approach this task with cycle-consistent GANs. We propose an alternate approach that directly restricts the generator to performing a simple sparse transformation in a latent layer.
  arXiv  Detail & Related papers  (2020-06-23T19:52:23Z)
• Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks [11.4219428942199]
  We present a novel, efficient unsupervised symmetric image registration method. We evaluate our method on 3D image registration with a large scale brain image dataset.
  arXiv  Detail & Related papers  (2020-03-20T22:07:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.