Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration

• URL: http://arxiv.org/abs/2307.03421v1
• Date: Fri, 7 Jul 2023 07:07:42 GMT
• Title: Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration
• Authors: Mingyuan Meng, Lei Bi, Michael Fulham, Dagan Feng, and Jinman Kim
• Abstract summary: We propose a Non-Iterative Coarse-to-finE Transformer network (NICE-Trans) for image registration. Our NICE-Trans is the first deep registration method that performs joint affine and deformable coarse-to-fine registration within a single network.
• Score: 10.994223928445589
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Image registration is a fundamental requirement for medical image analysis. Deep registration methods based on deep learning have been widely recognized for their capabilities to perform fast end-to-end registration. Many deep registration methods achieved state-of-the-art performance by performing coarse-to-fine registration, where multiple registration steps were iterated with cascaded networks. Recently, Non-Iterative Coarse-to-finE (NICE) registration methods have been proposed to perform coarse-to-fine registration in a single network and showed advantages in both registration accuracy and runtime. However, existing NICE registration methods mainly focus on deformable registration, while affine registration, a common prerequisite, is still reliant on time-consuming traditional optimization-based methods or extra affine registration networks. In addition, existing NICE registration methods are limited by the intrinsic locality of convolution operations. Transformers may address this limitation for their capabilities to capture long-range dependency, but the benefits of using transformers for NICE registration have not been explored. In this study, we propose a Non-Iterative Coarse-to-finE Transformer network (NICE-Trans) for image registration. Our NICE-Trans is the first deep registration method that (i) performs joint affine and deformable coarse-to-fine registration within a single network, and (ii) embeds transformers into a NICE registration framework to model long-range relevance between images. Extensive experiments with seven public datasets show that our NICE-Trans outperforms state-of-the-art registration methods on both registration accuracy and runtime.

Related papers

• uniGradICON: A Foundation Model for Medical Image Registration [17.23463407622614]
  We propose uniGradICON, a first step toward a foundation model for registration. We extensively trained and evaluated uniGradICON on twelve different public datasets.
  arXiv  Detail & Related papers  (2024-03-09T03:26:35Z)
• RegFormer: An Efficient Projection-Aware Transformer Network for Large-Scale Point Cloud Registration [73.69415797389195]
  We propose an end-to-end transformer network (RegFormer) for large-scale point cloud alignment. Specifically, a projection-aware hierarchical transformer is proposed to capture long-range dependencies and filter outliers. Our transformer has linear complexity, which guarantees high efficiency even for large-scale scenes.
  arXiv  Detail & Related papers  (2023-03-22T08:47:37Z)
• Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images [74.99415008543276]
  Most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain. We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields. A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images. We evaluate our method on the task of intra-subject-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences.
  arXiv  Detail & Related papers  (2022-11-24T23:45:01Z)
• Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning [11.795108660250843]
  We propose a Non-Iterative Coarse-to-finE registration network (NICE-Net) for deformable image registration. NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.
  arXiv  Detail & Related papers  (2022-06-25T08:34:59Z)
• A Robust Multimodal Remote Sensing Image Registration Method and System Using Steerable Filters with First- and Second-order Gradients [7.813406811407584]
  Co-registration of multimodal remote sensing images is still an ongoing challenge because of nonlinear radiometric differences (NRD) and significant geometric distortions. In this paper, a robust matching method based on the Steerable filters is proposed consisting of two critical steps. The performance of the proposed matching method has been evaluated with many different kinds of multimodal RS images.
  arXiv  Detail & Related papers  (2022-02-27T12:22:42Z)
• CAR-Net: Unsupervised Co-Attention Guided Registration Network for Joint Registration and Structure Learning [73.03885837923599]
  We propose a novel deep learning network, Co-Attention guided Registration Network (CAR-Net) CAR-Net employs a co-attention block to learn a new representation of the inputs, which drives the registration of the fixed and moving images. Experiments on UK Biobank cardiac cine-magnetic resonance image data demonstrate that CAR-Net obtains higher registration accuracy and smoother deformation fields than state-of-the-art unsupervised registration methods.
  arXiv  Detail & Related papers  (2021-06-11T23:25:49Z)
• DeepGMR: Learning Latent Gaussian Mixture Models for Registration [113.74060941036664]
  Point cloud registration is a fundamental problem in 3D computer vision, graphics and robotics. In this paper, we introduce Deep Gaussian Mixture Registration (DeepGMR), the first learning-based registration method. Our proposed method shows favorable performance when compared with state-of-the-art geometry-based and learning-based registration methods.
  arXiv  Detail & Related papers  (2020-08-20T17:25:16Z)
• Learning 3D-3D Correspondences for One-shot Partial-to-partial Registration [66.41922513553367]
  We show that learning-based partial-to-partial registration can be achieved in a one-shot manner. We propose an Optimal Transport layer able to account for occluded points thanks to the use of bins. The resulting OPRNet framework outperforms the state of the art on standard benchmarks.
  arXiv  Detail & Related papers  (2020-06-08T12:35:47Z)
• An Auto-Context Deformable Registration Network for Infant Brain MRI [54.57017031561516]
  We propose an infant-dedicated deep registration network that uses the auto-context strategy to gradually refine the deformation fields. Our method estimates the deformation fields by invoking a single network multiple times for iterative deformation refinement. Experimental results in comparison with state-of-the-art registration methods indicate that our method achieves higher accuracy while at the same time preserves the smoothness of the deformation fields.
  arXiv  Detail & Related papers  (2020-05-19T06:00:13Z)
• A Multiple Decoder CNN for Inverse Consistent 3D Image Registration [18.017296651822857]
  Deep learning technologies have drastically decreased the registration time and increased registration accuracy. We propose a registration framework with inverse consistency. We perform training and testing of the method on the publicly available LPBA40 MRI dataset and demonstrate strong performance.
  arXiv  Detail & Related papers  (2020-02-15T23:23:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.