Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration

• URL: http://arxiv.org/abs/2406.00123v2
• Date: Wed, 12 Jun 2024 12:21:52 GMT
• Title: Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration
• Authors: Mingyuan Meng, Dagan Feng, Lei Bi, Jinman Kim,
• Abstract summary: We propose a correlation-aware registration network (CorrMLP) for deformable medical image registration. Our CorrMLP introduces a correlation-aware multi-window block in a novel coarse-to-fine registration architecture. Our experiments with seven public medical datasets show that our CorrMLP outperforms state-of-the-art deformable registration methods.
• Score: 12.011187308375318
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Deformable image registration is a fundamental step for medical image analysis. Recently, transformers have been used for registration and outperformed Convolutional Neural Networks (CNNs). Transformers can capture long-range dependence among image features, which have been shown beneficial for registration. However, due to the high computation/memory loads of self-attention, transformers are typically used at downsampled feature resolutions and cannot capture fine-grained long-range dependence at the full image resolution. This limits deformable registration as it necessitates precise dense correspondence between each image pixel. Multi-layer Perceptrons (MLPs) without self-attention are efficient in computation/memory usage, enabling the feasibility of capturing fine-grained long-range dependence at full resolution. Nevertheless, MLPs have not been extensively explored for image registration and are lacking the consideration of inductive bias crucial for medical registration tasks. In this study, we propose the first correlation-aware MLP-based registration network (CorrMLP) for deformable medical image registration. Our CorrMLP introduces a correlation-aware multi-window MLP block in a novel coarse-to-fine registration architecture, which captures fine-grained multi-range dependence to perform correlation-aware coarse-to-fine registration. Extensive experiments with seven public medical datasets show that our CorrMLP outperforms state-of-the-art deformable registration methods.

Related papers

• Full-resolution MLPs Empower Medical Dense Prediction [11.195630893999203]
  Multi-layer Perceptrons (MLPs) are superior alternatives to transformers in medical dense prediction. Our framework achieves state-of-the-art performance on various medical dense prediction tasks.
  arXiv  Detail & Related papers  (2023-11-28T11:32:23Z)
• Improving Misaligned Multi-modality Image Fusion with One-stage Progressive Dense Registration [67.23451452670282]
  Misalignments between multi-modality images pose challenges in image fusion. We propose a Cross-modality Multi-scale Progressive Dense Registration scheme. This scheme accomplishes the coarse-to-fine registration exclusively using a one-stage optimization.
  arXiv  Detail & Related papers  (2023-08-22T03:46:24Z)
• Recurrence With Correlation Network for Medical Image Registration [66.63200823918429]
  We present Recurrence with Correlation Network (RWCNet), a medical image registration network with multi-scale features and a cost volume layer. We demonstrate that these architectural features improve medical image registration accuracy in two image registration datasets.
  arXiv  Detail & Related papers  (2023-02-05T02:41:46Z)
• Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images [74.99415008543276]
  Most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain. We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields. A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images. We evaluate our method on the task of intra-subject-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences.
  arXiv  Detail & Related papers  (2022-11-24T23:45:01Z)
• Unsupervised Echocardiography Registration through Patch-based MLPs and Transformers [6.330832343516528]
  This work introduces three patch-based frameworks for image registration using transformers and patches. We demonstrate comparable and even better registration performance than a popular CNN registration model.
  arXiv  Detail & Related papers  (2022-11-21T17:59:04Z)
• Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning [11.795108660250843]
  We propose a Non-Iterative Coarse-to-finE registration network (NICE-Net) for deformable image registration. NICE-Net can outperform state-of-the-art iterative deep registration methods while only requiring similar runtime to non-iterative methods.
  arXiv  Detail & Related papers  (2022-06-25T08:34:59Z)
• UNeXt: MLP-based Rapid Medical Image Segmentation Network [80.16644725886968]
  UNet and its latest extensions like TransUNet have been the leading medical image segmentation methods in recent years. We propose UNeXt which is a Convolutional multilayer perceptron based network for image segmentation. We show that we reduce the number of parameters by 72x, decrease the computational complexity by 68x, and improve the inference speed by 10x while also obtaining better segmentation performance.
  arXiv  Detail & Related papers  (2022-03-09T18:58:22Z)
• A Transformer-based Network for Deformable Medical Image Registration [5.388525884890891]
  Deformable medical image registration plays an important role in clinical diagnosis and treatment. Deep learning (DL) based image registration methods have been widely investigated and showed excellent performance in computational speed. This paper has proposed the transformer based image registration method.
  arXiv  Detail & Related papers  (2022-02-24T13:45:45Z)
• A Deep Discontinuity-Preserving Image Registration Network [73.03885837923599]
  Most deep learning-based registration methods assume that the desired deformation fields are globally smooth and continuous. We propose a weakly-supervised Deep Discontinuity-preserving Image Registration network (DDIR) to obtain better registration performance and realistic deformation fields. We demonstrate that our method achieves significant improvements in registration accuracy and predicts more realistic deformations, in registration experiments on cardiac magnetic resonance (MR) images.
  arXiv  Detail & Related papers  (2021-07-09T13:35:59Z)
• CAR-Net: Unsupervised Co-Attention Guided Registration Network for Joint Registration and Structure Learning [73.03885837923599]
  We propose a novel deep learning network, Co-Attention guided Registration Network (CAR-Net) CAR-Net employs a co-attention block to learn a new representation of the inputs, which drives the registration of the fixed and moving images. Experiments on UK Biobank cardiac cine-magnetic resonance image data demonstrate that CAR-Net obtains higher registration accuracy and smoother deformation fields than state-of-the-art unsupervised registration methods.
  arXiv  Detail & Related papers  (2021-06-11T23:25:49Z)
• Groupwise Multimodal Image Registration using Joint Total Variation [0.0]
  We introduce a cost function based on joint total variation for such multimodal image registration. We evaluate our algorithm on rigidly aligning both simulated and real 3D brain scans.
  arXiv  Detail & Related papers  (2020-05-06T16:11:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.