A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond
- URL: http://arxiv.org/abs/2307.15615v4
- Date: Fri, 01 Nov 2024 15:13:01 GMT
- Title: A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond
- Authors: Junyu Chen, Yihao Liu, Shuwen Wei, Zhangxing Bian, Shalini Subramanian, Aaron Carass, Jerry L. Prince, Yong Du,
- Abstract summary: Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade.
In this paper, we present a comprehensive overview of the most recent advancements in deep learning-based image registration.
We highlight the practical applications of these novel techniques in medical imaging and discuss the future prospects of deep learning-based image registration.
- Score: 11.011806131158
- License:
- Abstract: Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade. The initial developments, such as regression-based and U-Net-based networks, established the foundation for deep learning in image registration. Subsequent progress has been made in various aspects of deep learning-based registration, including similarity measures, deformation regularizations, network architectures, and uncertainty estimation. These advancements have not only enriched the field of image registration but have also facilitated its application in a wide range of tasks, including atlas construction, multi-atlas segmentation, motion estimation, and 2D-3D registration. In this paper, we present a comprehensive overview of the most recent advancements in deep learning-based image registration. We begin with a concise introduction to the core concepts of deep learning-based image registration. Then, we delve into innovative network architectures, loss functions specific to registration, and methods for estimating registration uncertainty. Additionally, this paper explores appropriate evaluation metrics for assessing the performance of deep learning models in registration tasks. Finally, we highlight the practical applications of these novel techniques in medical imaging and discuss the future prospects of deep learning-based image registration.
Related papers
- Joint segmentation and discontinuity-preserving deformable registration:
Application to cardiac cine-MR images [74.99415008543276]
Most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain.
We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields.
A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images.
We evaluate our method on the task of intra-subject-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences.
arXiv Detail & Related papers (2022-11-24T23:45:01Z) - Medical image registration using unsupervised deep neural network: A
scoping literature review [0.9527960631238173]
In medicine, image registration is vital in image-guided interventions and other clinical applications.
The implementation of deep neural networks provides an opportunity for some medical applications such as conducting image registration in less time with high accuracy.
arXiv Detail & Related papers (2022-08-03T03:11:34Z) - Deep Learning for Medical Image Registration: A Comprehensive Review [1.3190581566723918]
There has been a tremendous surge in the development of deep learning (DL)-based medical image registration models.
This review focuses on monomodal and multimodal registration and associated imaging, for instance, X-ray, CT scan, ultrasound, and MRI.
arXiv Detail & Related papers (2022-04-24T19:34:00Z) - Automated Learning for Deformable Medical Image Registration by Jointly
Optimizing Network Architectures and Objective Functions [69.6849409155959]
This paper proposes an automated learning registration algorithm (AutoReg) that cooperatively optimize both architectures and their corresponding training objectives.
We conduct image registration experiments on multi-site volume datasets and various registration tasks.
Our results show that our AutoReg may automatically learn an optimal deep registration network for given volumes and achieve state-of-the-art performance.
arXiv Detail & Related papers (2022-03-14T01:54:38Z) - Deep Image Deblurring: A Survey [165.32391279761006]
Deblurring is a classic problem in low-level computer vision, which aims to recover a sharp image from a blurred input image.
Recent advances in deep learning have led to significant progress in solving this problem.
arXiv Detail & Related papers (2022-01-26T01:31:30Z) - Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
Deep image prior was introduced as an effective prior for image reconstruction.
Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques.
We develop a two-stage learning paradigm to address the computational challenge.
arXiv Detail & Related papers (2021-11-23T15:08:26Z) - Deformable Image Registration with Deep Network Priors: a Study on
Longitudinal PET Images [0.5949967357689445]
Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers to tackle the image registration question.
We propose a subject-specific deformable registration method called MIRRBA, relying on a deep pyramidal architecture to be the prior model constraining the deformation field.
We demonstrate the regularizing power of deep architectures and present new elements to understand the role of the architecture in deep learning methods for registration.
arXiv Detail & Related papers (2021-11-22T10:58:14Z) - A Deep Discontinuity-Preserving Image Registration Network [73.03885837923599]
Most deep learning-based registration methods assume that the desired deformation fields are globally smooth and continuous.
We propose a weakly-supervised Deep Discontinuity-preserving Image Registration network (DDIR) to obtain better registration performance and realistic deformation fields.
We demonstrate that our method achieves significant improvements in registration accuracy and predicts more realistic deformations, in registration experiments on cardiac magnetic resonance (MR) images.
arXiv Detail & Related papers (2021-07-09T13:35:59Z) - An Auto-Context Deformable Registration Network for Infant Brain MRI [54.57017031561516]
We propose an infant-dedicated deep registration network that uses the auto-context strategy to gradually refine the deformation fields.
Our method estimates the deformation fields by invoking a single network multiple times for iterative deformation refinement.
Experimental results in comparison with state-of-the-art registration methods indicate that our method achieves higher accuracy while at the same time preserves the smoothness of the deformation fields.
arXiv Detail & Related papers (2020-05-19T06:00:13Z) - A Multiple Decoder CNN for Inverse Consistent 3D Image Registration [18.017296651822857]
Deep learning technologies have drastically decreased the registration time and increased registration accuracy.
We propose a registration framework with inverse consistency.
We perform training and testing of the method on the publicly available LPBA40 MRI dataset and demonstrate strong performance.
arXiv Detail & Related papers (2020-02-15T23:23:09Z) - Medical Image Registration Using Deep Neural Networks: A Comprehensive
Review [1.2425910171551517]
State-of-the-art literature on medical image registration using deep neural networks is presented.
The review is systematic and encompasses all the related works previously published in the field.
This review allows a deep understanding and insight for the readers active in the field who are investigating the state-of-the-art and seeking to contribute the future literature.
arXiv Detail & Related papers (2020-02-09T17:22:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.