A Meta-Learning Approach for Medical Image Registration
- URL: http://arxiv.org/abs/2104.10447v1
- Date: Wed, 21 Apr 2021 10:27:05 GMT
- Title: A Meta-Learning Approach for Medical Image Registration
- Authors: Heejung Park, Gyeong Min Lee, Soopil Kim, Ga Hyung Ryu, Areum Jeong,
Sang Hyun Park, Min Sagong
- Abstract summary: We propose a novel unsupervised registration model which is integrated with a gradient-based meta learning framework.
In our experiments, the proposed model obtained significantly improved performance in terms of accuracy and training time.
- Score: 6.518615946009265
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Non-rigid registration is a necessary but challenging task in medical imaging
studies. Recently, unsupervised registration models have shown good
performance, but they often require a large-scale training dataset and long
training times. Therefore, in real world application where only dozens to
hundreds of image pairs are available, existing models cannot be practically
used. To address these limitations, we propose a novel unsupervised
registration model which is integrated with a gradient-based meta learning
framework. In particular, we train a meta learner which finds an initialization
point of parameters by utilizing a variety of existing registration datasets.
To quickly adapt to various tasks, the meta learner was updated to get close to
the center of parameters which are fine-tuned for each registration task.
Thereby, our model can adapt to unseen domain tasks via a short fine-tuning
process and perform accurate registration. To verify the superiority of our
model, we train the model for various 2D medical image registration tasks such
as retinal choroid Optical Coherence Tomography Angiography (OCTA), CT organs,
and brain MRI scans and test on registration of retinal OCTA Superficial
Capillary Plexus (SCP). In our experiments, the proposed model obtained
significantly improved performance in terms of accuracy and training time
compared to other registration models.
Related papers
- Towards a vision foundation model for comprehensive assessment of Cardiac MRI [11.838157772803282]
We introduce a vision foundation model trained for cardiac magnetic resonance imaging (CMR) assessment.
We finetune the model in supervised way for 9 clinical tasks typical to a CMR workflow.
We demonstrate improved accuracy and robustness across all tasks, over a range of available labeled dataset sizes.
arXiv Detail & Related papers (2024-10-02T15:32:01Z) - PMT: Progressive Mean Teacher via Exploring Temporal Consistency for Semi-Supervised Medical Image Segmentation [51.509573838103854]
We propose a semi-supervised learning framework, termed Progressive Mean Teachers (PMT), for medical image segmentation.
Our PMT generates high-fidelity pseudo labels by learning robust and diverse features in the training process.
Experimental results on two datasets with different modalities, i.e., CT and MRI, demonstrate that our method outperforms the state-of-the-art medical image segmentation approaches.
arXiv Detail & Related papers (2024-09-08T15:02:25Z) - MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining [73.81862342673894]
Foundation models have reshaped the landscape of Remote Sensing (RS) by enhancing various image interpretation tasks.
transferring the pretrained models to downstream tasks may encounter task discrepancy due to their formulation of pretraining as image classification or object discrimination tasks.
We conduct multi-task supervised pretraining on the SAMRS dataset, encompassing semantic segmentation, instance segmentation, and rotated object detection.
Our models are finetuned on various RS downstream tasks, such as scene classification, horizontal and rotated object detection, semantic segmentation, and change detection.
arXiv Detail & Related papers (2024-03-20T09:17:22Z) - GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration [62.41725951450803]
Learning-based deformable registration relies on weighted objective functions trading off registration accuracy and smoothness of the field.
We construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyper parameter-free balance on multiple losses.
Our method is model-agnostic and can be merged into any deep registration network without introducing extra parameters or slowing down inference.
arXiv Detail & Related papers (2023-06-26T13:32:09Z) - Automated Learning for Deformable Medical Image Registration by Jointly
Optimizing Network Architectures and Objective Functions [69.6849409155959]
This paper proposes an automated learning registration algorithm (AutoReg) that cooperatively optimize both architectures and their corresponding training objectives.
We conduct image registration experiments on multi-site volume datasets and various registration tasks.
Our results show that our AutoReg may automatically learn an optimal deep registration network for given volumes and achieve state-of-the-art performance.
arXiv Detail & Related papers (2022-03-14T01:54:38Z) - Deformable Image Registration using Neural ODEs [15.245085400790002]
We present a generic, fast, and accurate diffeomorphic image registration framework that leverages neural ordinary differential equations (NODEs)
Compared with traditional optimization-based methods, our framework reduces the running time from tens of minutes to tens of seconds.
Our experiments show that the registration results of our method outperform state-of-the-arts under various metrics.
arXiv Detail & Related papers (2021-08-07T12:54:17Z) - A Deep Discontinuity-Preserving Image Registration Network [73.03885837923599]
Most deep learning-based registration methods assume that the desired deformation fields are globally smooth and continuous.
We propose a weakly-supervised Deep Discontinuity-preserving Image Registration network (DDIR) to obtain better registration performance and realistic deformation fields.
We demonstrate that our method achieves significant improvements in registration accuracy and predicts more realistic deformations, in registration experiments on cardiac magnetic resonance (MR) images.
arXiv Detail & Related papers (2021-07-09T13:35:59Z) - Test-Time Training for Deformable Multi-Scale Image Registration [15.523457398508263]
Deep learning-based registration approaches such as VoxelMorph have been emerging and achieve competitive performance.
We construct a test-time training for deep deformable image registration to improve the generalization ability of conventional learning-based registration model.
arXiv Detail & Related papers (2021-03-25T03:22:59Z) - Learning Deformable Image Registration from Optimization: Perspective,
Modules, Bilevel Training and Beyond [62.730497582218284]
We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation.
We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
arXiv Detail & Related papers (2020-04-30T03:23:45Z) - Learning Deformable Registration of Medical Images with Anatomical
Constraints [4.397224870979238]
Deformable image registration is a fundamental problem in the field of medical image analysis.
We learn global non-linear representations of image anatomy using segmentation masks, and employ them to constraint the registration process.
Our experiments show that the proposed anatomically constrained registration model produces more realistic and accurate results than state-of-the-art methods.
arXiv Detail & Related papers (2020-01-20T17:44:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.