Deform-GAN:An Unsupervised Learning Model for Deformable Registration
- URL: http://arxiv.org/abs/2002.11430v1
- Date: Wed, 26 Feb 2020 12:20:46 GMT
- Title: Deform-GAN:An Unsupervised Learning Model for Deformable Registration
- Authors: Xiaoyue Zhang, Weijian Jian, Yu Chen, Shihting Yang
- Abstract summary: In this paper, a non-rigid registration method is proposed for 3D medical images leveraging unsupervised learning.
The proposed gradient loss is robust across sequences and modals for large deformation.
Neither ground-truth nor manual labeling is required during training.
- Score: 4.030402376540977
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deformable registration is one of the most challenging task in the field of
medical image analysis, especially for the alignment between different
sequences and modalities. In this paper, a non-rigid registration method is
proposed for 3D medical images leveraging unsupervised learning. To the best of
our knowledge, this is the first attempt to introduce gradient loss into
deep-learning-based registration. The proposed gradient loss is robust across
sequences and modals for large deformation. Besides, adversarial learning
approach is used to transfer multi-modal similarity to mono-modal similarity
and improve the precision. Neither ground-truth nor manual labeling is required
during training. We evaluated our network on a 3D brain registration task
comprehensively. The experiments demonstrate that the proposed method can cope
with the data which has non-functional intensity relations, noise and blur. Our
approach outperforms other methods especially in accuracy and speed.
Related papers
- Adapting the Mean Teacher for keypoint-based lung registration under
geometric domain shifts [75.51482952586773]
deep neural networks generally require plenty of labeled training data and are vulnerable to domain shifts between training and test data.
We present a novel approach to geometric domain adaptation for image registration, adapting a model from a labeled source to an unlabeled target domain.
Our method consistently improves on the baseline model by 50%/47% while even matching the accuracy of models trained on target data.
arXiv Detail & Related papers (2022-07-01T12:16:42Z) - Multi-modal unsupervised brain image registration using edge maps [7.49320945341034]
We propose a simple yet effective unsupervised deep learning-based em multi-modal image registration approach.
The intuition behind this is that image locations with a strong gradient are assumed to denote a transition of tissues.
We evaluate our approach in the context of registering multi-modal (T1w to T2w) magnetic resonance (MR) brain images of different subjects using three different loss functions.
arXiv Detail & Related papers (2022-02-09T15:50:14Z) - Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound
Reconstruction [61.62191904755521]
3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan.
Existing deep learning based methods only focus on the basic cases of skill sequences.
We propose a novel approach to sensorless freehand 3D US reconstruction considering the complex skill sequences.
arXiv Detail & Related papers (2021-07-31T16:06:50Z) - Multi-scale Neural ODEs for 3D Medical Image Registration [7.715565365558909]
Image registration plays an important role in medical image analysis.
Deep learning methods such as learn-to-map are much faster but either iterative or coarse-to-fine approach is required to improve accuracy for handling large motions.
In this work, we proposed to learn a registration via a multi-scale neural ODE model.
arXiv Detail & Related papers (2021-06-16T00:26:53Z) - Learning a Model-Driven Variational Network for Deformable Image
Registration [89.9830129923847]
VR-Net is a novel cascaded variational network for unsupervised deformable image registration.
It outperforms state-of-the-art deep learning methods on registration accuracy.
It maintains the fast inference speed of deep learning and the data-efficiency of variational model.
arXiv Detail & Related papers (2021-05-25T21:37:37Z) - Unsupervised Noisy Tracklet Person Re-identification [100.85530419892333]
We present a novel selective tracklet learning (STL) approach that can train discriminative person re-id models from unlabelled tracklet data.
This avoids the tedious and costly process of exhaustively labelling person image/tracklet true matching pairs across camera views.
Our method is particularly more robust against arbitrary noisy data of raw tracklets therefore scalable to learning discriminative models from unconstrained tracking data.
arXiv Detail & Related papers (2021-01-16T07:31:00Z) - Recurrent Multi-view Alignment Network for Unsupervised Surface
Registration [79.72086524370819]
Learning non-rigid registration in an end-to-end manner is challenging due to the inherent high degrees of freedom and the lack of labeled training data.
We propose to represent the non-rigid transformation with a point-wise combination of several rigid transformations.
We also introduce a differentiable loss function that measures the 3D shape similarity on the projected multi-view 2D depth images.
arXiv Detail & Related papers (2020-11-24T14:22:42Z) - Planar 3D Transfer Learning for End to End Unimodal MRI Unbalanced Data
Segmentation [0.0]
We present a novel approach of 2D to 3D transfer learning based on mapping pre-trained 2D convolutional neural network weights into planar 3D kernels.
The method is validated by the proposed planar 3D res-u-net network with encoder transferred from the 2D VGG-16.
arXiv Detail & Related papers (2020-11-23T17:11:50Z) - F3RNet: Full-Resolution Residual Registration Network for Deformable
Image Registration [21.99118499516863]
Deformable image registration (DIR) is essential for many image-guided therapies.
We propose a novel unsupervised registration network, namely the Full-Resolution Residual Registration Network (F3RNet)
One stream takes advantage of the full-resolution information that facilitates accurate voxel-level registration.
The other stream learns the deep multi-scale residual representations to obtain robust recognition.
arXiv Detail & Related papers (2020-09-15T15:05:54Z) - Learning Deformable Image Registration from Optimization: Perspective,
Modules, Bilevel Training and Beyond [62.730497582218284]
We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation.
We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
arXiv Detail & Related papers (2020-04-30T03:23:45Z) - A Multiple Decoder CNN for Inverse Consistent 3D Image Registration [18.017296651822857]
Deep learning technologies have drastically decreased the registration time and increased registration accuracy.
We propose a registration framework with inverse consistency.
We perform training and testing of the method on the publicly available LPBA40 MRI dataset and demonstrate strong performance.
arXiv Detail & Related papers (2020-02-15T23:23:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.