Stochastic Planner-Actor-Critic for Unsupervised Deformable Image Registration

• URL: http://arxiv.org/abs/2112.07415v1
• Date: Tue, 14 Dec 2021 14:08:56 GMT
• Title: Stochastic Planner-Actor-Critic for Unsupervised Deformable Image Registration
• Authors: Ziwei Luo, Jing Hu, Xin Wang, Shu Hu, Bin Kong, Youbing Yin, Qi Song, Xi Wu, Siwei Lyu
• Abstract summary: We present a novel reinforcement learning-based framework that performs step-wise registration of medical images with large deformations. We evaluate our method on several 2D and 3D medical image datasets, some of which contain large deformations.
• Score: 33.72954116727303
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large deformations of organs, caused by diverse shapes and nonlinear shape changes, pose a significant challenge for medical image registration. Traditional registration methods need to iteratively optimize an objective function via a specific deformation model along with meticulous parameter tuning, but which have limited capabilities in registering images with large deformations. While deep learning-based methods can learn the complex mapping from input images to their respective deformation field, it is regression-based and is prone to be stuck at local minima, particularly when large deformations are involved. To this end, we present Stochastic Planner-Actor-Critic (SPAC), a novel reinforcement learning-based framework that performs step-wise registration. The key notion is warping a moving image successively by each time step to finally align to a fixed image. Considering that it is challenging to handle high dimensional continuous action and state spaces in the conventional reinforcement learning (RL) framework, we introduce a new concept `Plan' to the standard Actor-Critic model, which is of low dimension and can facilitate the actor to generate a tractable high dimensional action. The entire framework is based on unsupervised training and operates in an end-to-end manner. We evaluate our method on several 2D and 3D medical image datasets, some of which contain large deformations. Our empirical results highlight that our work achieves consistent, significant gains and outperforms state-of-the-art methods.

Related papers

• RL-I2IT: Image-to-Image Translation with Deep Reinforcement Learning [54.40719981158774]
  Image-to-Image Translation (I2IT) methods generate images in a single run of a deep learning (DL) model. We reformulate I2IT as a step-wise decision-making problem via deep reinforcement learning (DRL) We propose a novel framework that performs RL-based I2IT (RL-I2IT)
  arXiv  Detail & Related papers  (2023-09-24T15:40:40Z)
• SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes [75.9110646062442]
  We propose SceNeRFlow to reconstruct a general, non-rigid scene in a time-consistent manner. Our method takes multi-view RGB videos and background images from static cameras with known camera parameters as input. We show experimentally that, unlike prior work that only handles small motion, our method enables the reconstruction of studio-scale motions.
  arXiv  Detail & Related papers  (2023-08-16T09:50:35Z)
• RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning [62.86400614141706]
  We propose a new learning model, i.e., Rectangling Rectification Network (RecRecNet) Our model can flexibly warp the source structure to the target domain and achieves an end-to-end unsupervised deformation. Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations.
  arXiv  Detail & Related papers  (2023-01-04T15:12:57Z)
• DiffuseMorph: Unsupervised Deformable Image Registration Along Continuous Trajectory Using Diffusion Models [31.826844124173984]
  We present a novel approach of diffusion model-based probabilistic image registration, called DiffuseMorph. Our model learns the score function of the deformation between moving and fixed images. Our method can provide flexible and accurate deformation with a capability of topology preservation.
  arXiv  Detail & Related papers  (2021-12-09T08:41:23Z)
• Image Deformation Estimation via Multi-Objective Optimization [13.159751065619544]
  Free-form deformation model can represent a wide range of non-rigid deformations by manipulating a control point lattice over the image. It is challenging to fit the model directly to the deformed image for deformation estimation because of the complexity of the fitness landscape.
  arXiv  Detail & Related papers  (2021-06-08T06:52:12Z)
• Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration [67.69257782645789]
  We propose piecewise transformation fields that learn 3D translation vectors to map any query point in posed space to its correspond position in rest-pose space. We show that fitting parametric models with poses by our network results in much better registration quality, especially for extreme poses.
  arXiv  Detail & Related papers  (2021-04-16T15:16:09Z)
• Test-Time Training for Deformable Multi-Scale Image Registration [15.523457398508263]
  Deep learning-based registration approaches such as VoxelMorph have been emerging and achieve competitive performance. We construct a test-time training for deep deformable image registration to improve the generalization ability of conventional learning-based registration model.
  arXiv  Detail & Related papers  (2021-03-25T03:22:59Z)
• An Auto-Context Deformable Registration Network for Infant Brain MRI [54.57017031561516]
  We propose an infant-dedicated deep registration network that uses the auto-context strategy to gradually refine the deformation fields. Our method estimates the deformation fields by invoking a single network multiple times for iterative deformation refinement. Experimental results in comparison with state-of-the-art registration methods indicate that our method achieves higher accuracy while at the same time preserves the smoothness of the deformation fields.
  arXiv  Detail & Related papers  (2020-05-19T06:00:13Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.