Neural Graphics Primitives-based Deformable Image Registration for On-the-fly Motion Extraction

• URL: http://arxiv.org/abs/2402.05568v1
• Date: Thu, 8 Feb 2024 11:09:27 GMT
• Title: Neural Graphics Primitives-based Deformable Image Registration for On-the-fly Motion Extraction
• Authors: Xia Li, Fabian Zhang, Muheng Li, Damien Weber, Antony Lomax, Joachim Buhmann, Ye Zhang
• Abstract summary: Intra-fraction motion in radiotherapy is commonly modeled using deformable image registration (DIR) Existing methods often struggle to balance speed and accuracy, limiting their applicability in clinical scenarios. This study introduces a novel approach that harnesses Neural Graphics Primitives (NGP) to optimize the displacement vector field (DVF) We validate this approach on the 4D-CT lung dataset DIR-lab, achieving a target registration error (TRE) of 1.15pm1.15 mm within a remarkable time of 1.77 seconds.
• Score: 9.599774878892665
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Intra-fraction motion in radiotherapy is commonly modeled using deformable image registration (DIR). However, existing methods often struggle to balance speed and accuracy, limiting their applicability in clinical scenarios. This study introduces a novel approach that harnesses Neural Graphics Primitives (NGP) to optimize the displacement vector field (DVF). Our method leverages learned primitives, processed as splats, and interpolates within space using a shallow neural network. Uniquely, it enables self-supervised optimization at an ultra-fast speed, negating the need for pre-training on extensive datasets and allowing seamless adaptation to new cases. We validated this approach on the 4D-CT lung dataset DIR-lab, achieving a target registration error (TRE) of 1.15\pm1.15 mm within a remarkable time of 1.77 seconds. Notably, our method also addresses the sliding boundary problem, a common challenge in conventional DIR methods.

Related papers

• Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
  We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively. We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
  arXiv  Detail & Related papers  (2024-09-18T13:40:59Z)
• LeRF: Learning Resampling Function for Adaptive and Efficient Image Interpolation [64.34935748707673]
  Recent deep neural networks (DNNs) have made impressive progress in performance by introducing learned data priors. We propose a novel method of Learning Resampling (termed LeRF) which takes advantage of both the structural priors learned by DNNs and the locally continuous assumption. LeRF assigns spatially varying resampling functions to input image pixels and learns to predict the shapes of these resampling functions with a neural network.
  arXiv  Detail & Related papers  (2024-07-13T16:09:45Z)
• Enhancing Dynamic CT Image Reconstruction with Neural Fields Through Explicit Motion Regularizers [0.0]
  We show the benefits of introducing explicit PDE-based motion regularizers in 2D+time computed tomography for the optimization of neural fields. We also compare neural fields against a grid-based solver and show that the former outperforms the latter.
  arXiv  Detail & Related papers  (2024-06-03T13:07:29Z)
• Self-STORM: Deep Unrolled Self-Supervised Learning for Super-Resolution Microscopy [55.2480439325792]
  We introduce deep unrolled self-supervised learning, which alleviates the need for such data by training a sequence-specific, model-based autoencoder. Our proposed method exceeds the performance of its supervised counterparts.
  arXiv  Detail & Related papers  (2024-03-25T17:40:32Z)
• Efficient Deformable Tissue Reconstruction via Orthogonal Neural Plane [58.871015937204255]
  We introduce Fast Orthogonal Plane (plane) for the reconstruction of deformable tissues. We conceptualize surgical procedures as 4D volumes, and break them down into static and dynamic fields comprised of neural planes. This factorization iscretizes four-dimensional space, leading to a decreased memory usage and faster optimization.
  arXiv  Detail & Related papers  (2023-12-23T13:27:50Z)
• Adapting the Mean Teacher for keypoint-based lung registration under geometric domain shifts [75.51482952586773]
  deep neural networks generally require plenty of labeled training data and are vulnerable to domain shifts between training and test data. We present a novel approach to geometric domain adaptation for image registration, adapting a model from a labeled source to an unlabeled target domain. Our method consistently improves on the baseline model by 50%/47% while even matching the accuracy of models trained on target data.
  arXiv  Detail & Related papers  (2022-07-01T12:16:42Z)
• Implicit Optimizer for Diffeomorphic Image Registration [3.1970342304563037]
  We propose a rapid and accurate Implicit for Diffeomorphic Image Registration (IDIR) which utilizes the Deep Implicit Function as the neural velocity field. We evaluate our proposed method on two 3D large-scale MR brain scan datasets, the results show that our proposed method provides faster and better registration results than conventional image registration approaches.
  arXiv  Detail & Related papers  (2022-02-25T05:04:29Z)
• Deep Learning Adapted Acceleration for Limited-view Photoacoustic Computed Tomography [1.8830359888767887]
  Photoacoustic computed tomography (PACT) uses unfocused large-area light to illuminate the target with ultrasound transducer array for PA signal detection. Limited-view issue could cause a low-quality image in PACT due to the limitation of geometric condition. A model-based method that combines the mathematical variational model with deep learning is proposed to speed up and regularize the unrolled procedure of reconstruction.
  arXiv  Detail & Related papers  (2021-11-08T02:05:58Z)
• Learning a Model-Driven Variational Network for Deformable Image Registration [89.9830129923847]
  VR-Net is a novel cascaded variational network for unsupervised deformable image registration. It outperforms state-of-the-art deep learning methods on registration accuracy. It maintains the fast inference speed of deep learning and the data-efficiency of variational model.
  arXiv  Detail & Related papers  (2021-05-25T21:37:37Z)
• A Lightweight Structure Aimed to Utilize Spatial Correlation for Sparse-View CT Reconstruction [6.8438089867929905]
  Severe imaging noise and streaking artifacts turn out to be a major issue in the low dose protocol. We propose a dual-domain deep learning-based method that breaks through the limitations of currently prevailing algorithms. Our method achieves the state-of-the-art performance by reaching the PSNR of 40.305 and the SSIM of 0.948, while ensuring high model mobility.
  arXiv  Detail & Related papers  (2021-01-19T13:26:17Z)
• Registration by tracking for sequential 2D MRI [0.0]
  We present an image registration method that exploits the sequential nature of 2D MR images to estimate the displacement field. The method is evaluated on a segmented cardiac dataset and when compared to two conventional methods we observe an improved performance.
  arXiv  Detail & Related papers  (2020-03-24T13:12:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.