UDCR: Unsupervised Aortic DSA/CTA Rigid Registration Using Deep Reinforcement Learning and Overlap Degree Calculation

• URL: http://arxiv.org/abs/2403.05753v1
• Date: Sat, 9 Mar 2024 01:18:32 GMT
• Title: UDCR: Unsupervised Aortic DSA/CTA Rigid Registration Using Deep Reinforcement Learning and Overlap Degree Calculation
• Authors: Wentao Liu, Bowen Liang, Weijin Xu, Tong Tian, Qingsheng Lu, Xipeng Pan, Haoyuan Li, Siyu Tian, Huihua Yang, Ruisheng Su
• Abstract summary: We propose an unsupervised method, UDCR, for aortic DSA/CTA rigid registration based on deep reinforcement learning. We manually annotated 61 pairs of aortic DSA/CTA for algorithm evaluation. The results indicate that the proposed UDCR achieved a Mean Absolute Error (MAE) of 2.85 mm in translation and 4.35deg in rotation.
• Score: 12.201553863670155
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The rigid registration of aortic Digital Subtraction Angiography (DSA) and Computed Tomography Angiography (CTA) can provide 3D anatomical details of the vasculature for the interventional surgical treatment of conditions such as aortic dissection and aortic aneurysms, holding significant value for clinical research. However, the current methods for 2D/3D image registration are dependent on manual annotations or synthetic data, as well as the extraction of landmarks, which is not suitable for cross-modal registration of aortic DSA/CTA. In this paper, we propose an unsupervised method, UDCR, for aortic DSA/CTA rigid registration based on deep reinforcement learning. Leveraging the imaging principles and characteristics of DSA and CTA, we have constructed a cross-dimensional registration environment based on spatial transformations. Specifically, we propose an overlap degree calculation reward function that measures the intensity difference between the foreground and background, aimed at assessing the accuracy of registration between segmentation maps and DSA images. This method is highly flexible, allowing for the loading of pre-trained models to perform registration directly or to seek the optimal spatial transformation parameters through online learning. We manually annotated 61 pairs of aortic DSA/CTA for algorithm evaluation. The results indicate that the proposed UDCR achieved a Mean Absolute Error (MAE) of 2.85 mm in translation and 4.35{\deg} in rotation, showing significant potential for clinical applications.

Related papers

• Cross Feature Fusion of Fundus Image and Generated Lesion Map for Referable Diabetic Retinopathy Classification [1.091626241764448]
  Diabetic Retinopathy (DR) is a primary cause of blindness, necessitating early detection and diagnosis. We develop an advanced cross-learning DR classification method leveraging transfer learning and cross-attention mechanisms. Our experiments, utilizing two public datasets, demonstrate a superior accuracy of 94.6%, surpassing current state-of-the-art methods by 4.4%.
  arXiv  Detail & Related papers  (2024-11-06T02:23:38Z)
• Enhancing Angular Resolution via Directionality Encoding and Geometric Constraints in Brain Diffusion Tensor Imaging [70.66500060987312]
  Diffusion-weighted imaging (DWI) is a type of Magnetic Resonance Imaging (MRI) technique sensitised to the diffusivity of water molecules. This work proposes DirGeo-DTI, a deep learning-based method to estimate reliable DTI metrics even from a set of DWIs acquired with the minimum theoretical number (6) of gradient directions.
  arXiv  Detail & Related papers  (2024-09-11T11:12:26Z)
• Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration [50.602074919305636]
  This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg. We use epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features.
  arXiv  Detail & Related papers  (2024-06-20T17:47:30Z)
• RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge [1.7625447004432986]
  A robust, efficient, and accurate registration method is highly desired by the scientific community and hospitals specializing in digital pathology. We propose a two-step hybrid method consisting of (i) deep learning- and feature-based initial alignment algorithm, and (ii) intensity-based nonrigid registration. The proposed method does not require any fine-tuning to a particular dataset and can be used directly for any desired tissue type and stain.
  arXiv  Detail & Related papers  (2024-04-19T16:19:30Z)
• SSASS: Semi-Supervised Approach for Stenosis Segmentation [9.767759441883008]
  The complexity of coronary artery structures combined with the inherent noise in X-ray images poses a considerable challenge to this task. We introduce a semi-supervised approach for cardiovascular stenosis segmentation. Our approach demonstrated an exceptional performance in the Automatic Region-based Coronary Artery Disease diagnostics.
  arXiv  Detail & Related papers  (2023-11-17T02:01:19Z)
• Multi-scale, Data-driven and Anatomically Constrained Deep Learning Image Registration for Adult and Fetal Echocardiography [4.923733944174007]
  We propose a framework that combines three strategies for deep learning image registration in both fetal and adult echo. Our tests show that good anatomical topology and image textures are strongly linked to shape-encoded and data-driven adversarial losses. Our approach outperforms traditional non-DL gold standard registration approaches, including Optical Flow and Elastix.
  arXiv  Detail & Related papers  (2023-09-02T05:33:31Z)
• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration [62.41725951450803]
  Learning-based deformable registration relies on weighted objective functions trading off registration accuracy and smoothness of the field. We construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyper parameter-free balance on multiple losses. Our method is model-agnostic and can be merged into any deep registration network without introducing extra parameters or slowing down inference.
  arXiv  Detail & Related papers  (2023-06-26T13:32:09Z)
• Structure-aware registration network for liver DCE-CT images [50.28546654316009]
  We propose a novel structure-aware registration method by incorporating structural information of related organs with segmentation-guided deep registration network. Our proposed method can achieve higher registration accuracy and preserve anatomical structure more effectively than state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-03-08T14:08:56Z)
• Outlier-based Autism Detection using Longitudinal Structural MRI [6.311381904410801]
  This paper proposes structural Magnetic Resonance Imaging (sMRI)-based Autism Spectrum Disorder diagnosis via an outlier detection approach. Generative Adversarial Network (GAN) is trained exclusively with sMRI scans of healthy subjects. Experiments reveal that our ASD detection framework performs comparably with the state-of-the-art with far fewer training data.
  arXiv  Detail & Related papers  (2022-02-21T04:37:25Z)
• Tattoo tomography: Freehand 3D photoacoustic image reconstruction with an optical pattern [49.240017254888336]
  Photoacoustic tomography (PAT) is a novel imaging technique that can resolve both morphological and functional tissue properties. A current drawback is the limited field-of-view provided by the conventionally applied 2D probes. We present a novel approach to 3D reconstruction of PAT data that does not require an external tracking system.
  arXiv  Detail & Related papers  (2020-11-10T09:27:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.