3D Coronary Vessel Reconstruction from Bi-Plane Angiography using Graph
Convolutional Networks
- URL: http://arxiv.org/abs/2302.14795v1
- Date: Tue, 28 Feb 2023 17:46:25 GMT
- Title: 3D Coronary Vessel Reconstruction from Bi-Plane Angiography using Graph
Convolutional Networks
- Authors: Kit Mills Bransby, Vincenzo Tufaro, Murat Cap, Greg Slabaugh, Christos
Bourantas, Qianni Zhang
- Abstract summary: 3DAngioNet is a novel deep learning (DL) system that enables rapid 3D vessel mesh reconstruction using 2D XCA images from two views.
Our approach learns a coarse mesh template using an EfficientB3-UNet segmentation network and projection geometries, and deforms it using a graph convolutional network.
- Score: 1.8244763402770727
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: X-ray coronary angiography (XCA) is used to assess coronary artery disease
and provides valuable information on lesion morphology and severity. However,
XCA images are 2D and therefore limit visualisation of the vessel. 3D
reconstruction of coronary vessels is possible using multiple views, however
lumen border detection in current software is performed manually resulting in
limited reproducibility and slow processing time. In this study we propose
3DAngioNet, a novel deep learning (DL) system that enables rapid 3D vessel mesh
reconstruction using 2D XCA images from two views. Our approach learns a coarse
mesh template using an EfficientB3-UNet segmentation network and projection
geometries, and deforms it using a graph convolutional network. 3DAngioNet
outperforms similar automated reconstruction methods, offers improved
efficiency, and enables modelling of bifurcated vessels. The approach was
validated using state-of-the-art software verified by skilled cardiologists.
Related papers
- NeCA: 3D Coronary Artery Tree Reconstruction from Two 2D Projections by Neural Implicit Representation [2.1771042711033997]
2D x-ray invasive coronary angiography remains as the most widely adopted imaging modality for CVDs diagnosis.
Due to the radiation limit, in general only two angiographic projections are acquired, providing limited information of the vessel geometry.
We propose a self-supervised deep learning method called NeCA, which is based on implicit neural representation using the multiresolution hash encoder and differentiable cone-beam forward projector layer.
arXiv Detail & Related papers (2024-09-06T20:08:21Z) - Deep Learning-based 3D Coronary Tree Reconstruction from Two 2D Non-simultaneous X-ray Angiography Projections [1.9929038355503754]
Cardiovascular diseases (CVDs) are the most common cause of death worldwide.
Invasive x-ray coronary angiography (ICA) is one of the most important imaging modalities for the diagnosis of CVDs.
ICA typically acquires only two 2D projections, which makes the 3D geometry of coronary vessels difficult to interpret.
We propose a novel deep learning pipeline to correct the non-rigid cardiac and respiratory motions between non-simultaneous projections.
arXiv Detail & Related papers (2024-07-19T18:18:17Z) - 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning [79.60829508459753]
Current commercial Digital Subtraction Angiography (DSA) systems typically demand hundreds of scanning views to perform reconstruction.
The dynamic blood flow and insufficient input of sparse-view DSA images present significant challenges to the 3D vessel reconstruction task.
We propose to use a time-agnostic vessel probability field to solve this problem effectively.
arXiv Detail & Related papers (2024-05-17T11:23:33Z) - Intraoperative 2D/3D Image Registration via Differentiable X-ray Rendering [5.617649111108429]
We present DiffPose, a self-supervised approach that leverages patient-specific simulation and differentiable physics-based rendering to achieve accurate 2D/3D registration without relying on manually labeled data.
DiffPose achieves sub-millimeter accuracy across surgical datasets at intraoperative speeds, improving upon existing unsupervised methods by an order of magnitude and even outperforming supervised baselines.
arXiv Detail & Related papers (2023-12-11T13:05:54Z) - Multi-View Vertebra Localization and Identification from CT Images [57.56509107412658]
We propose a multi-view vertebra localization and identification from CT images.
We convert the 3D problem into a 2D localization and identification task on different views.
Our method can learn the multi-view global information naturally.
arXiv Detail & Related papers (2023-07-24T14:43:07Z) - Deep learning network to correct axial and coronal eye motion in 3D OCT
retinal imaging [65.47834983591957]
We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan.
The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
arXiv Detail & Related papers (2023-05-27T03:55:19Z) - Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction [53.93674177236367]
Cone Beam Computed Tomography (CBCT) plays a vital role in clinical imaging.
Traditional methods typically require hundreds of 2D X-ray projections to reconstruct a high-quality 3D CBCT image.
This has led to a growing interest in sparse-view CBCT reconstruction to reduce radiation doses.
We introduce a novel geometry-aware encoder-decoder framework to solve this problem.
arXiv Detail & Related papers (2023-03-26T14:38:42Z) - Transfer Learning from an Artificial Radiograph-landmark Dataset for
Registration of the Anatomic Skull Model to Dual Fluoroscopic X-ray Images [0.4205692673448206]
We propose a transfer learning strategy for 3D-to-2D registration using deep neural networks trained from an artificial dataset.
Digitally reconstructed radiographs (DRRs) and radiographic skull landmarks were automatically created from craniocervical CT data of a female subject.
They were used to train a residual network (ResNet) for landmark detection and a cycle generative adversarial network (GAN) to eliminate the style difference between DRRs and actual X-rays.
The methodology to strategically augment artificial training data can tackle the complicated skull registration scenario, and has potentials to extend to widespread registration scenarios.
arXiv Detail & Related papers (2021-08-14T04:49:36Z) - Learning Hybrid Representations for Automatic 3D Vessel Centerline
Extraction [57.74609918453932]
Automatic blood vessel extraction from 3D medical images is crucial for vascular disease diagnoses.
Existing methods may suffer from discontinuities of extracted vessels when segmenting such thin tubular structures from 3D images.
We argue that preserving the continuity of extracted vessels requires to take into account the global geometry.
We propose a hybrid representation learning approach to address this challenge.
arXiv Detail & Related papers (2020-12-14T05:22:49Z) - Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid
Constrained Semi-Supervised Learning and Dual-UNet [74.22397862400177]
We propose a novel catheter segmentation approach, which requests fewer annotations than the supervised learning method.
Our scheme considers a deep Q learning as the pre-localization step, which avoids voxel-level annotation.
With the detected catheter, patch-based Dual-UNet is applied to segment the catheter in 3D volumetric data.
arXiv Detail & Related papers (2020-06-25T21:10:04Z) - Weakly-supervised 3D coronary artery reconstruction from two-view
angiographic images [4.722039838364292]
We propose an adversarial and generative way to reconstruct three dimensional coronary artery models.
With 3D fully supervised learning and 2D weakly supervised learning schemes, we obtained reconstruction accuracies that outperform state-of-art techniques.
arXiv Detail & Related papers (2020-03-26T11:41:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.