Morphology-based non-rigid registration of coronary computed tomography
and intravascular images through virtual catheter path optimization
- URL: http://arxiv.org/abs/2301.00060v1
- Date: Fri, 30 Dec 2022 21:48:32 GMT
- Title: Morphology-based non-rigid registration of coronary computed tomography
and intravascular images through virtual catheter path optimization
- Authors: Karim Kadry, Abhishek Karmakar, Andreas Schuh, Kersten Peterson,
Michiel Schaap, David Marlevi, Charles Taylor, Elazer Edelman, and Farhad
Nezami
- Abstract summary: We present a semi-automatic segmentation-based framework for both rigid and non-rigid matching of intravascular images to CCTA images.
Our results indicate that our non-rigid registration significantly outperforms other co-registration approaches for luminal bifurcation alignment.
- Score: 0.5525871666098097
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Coronary Computed Tomography Angiography (CCTA) provides information on the
presence, extent, and severity of obstructive coronary artery disease.
Large-scale clinical studies analyzing CCTA-derived metrics typically require
ground-truth validation in the form of high-fidelity 3D intravascular imaging.
However, manual rigid alignment of intravascular images to corresponding CCTA
images is both time consuming and user-dependent. Moreover, intravascular
modalities suffer from several non-rigid motion-induced distortions arising
from distortions in the imaging catheter path. To address these issues, we here
present a semi-automatic segmentation-based framework for both rigid and
non-rigid matching of intravascular images to CCTA images. We formulate the
problem in terms of finding the optimal \emph{virtual catheter path} that
samples the CCTA data to recapitulate the coronary artery morphology found in
the intravascular image. We validate our co-registration framework on a cohort
of $n=40$ patients using bifurcation landmarks as ground truth for longitudinal
and rotational registration. Our results indicate that our non-rigid
registration significantly outperforms other co-registration approaches for
luminal bifurcation alignment in both longitudinal (mean mismatch: 3.3 frames)
and rotational directions (mean mismatch: 28.6 degrees). By providing a
differentiable framework for automatic multi-modal intravascular data fusion,
our developed co-registration modules significantly reduces the manual effort
required to conduct large-scale multi-modal clinical studies while also
providing a solid foundation for the development of machine learning-based
co-registration approaches.
Related papers
- CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - Spatiotemporal Disentanglement of Arteriovenous Malformations in Digital
Subtraction Angiography [37.44819725897024]
The presented method aims to enhance Digital Subtraction Angiography (DSA) image series by highlighting critical information via automatic classification of vessels.
The method was tested on clinical DSA images series and demonstrated efficient differentiation between arteries and veins.
arXiv Detail & Related papers (2024-02-15T00:29:53Z) - Multi-scale, Data-driven and Anatomically Constrained Deep Learning
Image Registration for Adult and Fetal Echocardiography [4.923733944174007]
We propose a framework that combines three strategies for deep learning image registration in both fetal and adult echo.
Our tests show that good anatomical topology and image textures are strongly linked to shape-encoded and data-driven adversarial losses.
Our approach outperforms traditional non-DL gold standard registration approaches, including Optical Flow and Elastix.
arXiv Detail & Related papers (2023-09-02T05:33:31Z) - Joint segmentation and discontinuity-preserving deformable registration:
Application to cardiac cine-MR images [74.99415008543276]
Most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain.
We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields.
A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images.
We evaluate our method on the task of intra-subject-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences.
arXiv Detail & Related papers (2022-11-24T23:45:01Z) - Affinity Feature Strengthening for Accurate, Complete and Robust Vessel
Segmentation [48.638327652506284]
Vessel segmentation is crucial in many medical image applications, such as detecting coronary stenoses, retinal vessel diseases and brain aneurysms.
We present a novel approach, the affinity feature strengthening network (AFN), which jointly models geometry and refines pixel-wise segmentation features using a contrast-insensitive, multiscale affinity approach.
arXiv Detail & Related papers (2022-11-12T05:39:17Z) - Unsupervised Image Registration Towards Enhancing Performance and
Explainability in Cardiac And Brain Image Analysis [3.5718941645696485]
Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging.
We present an un-supervised deep learning registration methodology which can accurately model affine and non-rigid trans-formations.
Our methodology performs bi-directional cross-modality image synthesis to learn modality-invariant latent rep-resentations.
arXiv Detail & Related papers (2022-03-07T12:54:33Z) - Incremental Cross-view Mutual Distillation for Self-supervised Medical
CT Synthesis [88.39466012709205]
This paper builds a novel medical slice to increase the between-slice resolution.
Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy.
Our method outperforms state-of-the-art algorithms by clear margins.
arXiv Detail & Related papers (2021-12-20T03:38:37Z) - Symmetry-Enhanced Attention Network for Acute Ischemic Infarct
Segmentation with Non-Contrast CT Images [50.55978219682419]
We propose a symmetry enhanced attention network (SEAN) for acute ischemic infarct segmentation.
Our proposed network automatically transforms an input CT image into the standard space where the brain tissue is bilaterally symmetric.
The proposed SEAN outperforms some symmetry-based state-of-the-art methods in terms of both dice coefficient and infarct localization.
arXiv Detail & Related papers (2021-10-11T07:13:26Z) - A Deep Discontinuity-Preserving Image Registration Network [73.03885837923599]
Most deep learning-based registration methods assume that the desired deformation fields are globally smooth and continuous.
We propose a weakly-supervised Deep Discontinuity-preserving Image Registration network (DDIR) to obtain better registration performance and realistic deformation fields.
We demonstrate that our method achieves significant improvements in registration accuracy and predicts more realistic deformations, in registration experiments on cardiac magnetic resonance (MR) images.
arXiv Detail & Related papers (2021-07-09T13:35:59Z) - Segmentation of Anatomical Layers and Artifacts in Intravascular
Polarization Sensitive Optical Coherence Tomography Using Attending Physician
and Boundary Cardinality Lost Terms [4.93836246080317]
Intravascular ultrasound and optical coherence tomography are widely available for characterizing coronary stenoses.
We propose a convolutional neural network model and optimize its performance using a new multi-term loss function.
Our model segments two classes of major artifacts and detects the anatomical layers within the thickened vessel wall regions.
arXiv Detail & Related papers (2021-05-11T15:52:31Z) - Patch-based field-of-view matching in multi-modal images for
electroporation-based ablations [0.6285581681015912]
Multi-modal imaging sensors are currently involved at different steps of an interventional therapeutic work-flow.
Merging this information relies on a correct spatial alignment of the observed anatomy between the acquired images.
We show that a regional registration approach using voxel patches provides a good structural compromise between the voxel-wise and "global shifts" approaches.
arXiv Detail & Related papers (2020-11-09T11:27:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.