Self-supervised motion descriptor for cardiac phase detection in 4D CMR
based on discrete vector field estimations
- URL: http://arxiv.org/abs/2209.05778v1
- Date: Tue, 13 Sep 2022 07:23:17 GMT
- Title: Self-supervised motion descriptor for cardiac phase detection in 4D CMR
based on discrete vector field estimations
- Authors: Sven Koehler and Tarique Hussain and Hamza Hussain and Daniel Young
and Samir Sarikouch and Thomas Pickhardt and Gerald Greil and Sandy
Engelhardt
- Abstract summary: We show how to efficiently use a deformable vector field to describe the underlying dynamic process of a cardiac cycle in form of a derived 1D motion descriptor.
We evaluate the plausibility of the motion descriptor on two challenging multi-disease, -center, -scanner short-axis CMR datasets.
- Score: 1.5755566067326996
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Cardiac magnetic resonance (CMR) sequences visualise the cardiac function
voxel-wise over time. Simultaneously, deep learning-based deformable image
registration is able to estimate discrete vector fields which warp one time
step of a CMR sequence to the following in a self-supervised manner. However,
despite the rich source of information included in these 3D+t vector fields, a
standardised interpretation is challenging and the clinical applications remain
limited so far. In this work, we show how to efficiently use a deformable
vector field to describe the underlying dynamic process of a cardiac cycle in
form of a derived 1D motion descriptor. Additionally, based on the expected
cardiovascular physiological properties of a contracting or relaxing ventricle,
we define a set of rules that enables the identification of five cardiovascular
phases including the end-systole (ES) and end-diastole (ED) without the usage
of labels. We evaluate the plausibility of the motion descriptor on two
challenging multi-disease, -center, -scanner short-axis CMR datasets. First, by
reporting quantitative measures such as the periodic frame difference for the
extracted phases. Second, by comparing qualitatively the general pattern when
we temporally resample and align the motion descriptors of all instances across
both datasets. The average periodic frame difference for the ED, ES key phases
of our approach is $0.80\pm{0.85}$, $0.69\pm{0.79}$ which is slightly better
than the inter-observer variability ($1.07\pm{0.86}$, $0.91\pm{1.6}$) and the
supervised baseline method ($1.18\pm{1.91}$, $1.21\pm{1.78}$). Code and labels
will be made available on our GitHub repository.
https://github.com/Cardio-AI/cmr-phase-detection
Related papers
- Systole-Conditioned Generative Cardiac Motion [14.94166259218979]
We present a novel approach that synthesizes realistically looking pairs of cardiac CT frames enriched with dense 3D flow field annotations.<n>Our method leverages a conditional Variational Autoencoder (CVAE), which incorporates a novel multi-scale feature conditioning mechanism.<n>Our data generation pipeline could enable the training and validation of more complex and accurate myocardium motion models.
arXiv Detail & Related papers (2025-07-20T14:44:40Z) - Global and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECG [40.407824759778784]
PTACL (Patient and Temporal Alignment Contrastive Learning) is a multimodal contrastive learning framework that enhances ECG representations by integrating-temporal information from CMR.<n>We evaluate PTACL on paired ECG-CMR data from 27,951 subjects in the UK Biobank.<n>Our results highlight the potential of PTACL to enhance non-invasive cardiac diagnostics using ECG.
arXiv Detail & Related papers (2025-06-24T17:19:39Z) - ArrhythmiaVision: Resource-Conscious Deep Learning Models with Visual Explanations for ECG Arrhythmia Classification [0.0]
We propose ArrhythmiNet V1 and V2, optimized for efficient, real-time arrhythmia classification on edge devices.<n>Inspired by MobileNet's depthwise separable convolutional design, these models maintain memory footprints of just 302.18 KB and 157.76 KB, respectively.<n>Our findings demonstrate the feasibility of combining interpretability, predictive accuracy, and computational efficiency in practical, wearable, and embedded ECG monitoring systems.
arXiv Detail & Related papers (2025-04-30T18:22:45Z) - Enhancing Electrocardiogram Signal Analysis Using NLP-Inspired Techniques: A Novel Approach with Embedding and Self-Attention [2.7651063843287718]
We propose a novel ECG analysis technique, based on embedding and self attention, to capture the spatial as well as the temporal dependencies of the ECG data.
An accuracy of 91% was achieved with a good F1-score for all the disease classes.
arXiv Detail & Related papers (2024-07-15T12:20:15Z) - Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Images [13.686473040836113]
We introduce a whole-heart self-supervised learning framework to automatically uncover the correlations between spatial and temporal patches throughout the cardiac stacks.
We train our model on 14,000 unlabeled CMR data from UK BioBank and evaluate it on 1,000 annotated data.
arXiv Detail & Related papers (2024-06-01T07:08:45Z) - Learned Local Attention Maps for Synthesising Vessel Segmentations [43.314353195417326]
We present an encoder-decoder model for synthesising segmentations of the main cerebral arteries in the circle of Willis (CoW) from only T2 MRI.
It uses learned local attention maps generated by dilating the segmentation labels, which forces the network to only extract information from the T2 MRI relevant to synthesising the CoW.
arXiv Detail & Related papers (2023-08-24T15:32:27Z) - Error correcting 2D-3D cascaded network for myocardial infarct scar segmentation on late gadolinium enhancement cardiac magnetic resonance images [1.099532646524593]
We propose a cascaded framework of convolutional neural networks (CNNs) which enables to calculate the extent of myocardial infarction in a fully automated way.<n>We show that our framework outperforms state-of-the-art reference methods in segmentation of myocardial infarction.
arXiv Detail & Related papers (2023-06-26T14:21:18Z) - PulseNet: Deep Learning ECG-signal classification using random
augmentation policy and continous wavelet transform for canines [46.09869227806991]
evaluating canine electrocardiograms (ECG) require skilled veterinarians.
Current availability of veterinary cardiologists for ECG interpretation and diagnostic support is limited.
We implement a deep convolutional neural network (CNN) approach for classifying canine electrocardiogram sequences as either normal or abnormal.
arXiv Detail & Related papers (2023-05-17T09:06:39Z) - Three-dimensional micro-structurally informed in silico myocardium --
towards virtual imaging trials in cardiac diffusion weighted MRI [58.484353709077034]
We propose a novel method to generate a realistic numerical phantom of myocardial microstructure.
In-silico tissue models enable evaluating quantitative models of magnetic resonance imaging.
arXiv Detail & Related papers (2022-08-22T22:01:44Z) - Echocardiography Segmentation with Enforced Temporal Consistency [10.652677452009627]
We propose a framework to learn the 2D+time long-axis cardiac shape.
The identification and correction of cardiac inconsistencies relies on a constrained autoencoder trained to learn a physiologically interpretable embedding of cardiac shapes.
arXiv Detail & Related papers (2021-12-03T16:09:32Z) - Generalizing electrocardiogram delineation: training convolutional
neural networks with synthetic data augmentation [63.51064808536065]
Existing databases for ECG delineation are small, being insufficient in size and in the array of pathological conditions they represent.
This article delves has two main contributions. First, a pseudo-synthetic data generation algorithm was developed, based in probabilistically composing ECG traces given "pools" of fundamental segments, as cropped from the original databases, and a set of rules for their arrangement into coherent synthetic traces.
Second, two novel segmentation-based loss functions have been developed, which attempt at enforcing the prediction of an exact number of independent structures and at producing closer segmentation boundaries by focusing on a reduced number of samples.
arXiv Detail & Related papers (2021-11-25T10:11:41Z) - Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice
Cardiac MR Images by Incorporating Pretrained Task Networks [0.6437191714189735]
We show that there is a considerable domain shift between AX and SAX CMR images.
We propose a novel unsupervised domain adaptation approach, which uses task-related probabilities in an attention mechanism.
Our pre-trained task module has neither seen CMR images nor labels from the target domain, but is able to segment them after the domain gap is reduced.
arXiv Detail & Related papers (2021-01-19T14:39:30Z) - Myocardial Segmentation of Cardiac MRI Sequences with Temporal
Consistency for Coronary Artery Disease Diagnosis [12.53412028532286]
We propose a myocardial segmentation framework for sequence of cardiac MRI (CMR) scanning images of left ventricular cavity, right ventricular cavity, and myocardium.
Our framework can improve the segmentation accuracy by up to 2% in Dice coefficient.
arXiv Detail & Related papers (2020-12-29T01:54:09Z) - Noise-Resilient Automatic Interpretation of Holter ECG Recordings [67.59562181136491]
We present a three-stage process for analysing Holter recordings with robustness to noisy signal.
First stage is a segmentation neural network (NN) with gradientdecoder architecture which detects positions of heartbeats.
Second stage is a classification NN which will classify heartbeats as wide or narrow.
Third stage is a boosting decision trees (GBDT) on top of NN features that incorporates patient-wise features.
arXiv Detail & Related papers (2020-11-17T16:15:49Z) - Multilabel 12-Lead Electrocardiogram Classification Using Gradient
Boosting Tree Ensemble [64.29529357862955]
We build an algorithm using gradient boosted tree ensembles fitted on morphology and signal processing features to classify ECG diagnosis.
For each lead, we derive features from heart rate variability, PQRST template shape, and the full signal waveform.
We join the features of all 12 leads to fit an ensemble of gradient boosting decision trees to predict probabilities of ECG instances belonging to each class.
arXiv Detail & Related papers (2020-10-21T18:11:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.