Interpretable Multimodal Learning for Cardiovascular Hemodynamics Assessment

• URL: http://arxiv.org/abs/2404.04718v1
• Date: Sat, 6 Apr 2024 19:42:25 GMT
• Title: Interpretable Multimodal Learning for Cardiovascular Hemodynamics Assessment
• Authors: Prasun C Tripathi, Sina Tabakhi, Mohammod N I Suvon, Lawrence Schöb, Samer Alabed, Andrew J Swift, Shuo Zhou, Haiping Lu,
• Abstract summary: Pulmonary Arterial Wedge Pressure (PAWP) is an essential marker to detect heart failure. In this paper, we propose a multimodal learning pipeline to predict PAWP marker.
• Score: 5.854275745400326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pulmonary Arterial Wedge Pressure (PAWP) is an essential cardiovascular hemodynamics marker to detect heart failure. In clinical practice, Right Heart Catheterization is considered a gold standard for assessing cardiac hemodynamics while non-invasive methods are often needed to screen high-risk patients from a large population. In this paper, we propose a multimodal learning pipeline to predict PAWP marker. We utilize complementary information from Cardiac Magnetic Resonance Imaging (CMR) scans (short-axis and four-chamber) and Electronic Health Records (EHRs). We extract spatio-temporal features from CMR scans using tensor-based learning. We propose a graph attention network to select important EHR features for prediction, where we model subjects as graph nodes and feature relationships as graph edges using the attention mechanism. We design four feature fusion strategies: early, intermediate, late, and hybrid fusion. With a linear classifier and linear fusion strategies, our pipeline is interpretable. We validate our pipeline on a large dataset of $2,641$ subjects from our ASPIRE registry. The comparative study against state-of-the-art methods confirms the superiority of our pipeline. The decision curve analysis further validates that our pipeline can be applied to screen a large population. The code is available at https://github.com/prasunc/hemodynamics.

Related papers

• Deep vectorised operators for pulsatile hemodynamics estimation in coronary arteries from a steady-state prior [2.3971720731010766]
  We propose a time-efficient surrogate model, powered by machine learning, for the estimation of pulsatile hemodynamics. We show that our model produces accurate estimates of the pulsatile velocity and pressure while being agnostic to re-sampling of the source domain.
  arXiv  Detail & Related papers  (2024-10-15T12:24:50Z)
• Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Images [13.686473040836113]
  We introduce a whole-heart self-supervised learning framework to automatically uncover the correlations between spatial and temporal patches throughout the cardiac stacks. We train our model on 14,000 unlabeled CMR data from UK BioBank and evaluate it on 1,000 annotated data.
  arXiv  Detail & Related papers  (2024-06-01T07:08:45Z)
• FunnelNet: An End-to-End Deep Learning Framework to Monitor Digital Heart Murmur in Real-Time [5.408260756721024]
  Heart murmurs are abnormal sounds caused by turbulent blood flow within the heart. This study aims to develop a novel end-to-end real-time heart murmur detection approach using traditional and depthwise convolutional networks.
  arXiv  Detail & Related papers  (2024-05-10T03:12:17Z)
• Tensor-based Multimodal Learning for Prediction of Pulmonary Arterial Wedge Pressure from Cardiac MRI [6.21112347271845]
  Heart failure is a serious and life-threatening condition that can lead to elevated pressure in the left ventricle. PAWP is an important surrogate marker indicating high pressure in the left ventricle. A non-invasive method is useful in quickly identifying high-risk patients from a large population.
  arXiv  Detail & Related papers  (2023-03-14T00:05:08Z)
• Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification [74.84221280249876]
  An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
  arXiv  Detail & Related papers  (2022-05-08T15:29:54Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• ECG-Based Heart Arrhythmia Diagnosis Through Attentional Convolutional Neural Networks [9.410102957429705]
  We propose Attention-Based Convolutional Neural Networks (ABCNN) to work on the raw ECG signals and automatically extract the informative dependencies for accurate arrhythmia detection. Our main task is to find the arrhythmia from normal heartbeats and, at the meantime, accurately recognize the heart diseases from five arrhythmia types. The experimental results show that the proposed ABCNN outperforms the widely used baselines.
  arXiv  Detail & Related papers  (2021-08-18T14:55:46Z)
• Learning Tubule-Sensitive CNNs for Pulmonary Airway and Artery-Vein Segmentation in CT [45.93021999366973]
  Training convolutional neural networks (CNNs) for segmentation of pulmonary airway, artery, and vein is challenging. We present a CNNs-based method for accurate airway and artery-vein segmentation in non-contrast computed tomography. It enjoys superior sensitivity to tenuous peripheral bronchioles, arterioles, and venules.
  arXiv  Detail & Related papers  (2020-12-10T15:56:08Z)
• Noise-Resilient Automatic Interpretation of Holter ECG Recordings [67.59562181136491]
  We present a three-stage process for analysing Holter recordings with robustness to noisy signal. First stage is a segmentation neural network (NN) with gradientdecoder architecture which detects positions of heartbeats. Second stage is a classification NN which will classify heartbeats as wide or narrow. Third stage is a boosting decision trees (GBDT) on top of NN features that incorporates patient-wise features.
  arXiv  Detail & Related papers  (2020-11-17T16:15:49Z)
• BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes [53.163089893876645]
  We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey. An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys. We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
  arXiv  Detail & Related papers  (2020-09-24T00:42:36Z)
• A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced Cardiac Magnetic Resonance Imaging [90.29017019187282]
  " 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset. Analyse of the submitted algorithms using technical and biological metrics was performed. Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
  arXiv  Detail & Related papers  (2020-04-26T08:49:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.