Semantic-aware Temporal Channel-wise Attention for Cardiac Function Assessment

• URL: http://arxiv.org/abs/2310.05428v1
• Date: Mon, 9 Oct 2023 05:57:01 GMT
• Title: Semantic-aware Temporal Channel-wise Attention for Cardiac Function Assessment
• Authors: Guanqi Chen, Guanbin Li
• Abstract summary: Existing video-based methods do not pay much attention to the left ventricular region, nor the left ventricular changes caused by motion. We propose a semi-supervised auxiliary learning paradigm with a left ventricular segmentation task, which contributes to the representation learning for the left ventricular region. Our approach achieves state-of-the-art performance on the Stanford dataset with an improvement of 0.22 MAE, 0.26 RMSE, and 1.9% $R2$.
• Score: 69.02116920364311
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cardiac function assessment aims at predicting left ventricular ejection fraction (LVEF) given an echocardiogram video, which requests models to focus on the changes in the left ventricle during the cardiac cycle. How to assess cardiac function accurately and automatically from an echocardiogram video is a valuable topic in intelligent assisted healthcare. Existing video-based methods do not pay much attention to the left ventricular region, nor the left ventricular changes caused by motion. In this work, we propose a semi-supervised auxiliary learning paradigm with a left ventricular segmentation task, which contributes to the representation learning for the left ventricular region. To better model the importance of motion information, we introduce a temporal channel-wise attention (TCA) module to excite those channels used to describe motion. Furthermore, we reform the TCA module with semantic perception by taking the segmentation map of the left ventricle as input to focus on the motion patterns of the left ventricle. Finally, to reduce the difficulty of direct LVEF regression, we utilize an anchor-based classification and regression method to predict LVEF. Our approach achieves state-of-the-art performance on the Stanford dataset with an improvement of 0.22 MAE, 0.26 RMSE, and 1.9% $R^2$.

Related papers

• Lost in Tracking: Uncertainty-guided Cardiac Cine MRI Segmentation at Right Ventricle Base [6.124743898202368]
  We propose to address the currently unsolved issues in CMR segmentation, specifically at the RV base. We propose a novel dual encoder U-Net architecture that leverages temporal incoherence to inform the segmentation when interplanar motions occur.
  arXiv  Detail & Related papers  (2024-10-04T11:14:31Z)
• Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration [50.602074919305636]
  This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg. We use epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features.
  arXiv  Detail & Related papers  (2024-06-20T17:47:30Z)
• Deep Learning for Automatic Strain Quantification in Arrhythmogenic Right Ventricular Cardiomyopathy [0.0]
  Quantification of cardiac motion with cine Cardiac Magnetic Resonance Imaging (CMRI) is an integral part of arrhythmogenic right ventricular cardiomyopathy (ARVC) diagnosis. We develop a method to automatically assess cardiac motion using Implicit Neural Representations (INRs) and a deep learning approach. Our results show that inter-slice alignment and generation of super-resolved volumes combined with joint analysis of the two cardiac views, notably improves registration performance.
  arXiv  Detail & Related papers  (2023-11-24T12:55:36Z)
• SimLVSeg: Simplifying Left Ventricular Segmentation in 2D+Time Echocardiograms with Self- and Weakly-Supervised Learning [0.8672882547905405]
  We develop SimLVSeg, a video-based network for consistent left ventricular (LV) segmentation from sparsely annotated echocardiogram videos. SimLVSeg consists of self-supervised pre-training with temporal masking, followed by weakly supervised learning tailored for LV segmentation from sparse annotations. We demonstrate how SimLVSeg outperforms the state-of-the-art solutions by achieving a 93.32% dice score on the largest 2D+time echocardiography dataset.
  arXiv  Detail & Related papers  (2023-09-30T18:13:41Z)
• Cyclical Self-Supervision for Semi-Supervised Ejection Fraction Prediction from Echocardiogram Videos [32.62593401120131]
  Left-ventricular ejection fraction (LVEF) is an important indicator of heart failure. Current methods for LVEF estimation from video require large amounts of annotated data to achieve high performance. This paper presents the first semi-supervised approach for LVEF prediction.
  arXiv  Detail & Related papers  (2022-10-20T14:23:40Z)
• Semi-supervised Cardiac Image Segmentation via Label Propagation and Style Transfer [21.160227706899974]
  We present a fully automatic method to segment cardiac structures including the left (LV) and right ventricle (RV) blood pools. Specifically, we design a semi-supervised learning method to leverage unlabelled MRI sequence timeframes by label propagation. We exploit style transfer to reduce the variance among different centers and vendors for more robust cardiac image segmentation.
  arXiv  Detail & Related papers  (2020-12-29T14:57:03Z)
• Learning Tubule-Sensitive CNNs for Pulmonary Airway and Artery-Vein Segmentation in CT [45.93021999366973]
  Training convolutional neural networks (CNNs) for segmentation of pulmonary airway, artery, and vein is challenging. We present a CNNs-based method for accurate airway and artery-vein segmentation in non-contrast computed tomography. It enjoys superior sensitivity to tenuous peripheral bronchioles, arterioles, and venules.
  arXiv  Detail & Related papers  (2020-12-10T15:56:08Z)
• Neural collaborative filtering for unsupervised mitral valve segmentation in echocardiography [60.08918310097638]
  We propose an automated and unsupervised method for the mitral valve segmentation based on a low dimensional embedding of the echocardiography videos. The method is evaluated in a collection of echocardiography videos of patients with a variety of mitral valve diseases and on an independent test cohort. It outperforms state-of-the-art emphunsupervised and emphsupervised methods on low-quality videos or in the case of sparse annotation.
  arXiv  Detail & Related papers  (2020-08-13T12:53:26Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)
• Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on 2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
  The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI. A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing. The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
  arXiv  Detail & Related papers  (2020-05-27T20:44:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.