EchoNarrator: Generating natural text explanations for ejection fraction predictions

• URL: http://arxiv.org/abs/2410.23744v1
• Date: Thu, 31 Oct 2024 08:59:34 GMT
• Title: EchoNarrator: Generating natural text explanations for ejection fraction predictions
• Authors: Sarina Thomas, Qing Cao, Anna Novikova, Daria Kulikova, Guy Ben-Yosef,
• Abstract summary: Ejection fraction (EF) of the left ventricle (LV) is considered as one of the most important measurements for diagnosing acute heart failure. Recent successes in deep learning research successfully estimate EF values, but the proposed models often lack an explanation for the prediction. We propose a model that combines estimation of the LV contour over multiple frames, together with a set of modules and routines for computing various motion and shape attributes. It then feeds the attributes into a large language model to generate text that helps to explain the network's outcome in a human-like manner.
• Score: 1.3082208571657106
• License:
• Abstract: Ejection fraction (EF) of the left ventricle (LV) is considered as one of the most important measurements for diagnosing acute heart failure and can be estimated during cardiac ultrasound acquisition. While recent successes in deep learning research successfully estimate EF values, the proposed models often lack an explanation for the prediction. However, providing clear and intuitive explanations for clinical measurement predictions would increase the trust of cardiologists in these models. In this paper, we explore predicting EF measurements with Natural Language Explanation (NLE). We propose a model that in a single forward pass combines estimation of the LV contour over multiple frames, together with a set of modules and routines for computing various motion and shape attributes that are associated with ejection fraction. It then feeds the attributes into a large language model to generate text that helps to explain the network's outcome in a human-like manner. We provide experimental evaluation of our explanatory output, as well as EF prediction, and show that our model can provide EF comparable to state-of-the-art together with meaningful and accurate natural language explanation to the prediction. The project page can be found at https://github.com/guybenyosef/EchoNarrator .

Related papers

• Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation [56.87049651707208]
  Few-shot Semantic has evolved into In-context tasks, morphing into a crucial element in assessing generalist segmentation models. Our initial focus lies in understanding how to facilitate interaction between the query image and the support image, resulting in the proposal of a KV fusion method within the self-attention framework. Based on our analysis, we establish a simple and effective framework named DiffewS, maximally retaining the original Latent Diffusion Model's generative framework.
  arXiv  Detail & Related papers  (2024-10-03T10:33:49Z)
• A generative framework to bridge data-driven models and scientific theories in language neuroscience [84.76462599023802]
  We present generative explanation-mediated validation, a framework for generating concise explanations of language selectivity in the brain. We show that explanatory accuracy is closely related to the predictive power and stability of the underlying statistical models.
  arXiv  Detail & Related papers  (2024-10-01T15:57:48Z)
• Contrastive Learning with Counterfactual Explanations for Radiology Report Generation [83.30609465252441]
  We propose a textbfCountertextbfFactual textbfExplanations-based framework (CoFE) for radiology report generation. Counterfactual explanations serve as a potent tool for understanding how decisions made by algorithms can be changed by asking what if'' scenarios. Experiments on two benchmarks demonstrate that leveraging the counterfactual explanations enables CoFE to generate semantically coherent and factually complete reports.
  arXiv  Detail & Related papers  (2024-07-19T17:24:25Z)
• Extracting Training Data from Unconditional Diffusion Models [76.85077961718875]
  diffusion probabilistic models (DPMs) are being employed as mainstream models for generative artificial intelligence (AI) We aim to establish a theoretical understanding of memorization in DPMs with 1) a memorization metric for theoretical analysis, 2) an analysis of conditional memorization with informative and random labels, and 3) two better evaluation metrics for measuring memorization. Based on the theoretical analysis, we propose a novel data extraction method called textbfSurrogate condItional Data Extraction (SIDE) that leverages a trained on generated data as a surrogate condition to extract training data directly from unconditional diffusion models.
  arXiv  Detail & Related papers  (2024-06-18T16:20:12Z)
• Embracing Uncertainty Flexibility: Harnessing a Supervised Tree Kernel to Empower Ensemble Modelling for 2D Echocardiography-Based Prediction of Right Ventricular Volume [0.5492530316344587]
  The right ventricular (RV) function deterioration strongly predicts clinical outcomes in numerous circumstances. We propose to complement the volume predictions with uncertainty scores. The proposed framework can be used to enhance the decision-making process and reduce risks.
  arXiv  Detail & Related papers  (2024-03-04T12:36:31Z)
• MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation [58.93221876843639]
  This paper introduces a novel, end-to-end diffusion-based risk prediction model, named MedDiffusion. It enhances risk prediction performance by creating synthetic patient data during training to enlarge sample space. It discerns hidden relationships between patient visits using a step-wise attention mechanism, enabling the model to automatically retain the most vital information for generating high-quality data.
  arXiv  Detail & Related papers  (2023-10-04T01:36:30Z)
• Cyclical Self-Supervision for Semi-Supervised Ejection Fraction Prediction from Echocardiogram Videos [32.62593401120131]
  Left-ventricular ejection fraction (LVEF) is an important indicator of heart failure. Current methods for LVEF estimation from video require large amounts of annotated data to achieve high performance. This paper presents the first semi-supervised approach for LVEF prediction.
  arXiv  Detail & Related papers  (2022-10-20T14:23:40Z)
• EchoGNN: Explainable Ejection Fraction Estimation with Graph Neural Networks [26.817931695658583]
  Ejection fraction (EF) is a key indicator of cardiac function, allowing identification of patients prone to heart dysfunctions such as heart failure. EF is estimated from cardiac ultrasound videos known as echocardiograms (echo) by manually tracing the left ventricle and estimating its volume on certain frames. These estimations exhibit high inter-observer variability due to the manual process and varying video quality. We introduce EchoGNN, a model based on graph neural networks (GNNs) to estimate EF from echo videos.
  arXiv  Detail & Related papers  (2022-08-30T05:59:57Z)
• Neural operator learning of heterogeneous mechanobiological insults contributing to aortic aneurysms [0.15658704610960567]
  Thoracic aortic aneurysm (TAA) is a localized dilatation of the aorta resulting from compromised wall composition, structure, and function. We present an integrated framework to train a deep operator network (DeepONet)-based surrogate model to identify contributing factors for TAA. We show that the proposed approach can predict patient-specific mechanobiological insult profile with a high accuracy.
  arXiv  Detail & Related papers  (2022-05-08T04:37:49Z)
• Flexible Amortized Variational Inference in qBOLD MRI [56.4324135502282]
  Oxygen extraction fraction (OEF) and deoxygenated blood volume (DBV) are more ambiguously determined from the data. Existing inference methods tend to yield very noisy and underestimated OEF maps, while overestimating DBV. This work describes a novel probabilistic machine learning approach that can infer plausible distributions of OEF and DBV.
  arXiv  Detail & Related papers  (2022-03-11T10:47:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.