Automated Interpretable 2D Video Extraction from 3D Echocardiography

• URL: http://arxiv.org/abs/2511.15946v2
• Date: Fri, 21 Nov 2025 18:09:32 GMT
• Title: Automated Interpretable 2D Video Extraction from 3D Echocardiography
• Authors: Milos Vukadinovic, Hirotaka Ieki, Yuki Sahashi, David Ouyang, Bryan He,
• Abstract summary: Conventional medical imaging with cardiac ultrasound relies on a series of 2D videos showing individual cardiac structures.<n>We propose an automated method to select standard 2D views from 3D cardiac ultrasound volumes.
• Score: 0.9320657506524149
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Although the heart has complex three-dimensional (3D) anatomy, conventional medical imaging with cardiac ultrasound relies on a series of 2D videos showing individual cardiac structures. 3D echocardiography is a developing modality that now offers adequate image quality for clinical use, with potential to streamline acquisition and improve assessment of off-axis features. We propose an automated method to select standard 2D views from 3D cardiac ultrasound volumes, allowing physicians to interpret the data in their usual format while benefiting from the speed and usability of 3D scanning. Applying a deep learning view classifier and downstream heuristics based on anatomical landmarks together with heuristics provided by cardiologists, we reconstruct standard echocardiography views. This approach was validated by three cardiologists in blinded evaluation (96\% accuracy in 1,600 videos from 2 hospitals). The downstream 2D videos were also validated in their ability to detect cardiac abnormalities using AI echocardiography models (EchoPrime and PanEcho) as well as ability to generate clinical-grade measurements of cardiac anatomy (EchoNet-Measurement). We demonstrated that the extracted 2D videos preserve spatial calibration and diagnostic features, allowing clinicians to obtain accurate real-world interpretations from 3D volumes. We release the code and a dataset of 29 3D echocardiography videos https://github.com/echonet/3d-echo .

Related papers

• 3D Heart Reconstruction from Sparse Pose-agnostic 2D Echocardiographic Slices [6.275809518974307]
  We propose an innovative framework for reconstructing personalized 3D heart anatomy from 2D echo slices.<n>When six planes are used, the reconstructed 3D heart can lead to a significant improvement for LV volume estimation.<n>This study provides a new way for personalized 3D structure and function analysis from cardiac ultrasound.
  arXiv  Detail & Related papers  (2025-07-03T08:13:07Z)
• UltraTwin: Towards Cardiac Anatomical Twin Generation from Multi-view 2D Ultrasound [17.70782591089384]
  We introduce a novel generative framework UltraTwin, to obtain cardiac anatomical twin from sparse multi-view 2D US.<n>First, pioneered the construction of a real-world and high-quality dataset containing strictly paired multi-view 2D US and CT.<n>Second, we propose a coarse-to-fine scheme to achieve hierarchical reconstruction optimization.<n>Third, we introduce an implicit autoencoder for topology-aware constraints.
  arXiv  Detail & Related papers  (2025-06-30T03:27:42Z)
• S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogram [8.28431711854234]
  Most clinical echocardiograms provide only two-dimensional views, limiting the ability to fully assess cardiac anatomy and function in three dimensions.<n>We propose a deep learning framework S2MNet that reconstructs continuous and high-fidelity 3D heart models by integrating six slices of routinely acquired 2D echocardiogram views.
  arXiv  Detail & Related papers  (2025-05-09T14:56:48Z)
• MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
  We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data.<n>Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging.<n>We propose a versatile framework for reconstructing 3D motion from such partial data.
  arXiv  Detail & Related papers  (2024-12-03T17:18:33Z)
• Advanced XR-Based 6-DOF Catheter Tracking System for Immersive Cardiac Intervention Training [37.69303106863453]
  This paper presents a novel system for real-time 3D tracking and visualization of intracardiac echocardiography (ICE) catheters. A custom 3D-printed setup captures biplane video of the catheter, while a specialized computer vision algorithm reconstructs its 3D trajectory. The system's data is integrated into an interactive Unity-based environment, rendered through the Meta Quest 3 XR headset.
  arXiv  Detail & Related papers  (2024-11-04T21:05:40Z)
• Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train [66.35766658717205]
  Successful echocardiography requires a thorough understanding of the structures on the two-dimensional plane and the spatial relationships between planes in three-dimensional space. We propose a large-scale self-supervised pre-training method to acquire a cardiac structure-aware world model.
  arXiv  Detail & Related papers  (2024-06-28T08:54:44Z)
• Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model [66.35766658717205]
  There is a severe shortage of experienced cardiac sonographers, due to the heart's complex structure and significant operational challenges. We present a Cardiac Copilot system capable of providing real-time probe movement guidance. The core innovation lies in proposing a data-driven world model, named Cardiac Dreamer, for representing cardiac spatial structures. We train our model with real-world ultrasound data and corresponding probe motion from 110 routine clinical scans with 151K sample pairs by three certified sonographers.
  arXiv  Detail & Related papers  (2024-06-19T02:42:29Z)
• Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction [53.93674177236367]
  Cone Beam Computed Tomography (CBCT) plays a vital role in clinical imaging. Traditional methods typically require hundreds of 2D X-ray projections to reconstruct a high-quality 3D CBCT image. This has led to a growing interest in sparse-view CBCT reconstruction to reduce radiation doses. We introduce a novel geometry-aware encoder-decoder framework to solve this problem.
  arXiv  Detail & Related papers  (2023-03-26T14:38:42Z)
• Efficient Pix2Vox++ for 3D Cardiac Reconstruction from 2D echo views [0.6524460254566904]
  Reconstructing cardiac anatomy in 3D can enable discovery of new biomarkers. Most ultrasound systems only have 2D imaging capabilities. We propose a pipeline to perform reconstruction of 3D anatomy from 2D standard cardiac views.
  arXiv  Detail & Related papers  (2022-07-27T10:05:46Z)
• XraySyn: Realistic View Synthesis From a Single Radiograph Through CT Priors [118.27130593216096]
  A radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane. To the best of our knowledge, this is the first work on radiograph view synthesis. We show that by gaining an understanding of radiography in 3D space, our method can be applied to radiograph bone extraction and suppression without groundtruth bone labels.
  arXiv  Detail & Related papers  (2020-12-04T05:08:53Z)
• Noise-Resilient Automatic Interpretation of Holter ECG Recordings [67.59562181136491]
  We present a three-stage process for analysing Holter recordings with robustness to noisy signal. First stage is a segmentation neural network (NN) with gradientdecoder architecture which detects positions of heartbeats. Second stage is a classification NN which will classify heartbeats as wide or narrow. Third stage is a boosting decision trees (GBDT) on top of NN features that incorporates patient-wise features.
  arXiv  Detail & Related papers  (2020-11-17T16:15:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.