S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogram
- URL: http://arxiv.org/abs/2505.06105v1
- Date: Fri, 09 May 2025 14:56:48 GMT
- Title: S2MNet: Speckle-To-Mesh Net for Three-Dimensional Cardiac Morphology Reconstruction via Echocardiogram
- Authors: Xilin Gong, Yongkai Chen, Shushan Wu, Fang Wang, Ping Ma, Wenxuan Zhong,
- Abstract summary: Most clinical echocardiograms provide only two-dimensional views, limiting the ability to fully assess cardiac anatomy and function in three dimensions.<n>We propose a deep learning framework S2MNet that reconstructs continuous and high-fidelity 3D heart models by integrating six slices of routinely acquired 2D echocardiogram views.
- Score: 8.28431711854234
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Echocardiogram is the most commonly used imaging modality in cardiac assessment duo to its non-invasive nature, real-time capability, and cost-effectiveness. Despite its advantages, most clinical echocardiograms provide only two-dimensional views, limiting the ability to fully assess cardiac anatomy and function in three dimensions. While three-dimensional echocardiography exists, it often suffers from reduced resolution, limited availability, and higher acquisition costs. To overcome these challenges, we propose a deep learning framework S2MNet that reconstructs continuous and high-fidelity 3D heart models by integrating six slices of routinely acquired 2D echocardiogram views. Our method has three advantages. First, our method avoid the difficulties on training data acquasition by simulate six of 2D echocardiogram images from corresponding slices of a given 3D heart mesh. Second, we introduce a deformation field-based method, which avoid spatial discontinuities or structural artifacts in 3D echocardiogram reconstructions. We validate our method using clinically collected echocardiogram and demonstrate that our estimated left ventricular volume, a key clinical indicator of cardiac function, is strongly correlated with the doctor measured GLPS, a clinical measurement that should demonstrate a negative correlation with LVE in medical theory. This association confirms the reliability of our proposed 3D construction method.
Related papers
- 3D Heart Reconstruction from Sparse Pose-agnostic 2D Echocardiographic Slices [6.275809518974307]
We propose an innovative framework for reconstructing personalized 3D heart anatomy from 2D echo slices.<n>When six planes are used, the reconstructed 3D heart can lead to a significant improvement for LV volume estimation.<n>This study provides a new way for personalized 3D structure and function analysis from cardiac ultrasound.
arXiv Detail & Related papers (2025-07-03T08:13:07Z) - UltraTwin: Towards Cardiac Anatomical Twin Generation from Multi-view 2D Ultrasound [17.70782591089384]
We introduce a novel generative framework UltraTwin, to obtain cardiac anatomical twin from sparse multi-view 2D US.<n>First, pioneered the construction of a real-world and high-quality dataset containing strictly paired multi-view 2D US and CT.<n>Second, we propose a coarse-to-fine scheme to achieve hierarchical reconstruction optimization.<n>Third, we introduce an implicit autoencoder for topology-aware constraints.
arXiv Detail & Related papers (2025-06-30T03:27:42Z) - Heartcare Suite: Multi-dimensional Understanding of ECG with Raw Multi-lead Signal Modeling [50.58126509704037]
Heartcare Suite is a framework for fine-grained electrocardiogram (ECG) understanding.<n>Heartcare-220K is a high-quality, structured, and comprehensive multimodal ECG dataset.<n>Heartcare-Bench is a benchmark to guide the optimization of Medical Multimodal Large Language Models (Med-MLLMs) in ECG scenarios.
arXiv Detail & Related papers (2025-06-06T07:56:41Z) - MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data.<n>Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging.<n>We propose a versatile framework for reconstructing 3D motion from such partial data.
arXiv Detail & Related papers (2024-12-03T17:18:33Z) - Sequence-aware Pre-training for Echocardiography Probe Guidance [66.35766658717205]
Cardiac ultrasound faces two major challenges: (1) the inherently complex structure of the heart, and (2) significant individual variations.
Previous works have only learned the population-averaged 2D and 3D structures of the heart rather than personalized cardiac structural features.
We propose a sequence-aware self-supervised pre-training method to learn personalized 2D and 3D cardiac structural features.
arXiv Detail & Related papers (2024-08-27T12:55:54Z) - Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train [66.35766658717205]
Successful echocardiography requires a thorough understanding of the structures on the two-dimensional plane and the spatial relationships between planes in three-dimensional space.
We propose a large-scale self-supervised pre-training method to acquire a cardiac structure-aware world model.
arXiv Detail & Related papers (2024-06-28T08:54:44Z) - Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration [50.602074919305636]
This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg.<n>We use epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features.
arXiv Detail & Related papers (2024-06-20T17:47:30Z) - Continuous 3D Myocardial Motion Tracking via Echocardiography [30.19879953016694]
Myocardial motion tracking is an essential clinical tool in the prevention and detection of cardiovascular diseases.
Current techniques suffer from incomplete and inaccurate motion estimation of the myocardium in both spatial and temporal dimensions.
This paper introduces the Neural Cardiac Motion Field (NeuralCMF) to model the 3D structure and the comprehensive 6D forward/backward motion of the heart.
arXiv Detail & Related papers (2023-10-04T13:11:20Z) - SimLVSeg: Simplifying Left Ventricular Segmentation in 2D+Time Echocardiograms with Self- and Weakly-Supervised Learning [0.8672882547905405]
We develop SimLVSeg, a video-based network for consistent left ventricular (LV) segmentation from sparsely annotated echocardiogram videos.
SimLVSeg consists of self-supervised pre-training with temporal masking, followed by weakly supervised learning tailored for LV segmentation from sparse annotations.
We demonstrate how SimLVSeg outperforms the state-of-the-art solutions by achieving a 93.32% dice score on the largest 2D+time echocardiography dataset.
arXiv Detail & Related papers (2023-09-30T18:13:41Z) - DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume
Reconstruction [33.59945107137013]
Current cardiac MRI-based reconstruction technology is 2D with limited through-plane resolution.
We propose a morphology-guided diffusion model for 3D cardiac volume reconstruction, DMCVR, that synthesizes high-resolution 2D images and corresponding 3D reconstructed volumes.
arXiv Detail & Related papers (2023-08-18T00:48:30Z) - Error correcting 2D-3D cascaded network for myocardial infarct scar
segmentation on late gadolinium enhancement cardiac magnetic resonance images [0.0]
We propose a cascaded framework of two-dimensional and three-dimensional convolutional neural networks (CNNs) which enables to calculate the extent of myocardial infarction in a fully automated way.
The proposed method was trained and evaluated in a five-fold cross validation using the training dataset from the EMIDEC challenge.
arXiv Detail & Related papers (2023-06-26T14:21:18Z) - Efficient Pix2Vox++ for 3D Cardiac Reconstruction from 2D echo views [0.6524460254566904]
Reconstructing cardiac anatomy in 3D can enable discovery of new biomarkers.
Most ultrasound systems only have 2D imaging capabilities.
We propose a pipeline to perform reconstruction of 3D anatomy from 2D standard cardiac views.
arXiv Detail & Related papers (2022-07-27T10:05:46Z) - Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on
2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI.
A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing.
The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
arXiv Detail & Related papers (2020-05-27T20:44:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.