Echo4DIR: 4D Implicit Heart Reconstruction from 2D Echocardiography Videos

• URL: http://arxiv.org/abs/2605.22066v1
• Date: Thu, 21 May 2026 07:01:23 GMT
• Title: Echo4DIR: 4D Implicit Heart Reconstruction from 2D Echocardiography Videos
• Abstract summary: We propose Echo4DIR, a novel test-time 4D implicit reconstruction framework.<n>We learn robust 3D shape priors from statistical shape models (SSMs) via a cardiac conditional SDF.<n>We show that Echo4DIR achieves state-of-the-art 4D cardiac mesh reconstruction, notably an impressive clinical overlap of up to 98.35% Dice and 96.75% IoU.
• Score: 35.992365807108584
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reconstructing 4D (3D+t) cardiac geometry from sparse 2D echocardiography is highly desirable yet fundamentally challenged by geometric ambiguity and temporal discontinuity. To tackle these issues, we propose Echo4DIR, a novel test-time 4D implicit reconstruction framework. Specifically, we learn robust 3D shape priors from statistical shape models (SSMs) via a cardiac conditional SDF, constructing an Epipolar Mask Encoder module with epipolar cross attention to effectively fuse multi-view features. To bridge the synthetic-to-real domain gap, we introduce a self-supervised SDF-tailored differentiable rendering strategy for patient-specific 3D shape adaptation using uncalibrated clinical masks without requiring 3D ground truth. Crucially, the inherent continuity of implicit representation overcomes sparse observations, enabling anatomically reliable geometry at arbitrary resolutions. Furthermore, to empower our framework with physically continuous 4D extension, we introduce a Radial SDF Alignment strategy that strictly locks shape evolution to the predicted velocity field, fundamentally eliminating mesh drift. Extensive experiments on synthetic benchmarks and real clinical datasets demonstrate that Echo4DIR achieves state-of-the-art 4D cardiac mesh reconstruction, notably yielding an impressive clinical overlap of up to 98.35% Dice and 96.75% IoU.

Related papers

• Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering [7.111748961723236]
  We propose a novel end-to-end framework for reconstructing temporally resolved whole-heart meshes from 2D cine MRI sequences.<n>The framework incorporates a differentiable contour inspired by the Beer-Lambert attenuation principle, enabling anatomy-aware supervision of 3D+t mesh deformation.<n>The proposed method achieved a whole-heart mean absolute error of 1.68 $pm$ 0.31 mm and a motion jitter of 0.77 $pm$ 0.17 $mathrmmm/mathrmframe3$, outperforming existing methods with lower reconstruction error and substantially improved motion smoothness.
  arXiv  Detail & Related papers  (2026-07-02T09:42:46Z)
• Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video [69.94904173314505]
  We propose Ground4D, a geometry-grounded framework built on two stages.<n>First, we reconstruct multi-view-consistent 3D geometry and camera poses from monocular video.<n>Second, we conduct geometry-consistency-aware refinement via dynamic Gaussian Splatting.
  arXiv  Detail & Related papers  (2026-06-27T09:27:42Z)
• Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis [15.392128655814451]
  We propose a 4D controllable generative framework for anatomically consistent data augmentation.<n>A semi-supervised variational autoencoder learns a compact latent representation of anatomical volumes.<n>Anatomical structure is disentangled from temporal dynamics through a cascaded latent diffusion model.
  arXiv  Detail & Related papers  (2026-06-25T08:48:45Z)
• Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild [87.49244020695505]
  Reconstructing dynamic non-rigid objects from monocular video requires integrating visual cues from direct observations with data-driven priors over geometry and appearance.<n>Prior approaches either learn to directly predict 4D representations from visual input or initialize a 3D representation that is subsequently deformed and refined based on video evidence.<n>We present Lift4D, a test-time optimization framework that addresses both limitations.
  arXiv  Detail & Related papers  (2026-06-22T17:59:54Z)
• Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI for Cardiac Digital Twins [7.407471411133294]
  We propose a novel explicit geometry-motion embedded model to reconstruct 3D MI directly from cine MRIs.<n> Experimental results on 225 cine MRIs demonstrated that the proposed 3D MI reconstruction achieved high performance with an average Dice score of 0.678 $pm$ 0.011.
  arXiv  Detail & Related papers  (2026-06-01T07:25:56Z)
• CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRI [7.535721717099375]
  We propose CineMesh4D, a novel end-to-end 4D (3D+t) pipeline that directly reconstructs patient-specific whole-heart mesh from cine MRI.<n>CineMesh4D outperforms existing approaches in terms of reconstruction quality and motion consistency.
  arXiv  Detail & Related papers  (2026-05-13T18:05:08Z)
• Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformers [70.55535980817577]
  Sculpt4D is a native 4D generative framework that seamlessly integrates efficient temporal modeling into a pretrained 3D Transformer.<n>We show that Sculpt4D establishes a new state-of-the-art in temporally coherent 4D synthesis and charts a path toward efficient and scalable 4D generation.
  arXiv  Detail & Related papers  (2026-04-23T12:18:55Z)
• PhaseFlow4D: Physically Constrained 4D Beam Reconstruction via Feedback-Guided Latent Diffusion [78.29352305480285]
  PhaseFlow4D reconstructs and tracks the full 4D phase space from incomplete 2D observations alone.<n>We validate on multi-particle simulations of heavy-ion beams at the Facility for Rare Isotope Beams.
  arXiv  Detail & Related papers  (2026-04-04T22:37:01Z)
• SS4D: Native 4D Generative Model via Structured Spacetime Latents [50.29500511908054]
  We present SS4D, a native 4D generative model that synthesizes dynamic 3D objects directly from monocular video.<n>We train a generator directly on 4D data, achieving high fidelity, temporal coherence, and structural consistency.
  arXiv  Detail & Related papers  (2025-12-16T10:45:06Z)
• 3D Heart Reconstruction from Sparse Pose-agnostic 2D Echocardiographic Slices [6.275809518974307]
  We propose an innovative framework for reconstructing personalized 3D heart anatomy from 2D echo slices.<n>When six planes are used, the reconstructed 3D heart can lead to a significant improvement for LV volume estimation.<n>This study provides a new way for personalized 3D structure and function analysis from cardiac ultrasound.
  arXiv  Detail & Related papers  (2025-07-03T08:13:07Z)
• X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction [64.2059940799033]
  Current methods discretize temporal resolution into fixed phases with respiratory gating devices.<n>X$2$-Gaussian, a novel framework, enables continuous-time 4DCT reconstruction by integrating dynamic radiative splatting with self-supervised respiratory motion learning.
  arXiv  Detail & Related papers  (2025-03-27T17:59:57Z)
• MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
  We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data.<n>Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging.<n>We propose a versatile framework for reconstructing 3D motion from such partial data.
  arXiv  Detail & Related papers  (2024-12-03T17:18:33Z)
• DeepRecon: Joint 2D Cardiac Segmentation and 3D Volume Reconstruction via A Structure-Specific Generative Method [12.26150675728958]
  We propose an end-to-end latent-space-based framework, DeepRecon, that generates multiple clinically essential outcomes. Our method identifies the optimal latent representation of the cine image that contains accurate semantic information for cardiac structures. In particular, our model jointly generates synthetic images with accurate semantic information and segmentation of the cardiac structures.
  arXiv  Detail & Related papers  (2022-06-14T20:46:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.