CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRI
- URL: http://arxiv.org/abs/2605.13994v1
- Date: Wed, 13 May 2026 18:05:08 GMT
- Title: CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRI
- Abstract summary: We propose CineMesh4D, a novel end-to-end 4D (3D+t) pipeline that directly reconstructs patient-specific whole-heart mesh from cine MRI.<n>CineMesh4D outperforms existing approaches in terms of reconstruction quality and motion consistency.
- Score: 7.535721717099375
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Accurate 3D+t whole-heart mesh reconstruction from cine MRI is a clinically crucial yet technically challenging task. The difficulty of this task arises from two coupled factors: inherently sparse sampling of 3D cardiac anatomy by 2D image slices and the tight coupling between cardiac shape and motion. Current cardiac image-to-mesh approaches typically reconstruct only a subset of cardiac chambers or a single phase of the cardiac cycle. In this work, we propose CineMesh4D, a novel end-to-end 4D (3D+t) pipeline that directly reconstructs patient-specific whole-heart mesh from multi-view 2D cine MRI via cross-domain mapping. Specifically, we introduce a differentiable rendering loss that enables supervision of 3D+t whole-heart mesh from multi-view sparse contours of cine MRI. Furthermore, we develop a dual-context temporal block that fuses global and local cardiac temporal information to capture high-dimensional sequential patterns. In quantitative and qualitative evaluations, CineMesh4D outperforms existing approaches in terms of reconstruction quality and motion consistency, providing a practical pathway for personalized real-time cardiac assessment. The code will be publicly released once the manuscript is accepted.
Related papers
- Multiview Multi-Person Human Mesh Recovery Under Large Scenes with Occlusions [53.539496609429015]
We introduce a large-scale synthetic benchmark for multiview multi-person HMR, termed MVMP-HMR.<n>Based on this benchmark, we propose a multiview multi-person whole-body human mesh recovery model, referred to as MVMP-HMR.<n>The model first fuses multiview features into a scene-level 3D feature volume, and then leverages pelvis joints predicted by a 3D pose estimation network to extract person-specific queries from the 3D feature volume.<n>These human queries are cross-attended with the 3D feature volume and integrated to decode each person's 3D mesh.
arXiv Detail & Related papers (2026-07-27T11:47:26Z) - Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering [7.111748961723236]
We propose a novel end-to-end framework for reconstructing temporally resolved whole-heart meshes from 2D cine MRI sequences.<n>The framework incorporates a differentiable contour inspired by the Beer-Lambert attenuation principle, enabling anatomy-aware supervision of 3D+t mesh deformation.<n>The proposed method achieved a whole-heart mean absolute error of 1.68 $pm$ 0.31 mm and a motion jitter of 0.77 $pm$ 0.17 $mathrmmm/mathrmframe3$, outperforming existing methods with lower reconstruction error and substantially improved motion smoothness.
arXiv Detail & Related papers (2026-07-02T09:42:46Z) - Can Video Diffusion Model Reconstruct 4D Geometry? [66.5454886982702]
Sora3R is a novel framework that taps into richtemporals of large dynamic video diffusion models to infer 4D pointmaps from casual videos.<n>Experiments demonstrate that Sora3R reliably recovers both camera poses and detailed scene geometry, achieving performance on par with state-of-the-art methods for dynamic 4D reconstruction.
arXiv Detail & Related papers (2025-03-27T01:44:46Z) - MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data.<n>Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging.<n>We propose a versatile framework for reconstructing 3D motion from such partial data.
arXiv Detail & Related papers (2024-12-03T17:18:33Z) - MinD-3D: Reconstruct High-quality 3D objects in Human Brain [50.534007259536715]
Recon3DMind is an innovative task aimed at reconstructing 3D visuals from Functional Magnetic Resonance Imaging (fMRI) signals.
We present the fMRI-Shape dataset, which includes data from 14 participants and features 360-degree videos of 3D objects.
We propose MinD-3D, a novel and effective three-stage framework specifically designed to decode the brain's 3D visual information from fMRI signals.
arXiv Detail & Related papers (2023-12-12T18:21:36Z) - DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning [13.289561121562057]
3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases.
In this work, we model the heart as a 3D mesh consisting of epi- and endocardial surfaces.
We propose a novel learning framework, DeepMesh, which propagates a template heart mesh to a subject space and estimates the 3D motion of the heart mesh from CMR images for individual subjects.
arXiv Detail & Related papers (2023-09-25T17:24:18Z) - DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume
Reconstruction [33.59945107137013]
Current cardiac MRI-based reconstruction technology is 2D with limited through-plane resolution.
We propose a morphology-guided diffusion model for 3D cardiac volume reconstruction, DMCVR, that synthesizes high-resolution 2D images and corresponding 3D reconstructed volumes.
arXiv Detail & Related papers (2023-08-18T00:48:30Z) - Multi-class point cloud completion networks for 3D cardiac anatomy
reconstruction from cine magnetic resonance images [4.1448595037512925]
We propose a novel fully automatic surface reconstruction pipeline capable of reconstructing multi-class 3D cardiac anatomy meshes.
Its key component is a multi-class point cloud completion network (PCCN) capable of correcting both the sparsity and misalignment issues of the 3D reconstruction task.
arXiv Detail & Related papers (2023-07-17T14:52:52Z) - Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction [53.93674177236367]
Cone Beam Computed Tomography (CBCT) plays a vital role in clinical imaging.
Traditional methods typically require hundreds of 2D X-ray projections to reconstruct a high-quality 3D CBCT image.
This has led to a growing interest in sparse-view CBCT reconstruction to reduce radiation doses.
We introduce a novel geometry-aware encoder-decoder framework to solve this problem.
arXiv Detail & Related papers (2023-03-26T14:38:42Z) - MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View
Cardiac MRI [11.685829837689404]
We propose a novel multi-view motion estimation network (MulViMotion) to learn a consistent 3D motion field of the heart.
We extensively evaluate the proposed method on 2D cine CMR images from 580 subjects of the UK Biobank study for 3D motion tracking of the left ventricular myocardium.
arXiv Detail & Related papers (2022-07-29T18:29:52Z) - Monocular, One-stage, Regression of Multiple 3D People [105.3143785498094]
We propose to Regress all meshes in a One-stage fashion for Multiple 3D People (termed ROMP)
Our method simultaneously predicts a Body Center heatmap and a Mesh map, which can jointly describe the 3D body mesh on the pixel level.
Compared with state-of-the-art methods, ROMP superior performance on the challenging multi-person benchmarks.
arXiv Detail & Related papers (2020-08-27T17:21:47Z) - Coherent Reconstruction of Multiple Humans from a Single Image [68.3319089392548]
In this work, we address the problem of multi-person 3D pose estimation from a single image.
A typical regression approach in the top-down setting of this problem would first detect all humans and then reconstruct each one of them independently.
Our goal is to train a single network that learns to avoid these problems and generate a coherent 3D reconstruction of all the humans in the scene.
arXiv Detail & Related papers (2020-06-15T17:51:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.