DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume Reconstruction

• URL: http://arxiv.org/abs/2308.09223v1
• Date: Fri, 18 Aug 2023 00:48:30 GMT
• Title: DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume Reconstruction
• Authors: Xiaoxiao He, Chaowei Tan, Ligong Han, Bo Liu, Leon Axel, Kang Li, Dimitris N. Metaxas
• Abstract summary: Current cardiac MRI-based reconstruction technology is 2D with limited through-plane resolution. We propose a morphology-guided diffusion model for 3D cardiac volume reconstruction, DMCVR, that synthesizes high-resolution 2D images and corresponding 3D reconstructed volumes.
• Score: 33.59945107137013
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Accurate 3D cardiac reconstruction from cine magnetic resonance imaging (cMRI) is crucial for improved cardiovascular disease diagnosis and understanding of the heart's motion. However, current cardiac MRI-based reconstruction technology used in clinical settings is 2D with limited through-plane resolution, resulting in low-quality reconstructed cardiac volumes. To better reconstruct 3D cardiac volumes from sparse 2D image stacks, we propose a morphology-guided diffusion model for 3D cardiac volume reconstruction, DMCVR, that synthesizes high-resolution 2D images and corresponding 3D reconstructed volumes. Our method outperforms previous approaches by conditioning the cardiac morphology on the generative model, eliminating the time-consuming iterative optimization process of the latent code, and improving generation quality. The learned latent spaces provide global semantics, local cardiac morphology and details of each 2D cMRI slice with highly interpretable value to reconstruct 3D cardiac shape. Our experiments show that DMCVR is highly effective in several aspects, such as 2D generation and 3D reconstruction performance. With DMCVR, we can produce high-resolution 3D cardiac MRI reconstructions, surpassing current techniques. Our proposed framework has great potential for improving the accuracy of cardiac disease diagnosis and treatment planning. Code can be accessed at https://github.com/hexiaoxiao-cs/DMCVR.

Related papers

• 3D MedDiffusion: A 3D Medical Diffusion Model for Controllable and High-quality Medical Image Generation [47.701856217173244]
  3D Medical Diffusion (3D MedDiffusion) model for controllable, high-quality 3D medical image generation. 3D MedDiffusion incorporates a novel, highly efficient Patch-Volume Autoencoder that compresses medical images into latent space through patch-wise encoding. We show that 3D MedDiffusion surpasses state-of-the-art methods in generative quality and exhibits strong generalizability across tasks such as sparse-view CT reconstruction, fast MRI reconstruction, and data augmentation.
  arXiv  Detail & Related papers  (2024-12-17T16:25:40Z)
• MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
  We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data. Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging. We propose a versatile framework for reconstructing 3D motion from such partial data.
  arXiv  Detail & Related papers  (2024-12-03T17:18:33Z)
• Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration [50.602074919305636]
  This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg. We use epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features.
  arXiv  Detail & Related papers  (2024-06-20T17:47:30Z)
• 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning [79.60829508459753]
  Current commercial Digital Subtraction Angiography (DSA) systems typically demand hundreds of scanning views to perform reconstruction. The dynamic blood flow and insufficient input of sparse-view DSA images present significant challenges to the 3D vessel reconstruction task. We propose to use a time-agnostic vessel probability field to solve this problem effectively.
  arXiv  Detail & Related papers  (2024-05-17T11:23:33Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• Continuous 3D Myocardial Motion Tracking via Echocardiography [30.19879953016694]
  Myocardial motion tracking is an essential clinical tool in the prevention and detection of cardiovascular diseases. Current techniques suffer from incomplete and inaccurate motion estimation of the myocardium in both spatial and temporal dimensions. This paper introduces the Neural Cardiac Motion Field (NeuralCMF) to model the 3D structure and the comprehensive 6D forward/backward motion of the heart.
  arXiv  Detail & Related papers  (2023-10-04T13:11:20Z)
• MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View Cardiac MRI [11.685829837689404]
  We propose a novel multi-view motion estimation network (MulViMotion) to learn a consistent 3D motion field of the heart. We extensively evaluate the proposed method on 2D cine CMR images from 580 subjects of the UK Biobank study for 3D motion tracking of the left ventricular myocardium.
  arXiv  Detail & Related papers  (2022-07-29T18:29:52Z)
• Efficient Pix2Vox++ for 3D Cardiac Reconstruction from 2D echo views [0.6524460254566904]
  Reconstructing cardiac anatomy in 3D can enable discovery of new biomarkers. Most ultrasound systems only have 2D imaging capabilities. We propose a pipeline to perform reconstruction of 3D anatomy from 2D standard cardiac views.
  arXiv  Detail & Related papers  (2022-07-27T10:05:46Z)
• DeepRecon: Joint 2D Cardiac Segmentation and 3D Volume Reconstruction via A Structure-Specific Generative Method [12.26150675728958]
  We propose an end-to-end latent-space-based framework, DeepRecon, that generates multiple clinically essential outcomes. Our method identifies the optimal latent representation of the cine image that contains accurate semantic information for cardiac structures. In particular, our model jointly generates synthetic images with accurate semantic information and segmentation of the cardiac structures.
  arXiv  Detail & Related papers  (2022-06-14T20:46:11Z)
• CNN-based Cardiac Motion Extraction to Generate Deformable Geometric Left Ventricle Myocardial Models from Cine MRI [0.0]
  We propose a framework for the development of patient-specific geometric models of LV myocardium from cine cardiac MR images. We use the VoxelMorph-based convolutional neural network (CNN) to propagate the isosurface mesh and volume mesh of the end-diastole frame to the subsequent frames of the cardiac cycle.
  arXiv  Detail & Related papers  (2021-03-30T21:34:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.