PC-U Net: Learning to Jointly Reconstruct and Segment the Cardiac Walls
in 3D from CT Data
- URL: http://arxiv.org/abs/2008.08194v1
- Date: Tue, 18 Aug 2020 23:37:05 GMT
- Title: PC-U Net: Learning to Jointly Reconstruct and Segment the Cardiac Walls
in 3D from CT Data
- Authors: Meng Ye, Qiaoying Huang, Dong Yang, Pengxiang Wu, Jingru Yi, Leon
Axel, Dimitris Metaxas
- Abstract summary: We propose a PC-U net that jointly reconstructs the point cloud of the LV MYO wall directly from volumes of 2D CT slices.
The proposed joint learning framework of our PC-U net is beneficial for automatic cardiac image analysis tasks.
- Score: 18.941064150226236
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The 3D volumetric shape of the heart's left ventricle (LV) myocardium (MYO)
wall provides important information for diagnosis of cardiac disease and
invasive procedure navigation. Many cardiac image segmentation methods have
relied on detection of region-of-interest as a pre-requisite for shape
segmentation and modeling. With segmentation results, a 3D surface mesh and a
corresponding point cloud of the segmented cardiac volume can be reconstructed
for further analyses. Although state-of-the-art methods (e.g., U-Net) have
achieved decent performance on cardiac image segmentation in terms of accuracy,
these segmentation results can still suffer from imaging artifacts and noise,
which will lead to inaccurate shape modeling results. In this paper, we propose
a PC-U net that jointly reconstructs the point cloud of the LV MYO wall
directly from volumes of 2D CT slices and generates its segmentation masks from
the predicted 3D point cloud. Extensive experimental results show that by
incorporating a shape prior from the point cloud, the segmentation masks are
more accurate than the state-of-the-art U-Net results in terms of Dice's
coefficient and Hausdorff distance.The proposed joint learning framework of our
PC-U net is beneficial for automatic cardiac image analysis tasks because it
can obtain simultaneously the 3D shape and segmentation of the LV MYO walls.
Related papers
- Deep Conditional Shape Models for 3D cardiac image segmentation [1.4042211166197214]
We introduce a novel segmentation algorithm that uses Deep Shape models (DCSMs) Conditional as a core component.
To fit the generated shape to the image, the shape model is conditioned on anatomic landmarks that can be automatically detected or provided by the user.
We demonstrate that the automatic DCSM outperforms the baseline for non-contrasted CT without the local refinement, and with the refinement for contrasted CT and 3DE, especially with significant improvement in the Hausdorff distance.
arXiv Detail & Related papers (2023-10-16T18:38:26Z) - DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning [13.289561121562057]
3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases.
In this work, we model the heart as a 3D mesh consisting of epi- and endocardial surfaces.
We propose a novel learning framework, DeepMesh, which propagates a template heart mesh to a subject space and estimates the 3D motion of the heart mesh from CMR images for individual subjects.
arXiv Detail & Related papers (2023-09-25T17:24:18Z) - Modeling 3D cardiac contraction and relaxation with point cloud
deformation networks [4.65840670565844]
We propose the Point Cloud Deformation Network (PCD-Net) as a novel geometric deep learning approach to model 3D cardiac contraction and relaxation.
We evaluate our approach on a large dataset of over 10,000 cases from the UK Biobank study.
arXiv Detail & Related papers (2023-07-20T14:56:29Z) - Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via
Volumetric Pseudo-Labeling [66.75096111651062]
We created a large-scale dataset of 10,021 thoracic CTs with 157 labels.
We applied an ensemble of 3D anatomy segmentation models to extract anatomical pseudo-labels.
Our resulting segmentation models demonstrated remarkable performance on CXR.
arXiv Detail & Related papers (2023-06-06T18:01:08Z) - Deep learning network to correct axial and coronal eye motion in 3D OCT
retinal imaging [65.47834983591957]
We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan.
The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
arXiv Detail & Related papers (2023-05-27T03:55:19Z) - Pulmonary Vessel Segmentation based on Orthogonal Fused U-Net++ of Chest
CT Images [1.8692254863855962]
We present an effective framework and refinement process of pulmonary vessel segmentation from chest computed tomographic (CT) images.
The key to our approach is a 2.5D segmentation network applied from three axes, which presents a robust and fully automated pulmonary vessel segmentation result.
Our method outperforms other network structures by a large margin and achieves by far the highest average DICE score of 0.9272 and precision of 0.9310.
arXiv Detail & Related papers (2021-07-03T21:46:29Z) - Cardiac Segmentation on CT Images through Shape-Aware Contour Attentions [1.212901554957637]
The cardiac organ consists of multiple substructures, i.e., ventricles, atriums, aortas, arteries, veins, and myocardium.
These cardiac substructures are proximate to each other and have indiscernible boundaries.
We introduce a novel model to exploit shape and boundary-aware features.
arXiv Detail & Related papers (2021-05-27T13:54:59Z) - Weakly-supervised Learning For Catheter Segmentation in 3D Frustum
Ultrasound [74.22397862400177]
We propose a novel Frustum ultrasound based catheter segmentation method.
The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
arXiv Detail & Related papers (2020-10-19T13:56:22Z) - Rethinking the Extraction and Interaction of Multi-Scale Features for
Vessel Segmentation [53.187152856583396]
We propose a novel deep learning model called PC-Net to segment retinal vessels and major arteries in 2D fundus image and 3D computed tomography angiography (CTA) scans.
In PC-Net, the pyramid squeeze-and-excitation (PSE) module introduces spatial information to each convolutional block, boosting its ability to extract more effective multi-scale features.
arXiv Detail & Related papers (2020-10-09T08:22:54Z) - Deep Negative Volume Segmentation [60.44793799306154]
We propose a new angle to the 3D segmentation task: segment empty spaces between all the tissues surrounding the object.
Our approach is an end-to-end pipeline that comprises a V-Net for bone segmentation.
We validate the idea on the CT scans in a 50-patient dataset, annotated by experts in maxillofacial medicine.
arXiv Detail & Related papers (2020-06-22T16:55:23Z) - HEMlets PoSh: Learning Part-Centric Heatmap Triplets for 3D Human Pose
and Shape Estimation [60.35776484235304]
This work attempts to address the uncertainty of lifting the detected 2D joints to the 3D space by introducing an intermediate state-Part-Centric Heatmap Triplets (HEMlets)
The HEMlets utilize three joint-heatmaps to represent the relative depth information of the end-joints for each skeletal body part.
A Convolutional Network (ConvNet) is first trained to predict HEMlets from the input image, followed by a volumetric joint-heatmap regression.
arXiv Detail & Related papers (2020-03-10T04:03:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.