Implicit Shape Modeling for Anatomical Structure Refinement of
Volumetric Medical Images
- URL: http://arxiv.org/abs/2312.06164v2
- Date: Sat, 6 Jan 2024 13:35:07 GMT
- Title: Implicit Shape Modeling for Anatomical Structure Refinement of
Volumetric Medical Images
- Authors: Minghui Zhang, Hanxiao Zhang, Xin You, Guang-Zhong Yang, Yun Gu
- Abstract summary: We propose a unified framework for 3D shape modelling and segmentation refinement based on implicit neural networks.
For improved shape representation, implicit shape constraints are used for both instances and latent templates.
Experiments on validation datasets involving liver, pancreas and lung segmentation demonstrate the superiority of our approach.
- Score: 29.894934602946567
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Shape modeling of volumetric data is essential for medical image analysis and
computer-aided intervention. In practice, automated shape reconstruction cannot
always achieve satisfactory results due to limited image resolution and a lack
of sufficiently detailed shape priors used as constraints. In this paper, a
unified framework is proposed for 3D shape modelling and segmentation
refinement based on implicit neural networks. To learn a sharable shape prior
from different instances within the same category during training, physical
details of volumetric data are firstly used to construct Physical-Informed
Continuous Coordinate Transform (PICCT) for implicit shape modeling. For
improved shape representation, implicit shape constraints based on Signed
Distance Function (SDF) are used for both instances and latent templates. For
inference, a Template Interaction Module (TIM) is proposed to refine 3D shapes
produced by Convolutional Neural Networks (CNNs) via deforming deep implicit
templates with latent codes. Experimental results on validation datasets
involving liver, pancreas and lung segmentation demonstrate the superiority of
our approach in shape refinement and reconstruction. The Chamfer Distance/Earth
Mover's Distance achieved by the proposed method are 0.232/0.087 for the Liver
dataset, 0.128/0.069 for the Pancreas dataset, and 0.417/0.100 for the Lung
Lobe dataset, respectively.
Related papers
- An End-to-End Deep Learning Generative Framework for Refinable Shape
Matching and Generation [45.820901263103806]
Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs)
We develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space.
We extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability.
arXiv Detail & Related papers (2024-03-10T21:33:53Z) - On the Localization of Ultrasound Image Slices within Point Distribution
Models [84.27083443424408]
Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US)
Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology.
We present a framework for automated US image slice localization within a 3D shape representation.
arXiv Detail & Related papers (2023-09-01T10:10:46Z) - Landmark-free Statistical Shape Modeling via Neural Flow Deformations [0.5897108307012394]
We present FlowSSM, a novel shape modeling approach that learns shape variability without requiring dense correspondence between training instances.
Our model outperforms state-of-the-art methods in providing an expressive and robust shape prior for distal femur and liver.
arXiv Detail & Related papers (2022-09-14T18:17:19Z) - From Images to Probabilistic Anatomical Shapes: A Deep Variational
Bottleneck Approach [0.0]
Statistical shape modeling (SSM) directly from 3D medical images is an underutilized tool for detecting pathology, diagnosing disease, and conducting population-level morphology analysis.
In this paper, we propose a principled framework based on the variational information bottleneck theory to relax these assumptions.
Our experiments demonstrate that the proposed method provides improved accuracy and better calibrated aleatoric uncertainty estimates.
arXiv Detail & Related papers (2022-05-13T19:39:08Z) - Topology-Preserving Shape Reconstruction and Registration via Neural
Diffeomorphic Flow [22.1959666473906]
Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets.
We propose a new model called Neural Diffeomorphic Flow (NDF) to learn deep implicit shape templates.
NDF achieves consistently state-of-the-art organ shape reconstruction and registration results in both accuracy and quality.
arXiv Detail & Related papers (2022-03-16T14:39:11Z) - DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models [4.608133071225539]
Statistical shape modeling (SSM) characterizes anatomical variations in a population of shapes generated from medical images.
DeepSSM aims to provide a blueprint for deep learning-based image-to-shape models.
arXiv Detail & Related papers (2021-10-14T04:52:37Z) - A Self-Supervised Deep Framework for Reference Bony Shape Estimation in
Orthognathic Surgical Planning [55.30223654196882]
A virtual orthognathic surgical planning involves simulating surgical corrections of jaw deformities on 3D facial bony shape models.
A reference facial bony shape model representing normal anatomies can provide an objective guidance to improve planning accuracy.
We propose a self-supervised deep framework to automatically estimate reference facial bony shape models.
arXiv Detail & Related papers (2021-09-11T05:24:40Z) - Category Level Object Pose Estimation via Neural Analysis-by-Synthesis [64.14028598360741]
In this paper we combine a gradient-based fitting procedure with a parametric neural image synthesis module.
The image synthesis network is designed to efficiently span the pose configuration space.
We experimentally show that the method can recover orientation of objects with high accuracy from 2D images alone.
arXiv Detail & Related papers (2020-08-18T20:30:47Z) - Shape Prior Deformation for Categorical 6D Object Pose and Size
Estimation [62.618227434286]
We present a novel learning approach to recover the 6D poses and sizes of unseen object instances from an RGB-D image.
We propose a deep network to reconstruct the 3D object model by explicitly modeling the deformation from a pre-learned categorical shape prior.
arXiv Detail & Related papers (2020-07-16T16:45:05Z) - Monocular Human Pose and Shape Reconstruction using Part Differentiable
Rendering [53.16864661460889]
Recent works succeed in regression-based methods which estimate parametric models directly through a deep neural network supervised by 3D ground truth.
In this paper, we introduce body segmentation as critical supervision.
To improve the reconstruction with part segmentation, we propose a part-level differentiable part that enables part-based models to be supervised by part segmentation.
arXiv Detail & Related papers (2020-03-24T14:25:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.