Image2SSM: Reimagining Statistical Shape Models from Images with Radial Basis Functions

• URL: http://arxiv.org/abs/2305.11946v2
• Date: Fri, 29 Dec 2023 20:16:33 GMT
• Title: Image2SSM: Reimagining Statistical Shape Models from Images with Radial Basis Functions
• Authors: Hong Xu and Shireen Y. Elhabian
• Abstract summary: We propose Image2SSM, a novel deep-learning-based approach for statistical shape modeling. Image2SSM learns a radial-basis-function (RBF)-based representation of shapes directly from images. It can characterize populations of biological structures of interest by constructing statistical landmark-based shape models of ensembles of anatomical shapes.
• Score: 4.422330219605964
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Statistical shape modeling (SSM) is an essential tool for analyzing variations in anatomical morphology. In a typical SSM pipeline, 3D anatomical images, gone through segmentation and rigid registration, are represented using lower-dimensional shape features, on which statistical analysis can be performed. Various methods for constructing compact shape representations have been proposed, but they involve laborious and costly steps. We propose Image2SSM, a novel deep-learning-based approach for SSM that leverages image-segmentation pairs to learn a radial-basis-function (RBF)-based representation of shapes directly from images. This RBF-based shape representation offers a rich self-supervised signal for the network to estimate a continuous, yet compact representation of the underlying surface that can adapt to complex geometries in a data-driven manner. Image2SSM can characterize populations of biological structures of interest by constructing statistical landmark-based shape models of ensembles of anatomical shapes while requiring minimal parameter tuning and no user assistance. Once trained, Image2SSM can be used to infer low-dimensional shape representations from new unsegmented images, paving the way toward scalable approaches for SSM, especially when dealing with large cohorts. Experiments on synthetic and real datasets show the efficacy of the proposed method compared to the state-of-art correspondence-based method for SSM.

Related papers

• Efficient Visual State Space Model for Image Deblurring [83.57239834238035]
  Convolutional neural networks (CNNs) and Vision Transformers (ViTs) have achieved excellent performance in image restoration. We propose a simple yet effective visual state space model (EVSSM) for image deblurring.
  arXiv  Detail & Related papers  (2024-05-23T09:13:36Z)
• Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration [50.62725807357586]
  This article presents a general Bayesian learning framework for multi-modal groupwise image registration. We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables. Experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images.
  arXiv  Detail & Related papers  (2024-01-04T08:46:39Z)
• ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images [0.8192907805418583]
  This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.
  arXiv  Detail & Related papers  (2023-07-06T20:21:12Z)
• Mesh2SSM: From Surface Meshes to Statistical Shape Models of Anatomy [0.0]
  We propose Mesh2SSM, a new approach that leverages unsupervised, permutation-invariant representation learning to estimate how to deform a template point cloud to subject-specific meshes. Mesh2SSM can also learn a population-specific template, reducing any bias due to template selection.
  arXiv  Detail & Related papers  (2023-05-13T00:03:59Z)
• S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondences [91.48841778012782]
  We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies. Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods. Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
  arXiv  Detail & Related papers  (2023-04-15T09:39:52Z)
• Spatiotemporal Cardiac Statistical Shape Modeling: A Data-Driven Approach [0.0]
  Particle-based shape modeling (PSM) is a data-driven approach that captures population-level shape variations. This paper proposes a data-driven approach inspired by the PSM method to learn population-level temporal shape changes directly from shape data.
  arXiv  Detail & Related papers  (2022-09-06T18:00:45Z)
• Dynamic multi feature-class Gaussian process models [0.0]
  This study presents a statistical modelling method for automatic learning of shape, pose and intensity features in medical images. A DMFC-GPM is a Gaussian process (GP)-based model with a shared latent space that encodes linear and non-linear variation. The model performance results suggest that this new modelling paradigm is robust, accurate, accessible, and has potential applications.
  arXiv  Detail & Related papers  (2021-12-08T15:12:47Z)
• DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models [4.608133071225539]
  Statistical shape modeling (SSM) characterizes anatomical variations in a population of shapes generated from medical images. DeepSSM aims to provide a blueprint for deep learning-based image-to-shape models.
  arXiv  Detail & Related papers  (2021-10-14T04:52:37Z)
• PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstruction [67.08350202974434]
  We propose Parametric Model-Conditioned Implicit Representation (PaMIR), which combines the parametric body model with the free-form deep implicit function. We show that our method achieves state-of-the-art performance for image-based 3D human reconstruction in the cases of challenging poses and clothing types.
  arXiv  Detail & Related papers  (2020-07-08T02:26:19Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.