Leveraging Unsupervised Image Registration for Discovery of Landmark Shape Descriptor

• URL: http://arxiv.org/abs/2111.07009v1
• Date: Sat, 13 Nov 2021 01:02:10 GMT
• Title: Leveraging Unsupervised Image Registration for Discovery of Landmark Shape Descriptor
• Authors: Riddhish Bhalodia, Shireen Elhabian, Ladislav Kavan, Ross Whitaker
• Abstract summary: This paper proposes a self-supervised deep learning approach for discovering landmarks from images that can directly be used as a shape descriptor for subsequent analysis. We use landmark-driven image registration as the primary task to force the neural network to discover landmarks that register the images well. The proposed method circumvents segmentation and preprocessing and directly produces a usable shape descriptor using just 2D or 3D images.
• Score: 5.40076482533193
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In current biological and medical research, statistical shape modeling (SSM) provides an essential framework for the characterization of anatomy/morphology. Such analysis is often driven by the identification of a relatively small number of geometrically consistent features found across the samples of a population. These features can subsequently provide information about the population shape variation. Dense correspondence models can provide ease of computation and yield an interpretable low-dimensional shape descriptor when followed by dimensionality reduction. However, automatic methods for obtaining such correspondences usually require image segmentation followed by significant preprocessing, which is taxing in terms of both computation as well as human resources. In many cases, the segmentation and subsequent processing require manual guidance and anatomy specific domain expertise. This paper proposes a self-supervised deep learning approach for discovering landmarks from images that can directly be used as a shape descriptor for subsequent analysis. We use landmark-driven image registration as the primary task to force the neural network to discover landmarks that register the images well. We also propose a regularization term that allows for robust optimization of the neural network and ensures that the landmarks uniformly span the image domain. The proposed method circumvents segmentation and preprocessing and directly produces a usable shape descriptor using just 2D or 3D images. In addition, we also propose two variants on the training loss function that allows for prior shape information to be integrated into the model. We apply this framework on several 2D and 3D datasets to obtain their shape descriptors, and analyze their utility for various applications.

Related papers

• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• Prediction of Geometric Transformation on Cardiac MRI via Convolutional Neural Network [13.01021780124613]
  We propose to learn features in medical images by training ConvNets to recognize the geometric transformation applied to images. We present a simple self-supervised task that can easily predict the geometric transformation.
  arXiv  Detail & Related papers  (2022-11-12T11:29:14Z)
• Geo-SIC: Learning Deformable Geometric Shapes in Deep Image Classifiers [8.781861951759948]
  This paper presents Geo-SIC, the first deep learning model to learn deformable shapes in a deformation space for an improved performance of image classification. We introduce a newly designed framework that (i) simultaneously derives features from both image and latent shape spaces with large intra-class variations. We develop a boosted classification network, equipped with an unsupervised learning of geometric shape representations.
  arXiv  Detail & Related papers  (2022-10-25T01:55:17Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• A singular Riemannian geometry approach to Deep Neural Networks II. Reconstruction of 1-D equivalence classes [78.120734120667]
  We build the preimage of a point in the output manifold in the input space. We focus for simplicity on the case of neural networks maps from n-dimensional real spaces to (n - 1)-dimensional real spaces.
  arXiv  Detail & Related papers  (2021-12-17T11:47:45Z)
• DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models [4.608133071225539]
  Statistical shape modeling (SSM) characterizes anatomical variations in a population of shapes generated from medical images. DeepSSM aims to provide a blueprint for deep learning-based image-to-shape models.
  arXiv  Detail & Related papers  (2021-10-14T04:52:37Z)
• Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation [51.916106055115755]
  We propose a new CNN architecture that is pose and scale invariant thanks to the use of Spatial Transformer Network (STN) Our architecture is composed of three sequential modules that are estimated together during training. We test the proposed method in kidney and renal tumor segmentation on abdominal pediatric CT scanners.
  arXiv  Detail & Related papers  (2021-07-06T14:50:03Z)
• TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
  We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes. We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
  arXiv  Detail & Related papers  (2020-12-26T08:02:56Z)
• Category Level Object Pose Estimation via Neural Analysis-by-Synthesis [64.14028598360741]
  In this paper we combine a gradient-based fitting procedure with a parametric neural image synthesis module. The image synthesis network is designed to efficiently span the pose configuration space. We experimentally show that the method can recover orientation of objects with high accuracy from 2D images alone.
  arXiv  Detail & Related papers  (2020-08-18T20:30:47Z)
• Self-Supervised Discovery of Anatomical Shape Landmarks [5.693003993674883]
  We propose a self-supervised, neural network approach for automatically positioning and detecting landmarks in images that can be used for subsequent analysis. We present a complete framework, which only takes a set of input images and produces landmarks that are immediately usable for statistical shape analysis.
  arXiv  Detail & Related papers  (2020-06-13T00:56:33Z)
• Flexible Bayesian Modelling for Nonlinear Image Registration [0.3914676152740142]
  We describe a diffeomorphic registration algorithm that allows groups of images to be accurately aligned to a common space. The idea is to perform inference in a probabilistic graphical model that accounts for variability in both shape and appearance. The model is evaluated at inter-subject registration of 3D human brain scans.
  arXiv  Detail & Related papers  (2020-06-03T15:33:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.