Learning Deep Features for Shape Correspondence with Domain Invariance

• URL: http://arxiv.org/abs/2102.10493v1
• Date: Sun, 21 Feb 2021 02:25:32 GMT
• Title: Learning Deep Features for Shape Correspondence with Domain Invariance
• Authors: Praful Agrawal, Ross T. Whitaker, Shireen Y. Elhabian
• Abstract summary: Correspondence-based shape models are key to various medical imaging applications that rely on a statistical analysis of anatomies. This paper proposes an automated feature learning approach, using deep convolutional neural networks to extract correspondence-friendly features from shape ensembles.
• Score: 10.230933226423984
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Correspondence-based shape models are key to various medical imaging applications that rely on a statistical analysis of anatomies. Such shape models are expected to represent consistent anatomical features across the population for population-specific shape statistics. Early approaches for correspondence placement rely on nearest neighbor search for simpler anatomies. Coordinate transformations for shape correspondence hold promise to address the increasing anatomical complexities. Nonetheless, due to the inherent shape-level geometric complexity and population-level shape variation, the coordinate-wise correspondence often does not translate to the anatomical correspondence. An alternative, group-wise approach for correspondence placement explicitly models the trade-off between geometric description and the population's statistical compactness. However, these models achieve limited success in resolving nonlinear shape correspondence. Recent works have addressed this limitation by adopting an application-specific notion of correspondence through lifting positional data to a higher dimensional feature space. However, they heavily rely on manual expertise to create domain-specific features and consistent landmarks. This paper proposes an automated feature learning approach, using deep convolutional neural networks to extract correspondence-friendly features from shape ensembles. Further, an unsupervised domain adaptation scheme is introduced to augment the pretrained geometric features with new anatomies. Results on anatomical datasets of human scapula, femur, and pelvis bones demonstrate that features learned in supervised fashion show improved performance for correspondence estimation compared to the manual features. Further, unsupervised learning is demonstrated to learn complex anatomy features using the supervised domain adaptation from features learned on simpler anatomy.

Related papers

• Second Order Kinematic Surface Fitting in Anatomical Structures [0.43512163406551996]
  We propose an innovative approach utilizing a second order velocity field for kinematic surface fitting. This advancement accommodates higher rotational shape complexity and improves the accuracy of symmetry detection in anatomical structures. Our method not only enables the detection of curved rotational symmetries (core lines) but also facilitates morphological classification by deriving intrinsic shape parameters related to curvature and torsion.
  arXiv  Detail & Related papers  (2024-01-29T10:36:43Z)
• ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction [59.971808117043366]
  ReShapeIT represents an anatomical structure with an implicit template field shared within the same category. It ensures the implicit template field generates valid templates by strengthening the constraint of the correspondence between the instance shape and the template shape. A template Interaction Module is introduced to reconstruct unseen shapes by interacting the valid template shapes with the instance-wise latent codes.
  arXiv  Detail & Related papers  (2023-12-11T07:09:32Z)
• Unsupervised correspondence with combined geometric learning and imaging for radiotherapy applications [0.0]
  The aim of this study was to develop a model to accurately identify corresponding points between organ segmentations of different patients for radiotherapy applications. A model for simultaneous correspondence and estimation in 3D shapes was trained with head and neck organ segmentations from planning CT scans. We then extended the original model to incorporate imaging information using two approaches.
  arXiv  Detail & Related papers  (2023-09-25T16:29:18Z)
• S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondences [91.48841778012782]
  We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies. Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods. Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
  arXiv  Detail & Related papers  (2023-04-15T09:39:52Z)
• Anatomy-guided domain adaptation for 3D in-bed human pose estimation [62.3463429269385]
  3D human pose estimation is a key component of clinical monitoring systems. We present a novel domain adaptation method, adapting a model from a labeled source to a shifted unlabeled target domain. Our method consistently outperforms various state-of-the-art domain adaptation methods.
  arXiv  Detail & Related papers  (2022-11-22T11:34:51Z)
• A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras [52.33206865588584]
  We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. We build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity.
  arXiv  Detail & Related papers  (2022-10-04T13:36:52Z)
• Statistical Shape Modeling of Biventricular Anatomy with Shared Boundaries [16.287876512923084]
  This paper presents a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries. Shape changes within these shared boundaries of the heart can indicate potential pathological changes that lead to uncoordinated contraction and poor end-organ perfusion.
  arXiv  Detail & Related papers  (2022-09-06T15:54:37Z)
• Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transport [80.64516377977183]
  Shape matching has been a long-studied problem for the computer graphics and vision community. We investigate a hierarchical learning design, to which we incorporate local patch-level information and global shape-level structures. We propose a novel optimal transport solver by recurrently updating features on non-confident nodes to learn globally consistent correspondences between the shapes.
  arXiv  Detail & Related papers  (2022-02-03T11:41:46Z)
• Learning Population-level Shape Statistics and Anatomy Segmentation From Images: A Joint Deep Learning Model [0.0]
  Point distribution models (PDMs) represent the anatomical surface via a dense set of correspondences. We propose a deep-learning-based framework that simultaneously learns these two coordinate spaces directly from the volumetric images. The proposed joint model serves a dual purpose; the world correspondences can directly be used for shape analysis applications, circumventing the heavy pre-processing and segmentation involved in traditional PDM models.
  arXiv  Detail & Related papers  (2022-01-10T17:24:35Z)
• NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go [109.88509362837475]
  We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes. NeuroMorph produces smooth and point-to-point correspondences between them. It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
  arXiv  Detail & Related papers  (2021-06-17T12:25:44Z)
• Discriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks [3.7814216736076434]
  We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task. Our framework is modular and consists of several computing blocks that perform fundamental shape processing tasks. We propose a discriminative model for disease classification and age regression, as well as a generative model for the accruate reconstruction of shapes.
  arXiv  Detail & Related papers  (2020-10-02T07:37:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.