Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud

• URL: http://arxiv.org/abs/2305.14486v2
• Date: Wed, 24 Jan 2024 20:41:54 GMT
• Title: Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud
• Authors: Jadie Adams and Shireen Elhabian
• Abstract summary: We present Point2SSM, a novel unsupervised learning approach for constructing correspondence-based statistical shape models (SSMs) directly from raw point clouds. SSM is crucial in clinical research, enabling population-level analysis of morphological variation in bones and organs.
• Score: 5.874142059884521
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present Point2SSM, a novel unsupervised learning approach for constructing correspondence-based statistical shape models (SSMs) directly from raw point clouds. SSM is crucial in clinical research, enabling population-level analysis of morphological variation in bones and organs. Traditional methods of SSM construction have limitations, including the requirement of noise-free surface meshes or binary volumes, reliance on assumptions or templates, and prolonged inference times due to simultaneous optimization of the entire cohort. Point2SSM overcomes these barriers by providing a data-driven solution that infers SSMs directly from raw point clouds, reducing inference burdens and increasing applicability as point clouds are more easily acquired. While deep learning on 3D point clouds has seen success in unsupervised representation learning and shape correspondence, its application to anatomical SSM construction is largely unexplored. We conduct a benchmark of state-of-the-art point cloud deep networks on the SSM task, revealing their limited robustness to clinical challenges such as noisy, sparse, or incomplete input and limited training data. Point2SSM addresses these issues through an attention-based module, providing effective correspondence mappings from learned point features. Our results demonstrate that the proposed method significantly outperforms existing networks in terms of accurate surface sampling and correspondence, better capturing population-level statistics.

Related papers

• Point2SSM++: Self-Supervised Learning of Anatomical Shape Models from Point Clouds [4.972323953932128]
  Correspondence-based statistical shape modeling (SSM) stands as a powerful technology for morphometric analysis in clinical research. Point2SSM++ is a principled, self-supervised deep learning approach that learns correspondence points from point cloud representations of anatomical shapes. We present principled extensions of Point2SSM++ tailored for dynamictemporal and multi-anatomy scenarios.
  arXiv  Detail & Related papers  (2024-05-15T21:13:54Z)
• Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images [4.424170214926035]
  Correspondence-based statistical shape modeling (SSM) facilitates population-level morphometrics. Recent advancements in deep learning have streamlined this process in inference. We introduce a weakly supervised deep learning approach to predict SSM from images using point cloud supervision.
  arXiv  Detail & Related papers  (2024-05-15T20:47:59Z)
• Deep Learning-Based Point Cloud Registration: A Comprehensive Survey and Taxonomy [79.66031973540946]
  We present a comprehensive survey and taxonomy on deep learning-based point cloud registration (DL-PCR) For supervised DL-PCR methods, we organize the discussion based on key aspects, including the registration procedure. We classify them into correspondence-based and correspondence-free approaches, depending on whether they require explicit identification of point-to-point correspondences.
  arXiv  Detail & Related papers  (2024-04-22T02:05:15Z)
• Bidirectional Knowledge Reconfiguration for Lightweight Point Cloud Analysis [74.00441177577295]
  Point cloud analysis faces computational system overhead, limiting its application on mobile or edge devices. This paper explores feature distillation for lightweight point cloud models. We propose bidirectional knowledge reconfiguration to distill informative contextual knowledge from the teacher to the student.
  arXiv  Detail & Related papers  (2023-10-08T11:32:50Z)
• Can point cloud networks learn statistical shape models of anatomies? [0.0]
  We show that point cloud encoder-decoder-based completion networks can provide an untapped potential for Statistical Shape Modeling. Our work paves the way for further exploration of point cloud deep learning for SSM.
  arXiv  Detail & Related papers  (2023-05-09T17:01:17Z)
• Self-Supervised Learning for Point Clouds Data: A Survey [8.858165912687923]
  Self-Supervised Learning (SSL) is considered as an essential solution to solve the time-consuming and labor-intensive data labelling problems. This paper provides a comprehensive survey of recent advances on SSL for point clouds.
  arXiv  Detail & Related papers  (2023-05-09T08:47:09Z)
• S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondences [91.48841778012782]
  We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies. Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods. Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
  arXiv  Detail & Related papers  (2023-04-15T09:39:52Z)
• Spatiotemporal Self-supervised Learning for Point Clouds in the Wild [65.56679416475943]
  We introduce an SSL strategy that leverages positive pairs in both the spatial and temporal domain. We demonstrate the benefits of our approach via extensive experiments performed by self-supervised training on two large-scale LiDAR datasets.
  arXiv  Detail & Related papers  (2023-03-28T18:06:22Z)
• Semi-supervised Domain Adaptive Structure Learning [72.01544419893628]
  Semi-supervised domain adaptation (SSDA) is a challenging problem requiring methods to overcome both 1) overfitting towards poorly annotated data and 2) distribution shift across domains. We introduce an adaptive structure learning method to regularize the cooperation of SSL and DA.
  arXiv  Detail & Related papers  (2021-12-12T06:11:16Z)
• Deep Implicit Statistical Shape Models for 3D Medical Image Delineation [47.78425002879612]
  3D delineation of anatomical structures is a cardinal goal in medical imaging analysis. Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology. We present deep implicit statistical shape models (DISSMs), a new approach to delineation that marries the representation power of CNNs with the robustness of SSMs.
  arXiv  Detail & Related papers  (2021-04-07T01:15:06Z)
• SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization [52.20602782690776]
  It is expensive and tedious to obtain large scale paired sparse-canned point sets for training from real scanned sparse data. We propose a self-supervised point cloud upsampling network, named SPU-Net, to capture the inherent upsampling patterns of points lying on the underlying object surface. We conduct various experiments on both synthetic and real-scanned datasets, and the results demonstrate that we achieve comparable performance to the state-of-the-art supervised methods.
  arXiv  Detail & Related papers  (2020-12-08T14:14:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.