Skeletal Point Representations with Geometric Deep Learning

• URL: http://arxiv.org/abs/2303.02123v1
• Date: Fri, 3 Mar 2023 18:08:12 GMT
• Title: Skeletal Point Representations with Geometric Deep Learning
• Authors: Ninad Khargonkar, Beatriz Paniagua, Jared Vicory
• Abstract summary: We propose novel geometric terms for calculating skeletal structures of objects. Results are similar to traditional fitted s-reps but are produced much more quickly.
• Score: 0.6696732597888386
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Skeletonization has been a popular shape analysis technique that models both the interior and exterior of an object. Existing template-based calculations of skeletal models from anatomical structures are a time-consuming manual process. Recently, learning-based methods have been used to extract skeletons from 3D shapes. In this work, we propose novel additional geometric terms for calculating skeletal structures of objects. The results are similar to traditional fitted s-reps but but are produced much more quickly. Evaluation on real clinical data shows that the learned model predicts accurate skeletal representations and shows the impact of proposed geometric losses along with using s-reps as weak supervision.

Related papers

• Fitting Skeletal Models via Graph-based Learning [3.059114987144684]
  We propose a new skeletonization method which leverages graph convolutional networks to produce skeletal representations (s-reps) from dense segmentation masks. The method is evaluated on both synthetic data and real hippocampus segmentations, achieving promising results and fast inference.
  arXiv  Detail & Related papers  (2024-09-09T03:50:41Z)
• Deep Medial Voxels: Learned Medial Axis Approximations for Anatomical Shape Modeling [5.584193645582203]
  We introduce deep medial voxels, a semi-implicit representation that faithfully approximates the topological skeleton from imaging volumes. Our reconstruction technique shows potential for both visualization and computer simulations.
  arXiv  Detail & Related papers  (2024-03-18T13:47:18Z)
• An End-to-End Deep Learning Generative Framework for Refinable Shape Matching and Generation [45.820901263103806]
  Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs) We develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space. We extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability.
  arXiv  Detail & Related papers  (2024-03-10T21:33:53Z)
• ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction [59.971808117043366]
  ReShapeIT represents an anatomical structure with an implicit template field shared within the same category. It ensures the implicit template field generates valid templates by strengthening the constraint of the correspondence between the instance shape and the template shape. A template Interaction Module is introduced to reconstruct unseen shapes by interacting the valid template shapes with the instance-wise latent codes.
  arXiv  Detail & Related papers  (2023-12-11T07:09:32Z)
• TailorMe: Self-Supervised Learning of an Anatomically Constrained Volumetric Human Shape Model [4.474107938692397]
  Human shape spaces have been extensively studied, as they are a core element of human shape and pose inference tasks. We create an anatomical template, consisting of skeleton bones and soft tissue, to the surface scans of the CAESAR database. This data is then used to learn an anthropo constrained volumetric human shape model in a self-supervised fashion.
  arXiv  Detail & Related papers  (2023-11-03T07:42:19Z)
• Hierarchical Skeleton Meta-Prototype Contrastive Learning with Hard Skeleton Mining for Unsupervised Person Re-Identification [70.90142717649785]
  This paper proposes a generic unsupervised Hierarchical skeleton Meta-Prototype Contrastive learning (Hi-MPC) approach with Hard Skeleton Mining (HSM) for person re-ID with unlabeled 3D skeletons. By converting original prototypes into meta-prototypes with multiple homogeneous transformations, we induce the model to learn the inherent consistency of prototypes to capture more effective skeleton features for person re-ID.
  arXiv  Detail & Related papers  (2023-07-24T16:18:22Z)
• SkeletonMAE: Graph-based Masked Autoencoder for Skeleton Sequence Pre-training [110.55093254677638]
  We propose an efficient skeleton sequence learning framework, named Skeleton Sequence Learning (SSL) In this paper, we build an asymmetric graph-based encoder-decoder pre-training architecture named SkeletonMAE. Our SSL generalizes well across different datasets and outperforms the state-of-the-art self-supervised skeleton-based action recognition methods.
  arXiv  Detail & Related papers  (2023-07-17T13:33:11Z)
• A Self-Supervised Deep Framework for Reference Bony Shape Estimation in Orthognathic Surgical Planning [55.30223654196882]
  A virtual orthognathic surgical planning involves simulating surgical corrections of jaw deformities on 3D facial bony shape models. A reference facial bony shape model representing normal anatomies can provide an objective guidance to improve planning accuracy. We propose a self-supervised deep framework to automatically estimate reference facial bony shape models.
  arXiv  Detail & Related papers  (2021-09-11T05:24:40Z)
• Point2Skeleton: Learning Skeletal Representations from Point Clouds [36.62519847312199]
  We introduce Point2Skeleton, an unsupervised method to learn skeletal representations from point clouds. We first predict a set of skeletal points by learning a geometric transformation, and then analyze the connectivity of the skeletal points to form skeletal mesh structures.
  arXiv  Detail & Related papers  (2020-12-01T03:04:09Z)
• SkeletonNet: A Topology-Preserving Solution for Learning Mesh Reconstruction of Object Surfaces from RGB Images [85.66560542483286]
  This paper focuses on the challenging task of learning 3D object surface reconstructions from RGB images. We propose two models, the Skeleton-Based GraphConvolutional Neural Network (SkeGCNN) and the Skeleton-Regularized Deep Implicit Surface Network (SkeDISN) We conduct thorough experiments that verify the efficacy of our proposed SkeletonNet.
  arXiv  Detail & Related papers  (2020-08-13T07:59:25Z)
• Monocular Human Pose and Shape Reconstruction using Part Differentiable Rendering [53.16864661460889]
  Recent works succeed in regression-based methods which estimate parametric models directly through a deep neural network supervised by 3D ground truth. In this paper, we introduce body segmentation as critical supervision. To improve the reconstruction with part segmentation, we propose a part-level differentiable part that enables part-based models to be supervised by part segmentation.
  arXiv  Detail & Related papers  (2020-03-24T14:25:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.