Self-supervised Landmark Learning with Deformation Reconstruction and Cross-subject Consistency Objectives

• URL: http://arxiv.org/abs/2308.04987v1
• Date: Wed, 9 Aug 2023 14:40:51 GMT
• Title: Self-supervised Landmark Learning with Deformation Reconstruction and Cross-subject Consistency Objectives
• Authors: Chun-Hung Chao and Marc Niethammer
• Abstract summary: We present a self-supervised approach to extract landmark points from a given registration model for the Point Distribution Model (PDM) We argue that data with complicated deformations can not easily be modeled with point-based registration when only a limited number of points is used to extract influential landmark points.
• Score: 19.607668635077502
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: A Point Distribution Model (PDM) is the basis of a Statistical Shape Model (SSM) that relies on a set of landmark points to represent a shape and characterize the shape variation. In this work, we present a self-supervised approach to extract landmark points from a given registration model for the PDMs. Based on the assumption that the landmarks are the points that have the most influence on registration, existing works learn a point-based registration model with a small number of points to estimate the landmark points that influence the deformation the most. However, such approaches assume that the deformation can be captured by point-based registration and quality landmarks can be learned solely with the deformation capturing objective. We argue that data with complicated deformations can not easily be modeled with point-based registration when only a limited number of points is used to extract influential landmark points. Further, landmark consistency is not assured in existing approaches In contrast, we propose to extract landmarks based on a given registration model, which is tailored for the target data, so we can obtain more accurate correspondences. Secondly, to establish the anatomical consistency of the predicted landmarks, we introduce a landmark discovery loss to explicitly encourage the model to predict the landmarks that are anatomically consistent across subjects. We conduct experiments on an osteoarthritis progression prediction task and show our method outperforms existing image-based and point-based approaches.

Related papers

• FM-OSD: Foundation Model-Enabled One-Shot Detection of Anatomical Landmarks [44.54301473673582]
  We propose the first foundation model-enabled one-shot landmark detection (FM-OSD) framework for accurate landmark detection in medical images. By using solely a single template image, our method demonstrates significant superiority over strong state-of-the-art one-shot landmark detection methods.
  arXiv  Detail & Related papers  (2024-07-07T15:37:02Z)
• Point Deformable Network with Enhanced Normal Embedding for Point Cloud Analysis [59.12922158979068]
  Recently-based methods have shown strong performance in point cloud analysis. Simple architectures are able to learn geometric features in local point groups yet fail to model long-range dependencies directly. We propose Point Deformable Network (PDNet) to capture long-range relations with strong representation ability.
  arXiv  Detail & Related papers  (2023-12-20T14:52:07Z)
• Exploiting Point-Wise Attention in 6D Object Pose Estimation Based on Bidirectional Prediction [22.894810893732416]
  The paper proposes a bidirectional correspondence prediction network with a point-wise attention-aware mechanism. Our key insight is that the correlations between each model point and scene point provide essential information for learning point-pair matches. Experimental results on the public datasets of LineMOD, YCB-Video, and Occ-LineMOD show that the proposed method achieves better performance than other state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-08-16T17:13:45Z)
• Watermarking for Out-of-distribution Detection [76.20630986010114]
  Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. We propose a general methodology named watermarking in this paper. We learn a unified pattern that is superimposed onto features of original data, and the model's detection capability is largely boosted after watermarking.
  arXiv  Detail & Related papers  (2022-10-27T06:12:32Z)
• Towards Self-Supervised Category-Level Object Pose and Size Estimation [121.28537953301951]
  This work presents a self-supervised framework for category-level object pose and size estimation from a single depth image. We leverage the geometric consistency residing in point clouds of the same shape for self-supervision.
  arXiv  Detail & Related papers  (2022-03-06T06:02:30Z)
• SASA: Semantics-Augmented Set Abstraction for Point-based 3D Object Detection [78.90102636266276]
  We propose a novel set abstraction method named Semantics-Augmented Set Abstraction (SASA) Based on the estimated point-wise foreground scores, we then propose a semantics-guided point sampling algorithm to help retain more important foreground points during down-sampling. In practice, SASA shows to be effective in identifying valuable points related to foreground objects and improving feature learning for point-based 3D detection.
  arXiv  Detail & Related papers  (2022-01-06T08:54:47Z)
• Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Clouds [36.49322708074682]
  This paper proposes a new method of geometry-aware self-training (GAST) for unsupervised domain adaptation of object point cloud classification. Specifically, this paper aims to learn a domain-shared representation of semantic categories, via two novel self-supervised geometric learning tasks as feature regularization. On the other hand, a diverse point distribution across datasets can be normalized with a novel curvature-aware distortion localization.
  arXiv  Detail & Related papers  (2021-08-20T13:29:11Z)
• Attention-based Vehicle Self-Localization with HD Feature Maps [13.368212933272238]
  We present a vehicle self-localization method using point-based deep neural networks. Our approach processes measurements and point features, i.e. landmarks, from a high-definition digital map to infer the vehicle's pose.
  arXiv  Detail & Related papers  (2021-07-16T09:25:25Z)
• Pretrained equivariant features improve unsupervised landmark discovery [69.02115180674885]
  We formulate a two-step unsupervised approach that overcomes this challenge by first learning powerful pixel-based features. Our method produces state-of-the-art results in several challenging landmark detection datasets.
  arXiv  Detail & Related papers  (2021-04-07T05:42:11Z)
• Point-Set Anchors for Object Detection, Instance Segmentation and Pose Estimation [85.96410825961966]
  We argue that the image features extracted at a central point contain limited information for predicting distant keypoints or bounding box boundaries. To facilitate inference, we propose to instead perform regression from a set of points placed at more advantageous positions. We apply this proposed framework, called Point-Set Anchors, to object detection, instance segmentation, and human pose estimation.
  arXiv  Detail & Related papers  (2020-07-06T15:59:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.