SCorP: Statistics-Informed Dense Correspondence Prediction Directly from Unsegmented Medical Images

• URL: http://arxiv.org/abs/2404.17967v2
• Date: Wed, 22 May 2024 05:38:44 GMT
• Title: SCorP: Statistics-Informed Dense Correspondence Prediction Directly from Unsegmented Medical Images
• Authors: Krithika Iyer, Jadie Adams, Shireen Y. Elhabian,
• Abstract summary: We introduce SCorP, a novel framework capable of predicting surface-based correspondences directly from unsegmented images. The proposed model streamlines the training and inference phases by removing the supervision for the correspondence prediction task.
• Score: 5.507868474642766
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Statistical shape modeling (SSM) is a powerful computational framework for quantifying and analyzing the geometric variability of anatomical structures, facilitating advancements in medical research, diagnostics, and treatment planning. Traditional methods for shape modeling from imaging data demand significant manual and computational resources. Additionally, these methods necessitate repeating the entire modeling pipeline to derive shape descriptors (e.g., surface-based point correspondences) for new data. While deep learning approaches have shown promise in streamlining the construction of SSMs on new data, they still rely on traditional techniques to supervise the training of the deep networks. Moreover, the predominant linearity assumption of traditional approaches restricts their efficacy, a limitation also inherited by deep learning models trained using optimized/established correspondences. Consequently, representing complex anatomies becomes challenging. To address these limitations, we introduce SCorP, a novel framework capable of predicting surface-based correspondences directly from unsegmented images. By leveraging the shape prior learned directly from surface meshes in an unsupervised manner, the proposed model eliminates the need for an optimized shape model for training supervision. The strong shape prior acts as a teacher and regularizes the feature learning of the student network to guide it in learning image-based features that are predictive of surface correspondences. The proposed model streamlines the training and inference phases by removing the supervision for the correspondence prediction task while alleviating the linearity assumption.

Related papers

• Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond [61.18736646013446]
  In pursuit of a deeper understanding of its surprising behaviors, we investigate the utility of a simple yet accurate model of a trained neural network. Across three case studies, we illustrate how it can be applied to derive new empirical insights on a diverse range of prominent phenomena.
  arXiv  Detail & Related papers  (2024-10-31T22:54:34Z)
• Transferable Post-training via Inverse Value Learning [83.75002867411263]
  We propose modeling changes at the logits level during post-training using a separate neural network (i.e., the value network) After training this network on a small base model using demonstrations, this network can be seamlessly integrated with other pre-trained models during inference. We demonstrate that the resulting value network has broad transferability across pre-trained models of different parameter sizes.
  arXiv  Detail & Related papers  (2024-10-28T13:48:43Z)
• Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images [4.424170214926035]
  Correspondence-based statistical shape modeling (SSM) facilitates population-level morphometrics. Recent advancements in deep learning have streamlined this process in inference. We introduce a weakly supervised deep learning approach to predict SSM from images using point cloud supervision.
  arXiv  Detail & Related papers  (2024-05-15T20:47:59Z)
• ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images [0.8192907805418583]
  This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.
  arXiv  Detail & Related papers  (2023-07-06T20:21:12Z)
• Towards a Better Theoretical Understanding of Independent Subnetwork Training [56.24689348875711]
  We take a closer theoretical look at Independent Subnetwork Training (IST) IST is a recently proposed and highly effective technique for solving the aforementioned problems. We identify fundamental differences between IST and alternative approaches, such as distributed methods with compressed communication.
  arXiv  Detail & Related papers  (2023-06-28T18:14:22Z)
• Mesh2SSM: From Surface Meshes to Statistical Shape Models of Anatomy [0.0]
  We propose Mesh2SSM, a new approach that leverages unsupervised, permutation-invariant representation learning to estimate how to deform a template point cloud to subject-specific meshes. Mesh2SSM can also learn a population-specific template, reducing any bias due to template selection.
  arXiv  Detail & Related papers  (2023-05-13T00:03:59Z)
• S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondences [91.48841778012782]
  We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies. Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods. Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
  arXiv  Detail & Related papers  (2023-04-15T09:39:52Z)
• From Images to Probabilistic Anatomical Shapes: A Deep Variational Bottleneck Approach [0.0]
  Statistical shape modeling (SSM) directly from 3D medical images is an underutilized tool for detecting pathology, diagnosing disease, and conducting population-level morphology analysis. In this paper, we propose a principled framework based on the variational information bottleneck theory to relax these assumptions. Our experiments demonstrate that the proposed method provides improved accuracy and better calibrated aleatoric uncertainty estimates.
  arXiv  Detail & Related papers  (2022-05-13T19:39:08Z)
• An explainability framework for cortical surface-based deep learning [110.83289076967895]
  We develop a framework for cortical surface-based deep learning. First, we adapted a perturbation-based approach for use with surface data. We show that our explainability framework is not only able to identify important features and their spatial location but that it is also reliable and valid.
  arXiv  Detail & Related papers  (2022-03-15T23:16:49Z)
• DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models [4.608133071225539]
  Statistical shape modeling (SSM) characterizes anatomical variations in a population of shapes generated from medical images. DeepSSM aims to provide a blueprint for deep learning-based image-to-shape models.
  arXiv  Detail & Related papers  (2021-10-14T04:52:37Z)
• Multi-Branch Deep Radial Basis Function Networks for Facial Emotion Recognition [80.35852245488043]
  We propose a CNN based architecture enhanced with multiple branches formed by radial basis function (RBF) units. RBF units capture local patterns shared by similar instances using an intermediate representation. We show it is the incorporation of local information what makes the proposed model competitive.
  arXiv  Detail & Related papers  (2021-09-07T21:05:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.