Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images

• URL: http://arxiv.org/abs/2405.09697v1
• Date: Wed, 15 May 2024 20:47:59 GMT
• Title: Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images
• Authors: Jadie Adams, Krithika Iyer, Shireen Elhabian,
• Abstract summary: Correspondence-based statistical shape modeling (SSM) facilitates population-level morphometrics. Recent advancements in deep learning have streamlined this process in inference. We introduce a weakly supervised deep learning approach to predict SSM from images using point cloud supervision.
• Score: 4.424170214926035
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Anatomical shape analysis plays a pivotal role in clinical research and hypothesis testing, where the relationship between form and function is paramount. Correspondence-based statistical shape modeling (SSM) facilitates population-level morphometrics but requires a cumbersome, potentially bias-inducing construction pipeline. Recent advancements in deep learning have streamlined this process in inference by providing SSM prediction directly from unsegmented medical images. However, the proposed approaches are fully supervised and require utilizing a traditional SSM construction pipeline to create training data, thus inheriting the associated burdens and limitations. To address these challenges, we introduce a weakly supervised deep learning approach to predict SSM from images using point cloud supervision. Specifically, we propose reducing the supervision associated with the state-of-the-art fully Bayesian variational information bottleneck DeepSSM (BVIB-DeepSSM) model. BVIB-DeepSSM is an effective, principled framework for predicting probabilistic anatomical shapes from images with quantification of both aleatoric and epistemic uncertainties. Whereas the original BVIB-DeepSSM method requires strong supervision in the form of ground truth correspondence points, the proposed approach utilizes weak supervision via point cloud surface representations, which are more readily obtainable. Furthermore, the proposed approach learns correspondence in a completely data-driven manner without prior assumptions about the expected variability in shape cohort. Our experiments demonstrate that this approach yields similar accuracy and uncertainty estimation to the fully supervised scenario while substantially enhancing the feasibility of model training for SSM construction.

Related papers

• Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction [88.65168366064061]
  We introduce Discrete Denoising Posterior Prediction (DDPP), a novel framework that casts the task of steering pre-trained MDMs as a problem of probabilistic inference. Our framework leads to a family of three novel objectives that are all simulation-free, and thus scalable. We substantiate our designs via wet-lab validation, where we observe transient expression of reward-optimized protein sequences.
  arXiv  Detail & Related papers  (2024-10-10T17:18:30Z)
• Probabilistic 3D Correspondence Prediction from Sparse Unsegmented Images [1.2179682412409507]
  We propose SPI-CorrNet, a unified model that predicts 3D correspondences from sparse imaging data. Experiments on the LGE MRI left atrium dataset and Abdomen CT-1K liver datasets demonstrate that our technique enhances the accuracy and robustness of sparse image-driven SSM.
  arXiv  Detail & Related papers  (2024-07-02T03:56:20Z)
• SCorP: Statistics-Informed Dense Correspondence Prediction Directly from Unsegmented Medical Images [5.507868474642766]
  We introduce SCorP, a novel framework capable of predicting surface-based correspondences directly from unsegmented images. The proposed model streamlines the training and inference phases by removing the supervision for the correspondence prediction task.
  arXiv  Detail & Related papers  (2024-04-27T17:56:58Z)
• Seeing Unseen: Discover Novel Biomedical Concepts via Geometry-Constrained Probabilistic Modeling [53.7117640028211]
  We present a geometry-constrained probabilistic modeling treatment to resolve the identified issues. We incorporate a suite of critical geometric properties to impose proper constraints on the layout of constructed embedding space. A spectral graph-theoretic method is devised to estimate the number of potential novel classes.
  arXiv  Detail & Related papers  (2024-03-02T00:56:05Z)
• Fully Bayesian VIB-DeepSSM [0.0]
  Statistical shape modeling (SSM) enables quantitative analysis of anatomical shapes, informing clinical diagnosis. DeepSSM is an effective, principled framework for predicting probabilistic shapes of anatomy from images with aleatoric uncertainty quantification. We derive a fully Bayesian VIB formulation and demonstrate the efficacy of two scalable implementation approaches. Experiments on synthetic shapes and left atrium data demonstrate that the fully Bayesian VIB network predicts SSM from images with improved uncertainty reasoning without sacrificing accuracy.
  arXiv  Detail & Related papers  (2023-05-09T23:01:05Z)
• S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondences [91.48841778012782]
  We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies. Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods. Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
  arXiv  Detail & Related papers  (2023-04-15T09:39:52Z)
• From Images to Probabilistic Anatomical Shapes: A Deep Variational Bottleneck Approach [0.0]
  Statistical shape modeling (SSM) directly from 3D medical images is an underutilized tool for detecting pathology, diagnosing disease, and conducting population-level morphology analysis. In this paper, we propose a principled framework based on the variational information bottleneck theory to relax these assumptions. Our experiments demonstrate that the proposed method provides improved accuracy and better calibrated aleatoric uncertainty estimates.
  arXiv  Detail & Related papers  (2022-05-13T19:39:08Z)
• Deep Implicit Statistical Shape Models for 3D Medical Image Delineation [47.78425002879612]
  3D delineation of anatomical structures is a cardinal goal in medical imaging analysis. Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology. We present deep implicit statistical shape models (DISSMs), a new approach to delineation that marries the representation power of CNNs with the robustness of SSMs.
  arXiv  Detail & Related papers  (2021-04-07T01:15:06Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)
• Uncertain-DeepSSM: From Images to Probabilistic Shape Models [0.0]
  DeepSSM is an end-to-end deep learning approach that extracts statistical shape representation directly from unsegmented images. DeepSSM produces an overconfident estimate of shape that cannot be blindly assumed to be accurate. We propose Uncertain-DeepSSM as a unified model that quantifies both, data-dependent aleatoric uncertainty by adapting the network to predict intrinsic input variance.
  arXiv  Detail & Related papers  (2020-07-13T17:18:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.