BOSS: Bones, Organs and Skin Shape Model
- URL: http://arxiv.org/abs/2303.04923v1
- Date: Wed, 8 Mar 2023 22:31:24 GMT
- Title: BOSS: Bones, Organs and Skin Shape Model
- Authors: Karthik Shetty, Annette Birkhold, Srikrishna Jaganathan, Norbert
Strobel, Bernhard Egger, Markus Kowarschik, Andreas Maier
- Abstract summary: We propose a deformable human shape and pose model that combines skin, internal organs, and bones, learned from CT images.
By modeling the statistical variations in a pose-normalized space using probabilistic PCA, our approach offers a holistic representation of the body.
- Score: 10.50175010474078
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Objective: A digital twin of a patient can be a valuable tool for enhancing
clinical tasks such as workflow automation, patient-specific X-ray dose
optimization, markerless tracking, positioning, and navigation assistance in
image-guided interventions. However, it is crucial that the patient's surface
and internal organs are of high quality for any pose and shape estimates. At
present, the majority of statistical shape models (SSMs) are restricted to a
small number of organs or bones or do not adequately represent the general
population. Method: To address this, we propose a deformable human shape and
pose model that combines skin, internal organs, and bones, learned from CT
images. By modeling the statistical variations in a pose-normalized space using
probabilistic PCA while also preserving joint kinematics, our approach offers a
holistic representation of the body that can benefit various medical
applications. Results: We assessed our model's performance on a registered
dataset, utilizing the unified shape space, and noted an average error of 3.6
mm for bones and 8.8 mm for organs. To further verify our findings, we
conducted additional tests on publicly available datasets with multi-part
segmentations, which confirmed the effectiveness of our model. Conclusion: This
works shows that anatomically parameterized statistical shape models can be
created accurately and in a computationally efficient manner. Significance: The
proposed approach enables the construction of shape models that can be directly
applied to various medical applications, including biomechanics and
reconstruction.
Related papers
- Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation [113.5002649181103]
Training open-source small multimodal models (SMMs) to bridge competency gaps for unmet clinical needs in radiology.
For training, we assemble a large dataset of over 697 thousand radiology image-text pairs.
For evaluation, we propose CheXprompt, a GPT-4-based metric for factuality evaluation, and demonstrate its parity with expert evaluation.
The inference of LlaVA-Rad is fast and can be performed on a single V100 GPU in private settings, offering a promising state-of-the-art tool for real-world clinical applications.
arXiv Detail & Related papers (2024-03-12T18:12:02Z) - Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusion [32.71972792352939]
3D patient body modeling is critical to the success of automated patient positioning for smart medical scanning and operating rooms.
Existing CNN-based end-to-end patient modeling solutions typically require customized network designs demanding large amount of relevant training data.
We propose a generic modularized 3D patient modeling method consists of (a) a multi-modal keypoint detection module with attentive fusion for 2D patient joint localization.
We demonstrate the efficacy of the proposed method by extensive patient positioning experiments on both public and clinical data.
arXiv Detail & Related papers (2024-03-05T18:58:55Z) - Statistical Shape Modeling of Biventricular Anatomy with Shared
Boundaries [16.287876512923084]
This paper presents a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries.
Shape changes within these shared boundaries of the heart can indicate potential pathological changes that lead to uncoordinated contraction and poor end-organ perfusion.
arXiv Detail & Related papers (2022-09-06T15:54:37Z) - LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human
Bodies [78.17425779503047]
We propose a novel neural implicit representation for the human body.
It is fully differentiable and optimizable with disentangled shape and pose latent spaces.
Our model can be trained and fine-tuned directly on non-watertight raw data with well-designed losses.
arXiv Detail & Related papers (2021-11-30T04:10:57Z) - Comprehensive Validation of Automated Whole Body Skeletal Muscle,
Adipose Tissue, and Bone Segmentation from 3D CT images for Body Composition
Analysis: Towards Extended Body Composition [0.6176955945418618]
Powerful tools of artificial intelligence such as deep learning are making it feasible now to segment the entire 3D image and generate accurate measurements of all internal anatomy.
These will enable the overcoming of the severe bottleneck that existed previously, namely, the need for manual segmentation.
These measurements were hitherto unavailable thereby limiting the field to a very small and limited subset.
arXiv Detail & Related papers (2021-06-01T17:30:45Z) - 3D Human Body Reshaping with Anthropometric Modeling [59.51820187982793]
Reshaping accurate and realistic 3D human bodies from anthropometric parameters poses a fundamental challenge for person identification, online shopping and virtual reality.
Existing approaches for creating such 3D shapes often suffer from complex measurement by range cameras or high-end scanners.
This paper proposes a novel feature-selection-based local mapping technique, which enables automatic anthropometric parameter modeling for each body facet.
arXiv Detail & Related papers (2021-04-05T04:09:39Z) - Adversarial Sample Enhanced Domain Adaptation: A Case Study on
Predictive Modeling with Electronic Health Records [57.75125067744978]
We propose a data augmentation method to facilitate domain adaptation.
adversarially generated samples are used during domain adaptation.
Results confirm the effectiveness of our method and the generality on different tasks.
arXiv Detail & Related papers (2021-01-13T03:20:20Z) - Benchmarking off-the-shelf statistical shape modeling tools in clinical
applications [53.47202621511081]
We systematically assess the outcome of widely used, state-of-the-art SSM tools.
We propose validation frameworks for anatomical landmark/measurement inference and lesion screening.
ShapeWorks and Deformetrica shape models are found to capture clinically relevant population-level variability.
arXiv Detail & Related papers (2020-09-07T03:51:35Z) - Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization.
We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise.
We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
arXiv Detail & Related papers (2020-06-11T17:29:53Z) - Dynamic multi-object Gaussian process models: A framework for
data-driven functional modelling of human joints [0.0]
A principled and robust way to combine shape and pose features has been illusive due to three main issues.
We propose a new framework for dynamic multi-object statistical modelling framework for the analysis of human joints.
The framework affords an efficient generative dynamic multi-object modelling platform for biological joints.
arXiv Detail & Related papers (2020-01-22T07:57:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.