Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins

• URL: http://arxiv.org/abs/2401.00247v1
• Date: Sat, 30 Dec 2023 14:21:30 GMT
• Title: Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins
• Authors: Karim Kadry, Shreya Gupta, Farhad R. Nezami, Elazer R. Edelman
• Abstract summary: We investigate the capacity of Latent Diffusion Models to edit digital twins to create anatomic variants. We specifically edit digital twins to introduce anatomic variation at different spatial scales and within localized regions.
• Score: 0.9628617363701458
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Numerical simulations can model the physical processes that govern cardiovascular device deployment. When such simulations incorporate digital twins; computational models of patient-specific anatomy, they can expedite and de-risk the device design process. Nonetheless, the exclusive use of patient-specific data constrains the anatomic variability which can be precisely or fully explored. In this study, we investigate the capacity of Latent Diffusion Models (LDMs) to edit digital twins to create anatomic variants, which we term digital siblings. Digital twins and their corresponding siblings can serve as the basis for comparative simulations, enabling the study of how subtle anatomic variations impact the simulated deployment of cardiovascular devices, as well as the augmentation of virtual cohorts for device assessment. However, while diffusion models have been characterized in their ability to edit natural images, their capacity to anatomically edit digital twins has yet to be studied. Using a case example centered on 3D digital twins of cardiac anatomy, we implement various methods for generating digital siblings and characterize them through morphological and topological analyses. We specifically edit digital twins to introduce anatomic variation at different spatial scales and within localized regions, demonstrating the existence of bias towards common anatomic features. We further show that such anatomic bias can be leveraged for virtual cohort augmentation through selective editing, partially alleviating issues related to dataset imbalance and lack of diversity. Our experimental framework thus delineates the limits and capabilities of using latent diffusion models in synthesizing anatomic variation for in silico trials.

Related papers

• Digital Twin Generators for Disease Modeling [2.341540989979203]
  A patient's digital twin is a computational model that describes the evolution of their health over time. Digital twins have the potential to revolutionize medicine by enabling individual-level computer simulations of human health.
  arXiv  Detail & Related papers  (2024-05-02T17:23:04Z)
• Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning [15.106435744696013]
  A digital twin is a virtual replica of a real-world physical phenomena that uses mathematical modeling to characterize and simulate its defining features. We propose a method to identify digital twin model parameters using only noninvasive patient health data.
  arXiv  Detail & Related papers  (2024-02-29T23:04:42Z)
• Few-shot learning for COVID-19 Chest X-Ray Classification with Imbalanced Data: An Inter vs. Intra Domain Study [49.5374512525016]
  Medical image datasets are essential for training models used in computer-aided diagnosis, treatment planning, and medical research. Some challenges are associated with these datasets, including variability in data distribution, data scarcity, and transfer learning issues when using models pre-trained from generic images. We propose a methodology based on Siamese neural networks in which a series of techniques are integrated to mitigate the effects of data scarcity and distribution imbalance.
  arXiv  Detail & Related papers  (2024-01-18T16:59:27Z)
• Simulation-based Inference for Cardiovascular Models [57.92535897767929]
  We use simulation-based inference to solve the inverse problem of mapping waveforms back to plausible physiological parameters. We perform an in-silico uncertainty analysis of five biomarkers of clinical interest. We study the gap between in-vivo and in-silico with the MIMIC-III waveform database.
  arXiv  Detail & Related papers  (2023-07-26T02:34:57Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• Twin-S: A Digital Twin for Skull-base Surgery [14.323901431687672]
  Digital twins are virtual interactive models of the real world, exhibiting identical behavior and properties. In surgical applications, computational analysis from digital twins can be used to enhance situational awareness. We present a digital twin framework for skull-base surgeries, named Twin-S, which can be integrated within various image-guided interventions seamlessly.
  arXiv  Detail & Related papers  (2022-11-21T21:33:51Z)
• Statistical Shape Modeling of Biventricular Anatomy with Shared Boundaries [16.287876512923084]
  This paper presents a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries. Shape changes within these shared boundaries of the heart can indicate potential pathological changes that lead to uncoordinated contraction and poor end-organ perfusion.
  arXiv  Detail & Related papers  (2022-09-06T15:54:37Z)
• Differentiable Agent-based Epidemiology [71.81552021144589]
  We introduce GradABM: a scalable, differentiable design for agent-based modeling that is amenable to gradient-based learning with automatic differentiation. GradABM can quickly simulate million-size populations in few seconds on commodity hardware, integrate with deep neural networks and ingest heterogeneous data sources.
  arXiv  Detail & Related papers  (2022-07-20T07:32:02Z)
• Mixed Effects Neural ODE: A Variational Approximation for Analyzing the Dynamics of Panel Data [50.23363975709122]
  We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data. We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem. We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
  arXiv  Detail & Related papers  (2022-02-18T22:41:51Z)
• A Probabilistic Graphical Model Foundation for Enabling Predictive Digital Twins at Scale [0.0]
  We create an abstraction of the asset-twin system as a set of coupled dynamical systems. We demonstrate how the model is instantiated to enable a structural digital twin of an unmanned aerial vehicle.
  arXiv  Detail & Related papers  (2020-12-10T17:33:59Z)
• Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
  Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise. We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
  arXiv  Detail & Related papers  (2020-06-11T17:29:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.