Twin-S: A Digital Twin for Skull-base Surgery
- URL: http://arxiv.org/abs/2211.11863v2
- Date: Sun, 7 May 2023 00:49:58 GMT
- Title: Twin-S: A Digital Twin for Skull-base Surgery
- Authors: Hongchao Shu, Ruixing Liang, Zhaoshuo Li, Anna Goodridge, Xiangyu
Zhang, Hao Ding, Nimesh Nagururu, Manish Sahu, Francis X. Creighton, Russell
H. Taylor, Adnan Munawar and Mathias Unberath
- Abstract summary: Digital twins are virtual interactive models of the real world, exhibiting identical behavior and properties.
In surgical applications, computational analysis from digital twins can be used to enhance situational awareness.
We present a digital twin framework for skull-base surgeries, named Twin-S, which can be integrated within various image-guided interventions seamlessly.
- Score: 14.323901431687672
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Purpose: Digital twins are virtual interactive models of the real world,
exhibiting identical behavior and properties. In surgical applications,
computational analysis from digital twins can be used, for example, to enhance
situational awareness. Methods: We present a digital twin framework for
skull-base surgeries, named Twin-S, which can be integrated within various
image-guided interventions seamlessly. Twin-S combines high-precision optical
tracking and real-time simulation. We rely on rigorous calibration routines to
ensure that the digital twin representation precisely mimics all real-world
processes. Twin-S models and tracks the critical components of skull-base
surgery, including the surgical tool, patient anatomy, and surgical camera.
Significantly, Twin-S updates and reflects real-world drilling of the
anatomical model in frame rate. Results: We extensively evaluate the accuracy
of Twin-S, which achieves an average 1.39 mm error during the drilling process.
We further illustrate how segmentation masks derived from the continuously
updated digital twin can augment the surgical microscope view in a mixed
reality setting, where bone requiring ablation is highlighted to provide
surgeons additional situational awareness. Conclusion: We present Twin-S, a
digital twin environment for skull-base surgery. Twin-S tracks and updates the
virtual model in real-time given measurements from modern tracking
technologies. Future research on complementing optical tracking with
higher-precision vision-based approaches may further increase the accuracy of
Twin-S.
Related papers
- Digital Twin Generators for Disease Modeling [2.341540989979203]
A patient's digital twin is a computational model that describes the evolution of their health over time.
Digital twins have the potential to revolutionize medicine by enabling individual-level computer simulations of human health.
arXiv Detail & Related papers (2024-05-02T17:23:04Z) - Creating a Digital Twin of Spinal Surgery: A Proof of Concept [68.37190859183663]
Surgery digitalization is the process of creating a virtual replica of real-world surgery.
We present a proof of concept (PoC) for surgery digitalization that is applied to an ex-vivo spinal surgery.
We employ five RGB-D cameras for dynamic 3D reconstruction of the surgeon, a high-end camera for 3D reconstruction of the anatomy, an infrared stereo camera for surgical instrument tracking, and a laser scanner for 3D reconstruction of the operating room and data fusion.
arXiv Detail & Related papers (2024-03-25T13:09:40Z) - Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning [15.106435744696013]
A digital twin is a virtual replica of a real-world physical phenomena that uses mathematical modeling to characterize and simulate its defining features.
We propose a method to identify digital twin model parameters using only noninvasive patient health data.
arXiv Detail & Related papers (2024-02-29T23:04:42Z) - S^2Former-OR: Single-Stage Bimodal Transformer for Scene Graph
Generation in OR [52.964721233679406]
Scene graph generation (SGG) of surgical procedures is crucial in enhancing holistically cognitive intelligence in the operating room (OR)
Previous works have primarily relied on the multi-stage learning that generates semantic scene graphs dependent on intermediate processes with pose estimation and object detection.
In this study, we introduce a novel single-stage bimodal transformer framework for SGG in the OR, termed S2Former-OR.
arXiv Detail & Related papers (2024-02-22T11:40:49Z) - Probing the Limits and Capabilities of Diffusion Models for the Anatomic
Editing of Digital Twins [0.9628617363701458]
We investigate the capacity of Latent Diffusion Models to edit digital twins to create anatomic variants.
We specifically edit digital twins to introduce anatomic variation at different spatial scales and within localized regions.
arXiv Detail & Related papers (2023-12-30T14:21:30Z) - 3DSAM-adapter: Holistic Adaptation of SAM from 2D to 3D for Promptable
Medical Image Segmentation [56.50064853710202]
We propose a novel adaptation method for transferring the segment anything model (SAM) from 2D to 3D for promptable medical image segmentation.
Our model can outperform domain state-of-the-art medical image segmentation models on 3 out of 4 tasks, specifically by 8.25%, 29.87%, and 10.11% for kidney tumor, pancreas tumor, colon cancer segmentation, and achieve similar performance for liver tumor segmentation.
arXiv Detail & Related papers (2023-06-23T12:09:52Z) - SpineNetV2: Automated Detection, Labelling and Radiological Grading Of
Clinical MR Scans [70.04389979779195]
SpineNetV2 is an automated tool which detects and labels vertebral bodies in clinical spinal magnetic resonance (MR) scans.
It also performs radiological grading of lumbar intervertebral discs in T2-weighted scans for a range of common degenerative changes.
arXiv Detail & Related papers (2022-05-03T15:05:58Z) - HDL: Hybrid Deep Learning for the Synthesis of Myocardial Velocity Maps
in Digital Twins for Cardiac Analysis [12.999677043271133]
We propose a hybrid deep learning (HDL) network, especially for synthetic 3Dir MVM data.
Our proposed algorithm can still successfully synthesise high temporal resolution 3Dir MVM CMR data.
This work is the first one in the literature investigating digital twins of the 3Dir MVM CMR.
arXiv Detail & Related papers (2022-03-09T23:22:56Z) - Incremental Cross-view Mutual Distillation for Self-supervised Medical
CT Synthesis [88.39466012709205]
This paper builds a novel medical slice to increase the between-slice resolution.
Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy.
Our method outperforms state-of-the-art algorithms by clear margins.
arXiv Detail & Related papers (2021-12-20T03:38:37Z) - A Probabilistic Graphical Model Foundation for Enabling Predictive
Digital Twins at Scale [0.0]
We create an abstraction of the asset-twin system as a set of coupled dynamical systems.
We demonstrate how the model is instantiated to enable a structural digital twin of an unmanned aerial vehicle.
arXiv Detail & Related papers (2020-12-10T17:33:59Z) - Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics [72.9038524082252]
We propose a compact single-shot monocular hyperspectral-depth (HS-D) imaging method.
Our method uses a diffractive optical element (DOE), the point spread function of which changes with respect to both depth and spectrum.
To facilitate learning the DOE, we present a first HS-D dataset by building a benchtop HS-D imager.
arXiv Detail & Related papers (2020-09-01T14:19:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.