Twin-S: A Digital Twin for Skull-base Surgery
- URL: http://arxiv.org/abs/2211.11863v2
- Date: Sun, 7 May 2023 00:49:58 GMT
- Title: Twin-S: A Digital Twin for Skull-base Surgery
- Authors: Hongchao Shu, Ruixing Liang, Zhaoshuo Li, Anna Goodridge, Xiangyu
Zhang, Hao Ding, Nimesh Nagururu, Manish Sahu, Francis X. Creighton, Russell
H. Taylor, Adnan Munawar and Mathias Unberath
- Abstract summary: Digital twins are virtual interactive models of the real world, exhibiting identical behavior and properties.
In surgical applications, computational analysis from digital twins can be used to enhance situational awareness.
We present a digital twin framework for skull-base surgeries, named Twin-S, which can be integrated within various image-guided interventions seamlessly.
- Score: 14.323901431687672
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Purpose: Digital twins are virtual interactive models of the real world,
exhibiting identical behavior and properties. In surgical applications,
computational analysis from digital twins can be used, for example, to enhance
situational awareness. Methods: We present a digital twin framework for
skull-base surgeries, named Twin-S, which can be integrated within various
image-guided interventions seamlessly. Twin-S combines high-precision optical
tracking and real-time simulation. We rely on rigorous calibration routines to
ensure that the digital twin representation precisely mimics all real-world
processes. Twin-S models and tracks the critical components of skull-base
surgery, including the surgical tool, patient anatomy, and surgical camera.
Significantly, Twin-S updates and reflects real-world drilling of the
anatomical model in frame rate. Results: We extensively evaluate the accuracy
of Twin-S, which achieves an average 1.39 mm error during the drilling process.
We further illustrate how segmentation masks derived from the continuously
updated digital twin can augment the surgical microscope view in a mixed
reality setting, where bone requiring ablation is highlighted to provide
surgeons additional situational awareness. Conclusion: We present Twin-S, a
digital twin environment for skull-base surgery. Twin-S tracks and updates the
virtual model in real-time given measurements from modern tracking
technologies. Future research on complementing optical tracking with
higher-precision vision-based approaches may further increase the accuracy of
Twin-S.
Related papers
- Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements.
Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements.
We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Digital Twin Ecosystem for Oncology Clinical Operations [0.8130739369606821]
This paper introduces a novel digital twin framework specifically designed to enhance oncology clinical operations.
We propose the integration of multiple specialized digital twins, such as the Medical Necessity Twin, Care Navigator Twin, and Clinical History Twin.
By synthesizing multiple data sources and aligning them with the National Comprehensive Cancer Network (NCCN) guidelines, we create a dynamic Cancer Care Path.
arXiv Detail & Related papers (2024-09-26T08:56:54Z) - Digital Twin Generators for Disease Modeling [2.341540989979203]
A patient's digital twin is a computational model that describes the evolution of their health over time.
Digital twins have the potential to revolutionize medicine by enabling individual-level computer simulations of human health.
arXiv Detail & Related papers (2024-05-02T17:23:04Z) - Creating a Digital Twin of Spinal Surgery: A Proof of Concept [68.37190859183663]
Surgery digitalization is the process of creating a virtual replica of real-world surgery.
We present a proof of concept (PoC) for surgery digitalization that is applied to an ex-vivo spinal surgery.
We employ five RGB-D cameras for dynamic 3D reconstruction of the surgeon, a high-end camera for 3D reconstruction of the anatomy, an infrared stereo camera for surgical instrument tracking, and a laser scanner for 3D reconstruction of the operating room and data fusion.
arXiv Detail & Related papers (2024-03-25T13:09:40Z) - Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning [15.106435744696013]
A digital twin is a virtual replica of a real-world physical phenomena that uses mathematical modeling to characterize and simulate its defining features.
We propose a method to identify digital twin model parameters using only noninvasive patient health data.
arXiv Detail & Related papers (2024-02-29T23:04:42Z) - S^2Former-OR: Single-Stage Bi-Modal Transformer for Scene Graph Generation in OR [50.435592120607815]
Scene graph generation (SGG) of surgical procedures is crucial in enhancing holistically cognitive intelligence in the operating room (OR)
Previous works have primarily relied on multi-stage learning, where the generated semantic scene graphs depend on intermediate processes with pose estimation and object detection.
In this study, we introduce a novel single-stage bi-modal transformer framework for SGG in the OR, termed S2Former-OR.
arXiv Detail & Related papers (2024-02-22T11:40:49Z) - Probing the Limits and Capabilities of Diffusion Models for the Anatomic
Editing of Digital Twins [0.9628617363701458]
We investigate the capacity of Latent Diffusion Models to edit digital twins to create anatomic variants.
We specifically edit digital twins to introduce anatomic variation at different spatial scales and within localized regions.
arXiv Detail & Related papers (2023-12-30T14:21:30Z) - 3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation [52.699139151447945]
We propose a novel adaptation method for transferring the segment anything model (SAM) from 2D to 3D for promptable medical image segmentation.
Our model can outperform domain state-of-the-art medical image segmentation models on 3 out of 4 tasks, specifically by 8.25%, 29.87%, and 10.11% for kidney tumor, pancreas tumor, colon cancer segmentation, and achieve similar performance for liver tumor segmentation.
arXiv Detail & Related papers (2023-06-23T12:09:52Z) - SpineNetV2: Automated Detection, Labelling and Radiological Grading Of
Clinical MR Scans [70.04389979779195]
SpineNetV2 is an automated tool which detects and labels vertebral bodies in clinical spinal magnetic resonance (MR) scans.
It also performs radiological grading of lumbar intervertebral discs in T2-weighted scans for a range of common degenerative changes.
arXiv Detail & Related papers (2022-05-03T15:05:58Z) - HDL: Hybrid Deep Learning for the Synthesis of Myocardial Velocity Maps
in Digital Twins for Cardiac Analysis [12.999677043271133]
We propose a hybrid deep learning (HDL) network, especially for synthetic 3Dir MVM data.
Our proposed algorithm can still successfully synthesise high temporal resolution 3Dir MVM CMR data.
This work is the first one in the literature investigating digital twins of the 3Dir MVM CMR.
arXiv Detail & Related papers (2022-03-09T23:22:56Z) - Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics [72.9038524082252]
We propose a compact single-shot monocular hyperspectral-depth (HS-D) imaging method.
Our method uses a diffractive optical element (DOE), the point spread function of which changes with respect to both depth and spectrum.
To facilitate learning the DOE, we present a first HS-D dataset by building a benchtop HS-D imager.
arXiv Detail & Related papers (2020-09-01T14:19:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.