High-precision surgical navigation using speckle structured light-based thoracoabdominal puncture robot
- URL: http://arxiv.org/abs/2406.06478v1
- Date: Mon, 6 May 2024 08:59:51 GMT
- Title: High-precision surgical navigation using speckle structured light-based thoracoabdominal puncture robot
- Authors: Zezhao Guo, Yanzhong Guo, Zhanfang Zhao,
- Abstract summary: During puncture robotic surgical navigation, the needle insertion point is positioned on the patient's chest and abdomen body surface.
Traditional reflective ball tracking method is difficult to apply.
This paper designs and experiments a method that is different from previous reflective ball optical markers.
It is based on a speckle structured light camera to identify the patient's body surface and fit it into a hollow ring with a diameter of 24mm.
- Score: 0.27309692684728604
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Abstract Background During percutaneous puncture robotic surgical navigation, the needle insertion point is positioned on the patient's chest and abdomen body surface. By locating any point on the soft skin tissue, it is difficult to apply the traditional reflective ball tracking method. The patient's chest and abdomen body surface has fluctuations in breathing and appears irregular. The chest and abdomen are regular and smooth, lacking obvious features, and it is challenging to locate the needle insertion point on the body surface. Methods This paper designs and experiments a method that is different from previous reflective ball optical markers or magnetic positioning surgical navigation and tracking methods. It is based on a speckle structured light camera to identify the patient's body surface and fit it into a hollow ring with a diameter of 24mm. Results Experimental results show that this method of the system can be small, flexible, and high-precision positioning of any body surface point at multiple angles, achieving a positioning accuracy of 0.033-0.563mm and an image of 7-30 frames/s. Conclusions The positioning recognition ring material used in this method can be well imaged under CT, so the optical positioning of the body surface and the in vivo imaging positioning under CT can be combined to form a unified patient's internal and external positioning world coordinates to achieve internal and external registration. Positioning integration. The system senses motion with six degrees of freedom, up and down, front and back, left and right, and all rotations, with sub-millimeter accuracy, and has broad application prospects in future puncture surgeries.
Related papers
- A Shape-Aware Total Body Photography System for In-focus Surface Coverage Optimization [3.8598226486555314]
Total Body Photography (TBP) is becoming a useful screening tool for patients at high risk for skin cancer.<n>This paper proposes a novel shape-aware TBP system automatically capturing full-body images.<n>The proposed system achieves an average resolution of 0.068 mm/pixel and 0.0566 mm/pixel with approximately 85% and 95% of surface area in-focus.
arXiv Detail & Related papers (2025-05-22T04:57:05Z) - A Fourier-enhanced multi-modal 3D small object optical mark recognition and positioning method for percutaneous abdominal puncture surgical navigation [0.27309692684728604]
This paper proposes a muti-modal 3D small object medical marker detection method, which identifies the center of a small single ring as the needle insertion point.
The experimental results show this novel method achieves high-precision and high-stability positioning.
arXiv Detail & Related papers (2024-04-13T12:28:40Z) - Robot-Assisted Deep Venous Thrombosis Ultrasound Examination using
Virtual Fixture [45.97156332608481]
Deep Venous Thrombosis (DVT) is a common vascular disease with blood clots inside deep veins, which may block blood flow or even cause a life-threatening pulmonary embolism.
A typical exam for DVT using ultrasound (US) imaging is by pressing the target vein until its lumens is fully compressed.
We present a robotic US system with a novel hybrid force motion control scheme ensuring position and force tracking accuracy, and soft landing of the probe onto the target surface.
arXiv Detail & Related papers (2024-01-04T21:02:39Z) - EyeLS: Shadow-Guided Instrument Landing System for Intraocular Target
Approaching in Robotic Eye Surgery [51.05595735405451]
Robotic ophthalmic surgery is an emerging technology to facilitate high-precision interventions such as retina penetration in subretinal injection and removal of floating tissues in retinal detachment.
Current image-based methods cannot effectively estimate the needle tip's trajectory towards both retinal and floating targets.
We propose to use the shadow positions of the target and the instrument tip to estimate their relative depth position.
Our method succeeds target approaching on a retina model, and achieves an average depth error of 0.0127 mm and 0.3473 mm for floating and retinal targets respectively in the surgical simulator.
arXiv Detail & Related papers (2023-11-15T09:11:37Z) - AiAReSeg: Catheter Detection and Segmentation in Interventional
Ultrasound using Transformers [75.20925220246689]
endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature.
This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
arXiv Detail & Related papers (2023-09-25T19:34:12Z) - Medical needle tip tracking based on Optical Imaging and AI [0.0]
This paper presents an innovative technology for needle tip real-time tracking, aiming for enhanced needle insertion guidance.
Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle, and uses Convolutional Neural Network (CNN) based algorithms to enable real-time estimation of the needle tip's position and orientation.
Given the average femoral arterial radius of 4 to 5mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures.
arXiv Detail & Related papers (2023-08-28T10:30:08Z) - Collaborative Robotic Biopsy with Trajectory Guidance and Needle Tip
Force Feedback [49.32653090178743]
We present a collaborative robotic biopsy system that combines trajectory guidance with kinesthetic feedback to assist the physician in needle placement.
A needle design that senses forces at the needle tip based on optical coherence tomography and machine learning for real-time data processing.
We demonstrate that even smaller, deep target structures can be accurately sampled by performing post-mortem in situ biopsies of the pancreas.
arXiv Detail & Related papers (2023-06-12T14:07:53Z) - Next-generation Surgical Navigation: Marker-less Multi-view 6DoF Pose
Estimation of Surgical Instruments [66.74633676595889]
We present a multi-camera capture setup consisting of static and head-mounted cameras.
Second, we publish a multi-view RGB-D video dataset of ex-vivo spine surgeries, captured in a surgical wet lab and a real operating theatre.
Third, we evaluate three state-of-the-art single-view and multi-view methods for the task of 6DoF pose estimation of surgical instruments.
arXiv Detail & Related papers (2023-05-05T13:42:19Z) - Feature-aggregated spatiotemporal spine surface estimation for wearable
patch ultrasound volumetric imaging [4.287216236596808]
We propose to use a patch-like wearable ultrasound solution to capture the reflective bone surfaces from multiple imaging angles.
Our wearable ultrasound system can potentially provide intuitive and accurate interventional guidance for clinicians in augmented reality setting.
arXiv Detail & Related papers (2022-11-11T02:15:48Z) - Follow the Curve: Robotic-Ultrasound Navigation with Learning Based
Localization of Spinous Processes for Scoliosis Assessment [1.7594269512136405]
This paper introduces a robotic-ultrasound approach for spinal curvature tracking and automatic navigation.
A fully connected network with deconvolutional heads is developed to locate the spinous process efficiently with real-time ultrasound images.
We developed a new force-driven controller that automatically adjusts the probe's pose relative to the skin surface to ensure a good acoustic coupling between the probe and skin.
arXiv Detail & Related papers (2021-09-11T06:25:30Z) - Tattoo tomography: Freehand 3D photoacoustic image reconstruction with
an optical pattern [49.240017254888336]
Photoacoustic tomography (PAT) is a novel imaging technique that can resolve both morphological and functional tissue properties.
A current drawback is the limited field-of-view provided by the conventionally applied 2D probes.
We present a novel approach to 3D reconstruction of PAT data that does not require an external tracking system.
arXiv Detail & Related papers (2020-11-10T09:27:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.