Vibration-Based Energy Metric for Restoring Needle Alignment in Autonomous Robotic Ultrasound
- URL: http://arxiv.org/abs/2508.06921v2
- Date: Mon, 18 Aug 2025 06:09:55 GMT
- Title: Vibration-Based Energy Metric for Restoring Needle Alignment in Autonomous Robotic Ultrasound
- Authors: Zhongyu Chen, Chenyang Li, Xuesong Li, Dianye Huang, Zhongliang Jiang, Stefanie Speidel, Xiangyu Chu, K. W. Samuel Au,
- Abstract summary: We propose a method to restore needle alignment when the ultrasound imaging plane and the needle insertion plane are misaligned.<n>Our method uses a more robust feature by periodically vibrating the needle using a mechanical system.<n>Experiments conducted on ex-vivo porcine tissue samples using a dual-arm robotic ultrasound-guided needle insertion system demonstrate the effectiveness of the proposed approach.
- Score: 9.00123836855783
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Precise needle alignment is essential for percutaneous needle insertion in robotic ultrasound-guided procedures. However, inherent challenges such as speckle noise, needle-like artifacts, and low image resolution make robust needle detection difficult, particularly when visibility is reduced or lost. In this paper, we propose a method to restore needle alignment when the ultrasound imaging plane and the needle insertion plane are misaligned. Unlike many existing approaches that rely heavily on needle visibility in ultrasound images, our method uses a more robust feature by periodically vibrating the needle using a mechanical system. Specifically, we propose a vibration-based energy metric that remains effective even when the needle is fully out of plane. Using this metric, we develop a control strategy to reposition the ultrasound probe in response to misalignments between the imaging plane and the needle insertion plane in both translation and rotation. Experiments conducted on ex-vivo porcine tissue samples using a dual-arm robotic ultrasound-guided needle insertion system demonstrate the effectiveness of the proposed approach. The experimental results show the translational error of 0.41$\pm$0.27 mm and the rotational error of 0.51$\pm$0.19 degrees.
Related papers
- VibNet: Vibration-Boosted Needle Detection in Ultrasound Images [40.64433529217187]
VibNet is a learning-based framework designed to enhance the visibility and accuracy of needle detection in US images.<n>VibNet integrates neural Short-Time Fourier Transform Hough Transform modules to achieve successive sub-goals, including motion feature extraction and needle detection.
arXiv Detail & Related papers (2024-03-21T16:23:25Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - Robot-Assisted Deep Venous Thrombosis Ultrasound Examination using
Virtual Fixture [45.97156332608481]
Deep Venous Thrombosis (DVT) is a common vascular disease with blood clots inside deep veins, which may block blood flow or even cause a life-threatening pulmonary embolism.
A typical exam for DVT using ultrasound (US) imaging is by pressing the target vein until its lumens is fully compressed.
We present a robotic US system with a novel hybrid force motion control scheme ensuring position and force tracking accuracy, and soft landing of the probe onto the target surface.
arXiv Detail & Related papers (2024-01-04T21:02:39Z) - RUSOpt: Robotic UltraSound Probe Normalization with Bayesian
Optimization for In-plane and Out-plane Scanning [4.420121239028863]
Proper orientation of the robotized probe plays a crucial role in governing the quality of ultrasound images.
We propose a sample-efficient method to automatically adjust the orientation of the ultrasound probe normal to the point of contact on the scanning surface.
arXiv Detail & Related papers (2023-10-05T09:22:16Z) - AiAReSeg: Catheter Detection and Segmentation in Interventional
Ultrasound using Transformers [75.20925220246689]
endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature.
This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
arXiv Detail & Related papers (2023-09-25T19:34:12Z) - Medical needle tip tracking based on Optical Imaging and AI [0.0]
This paper presents an innovative technology for needle tip real-time tracking, aiming for enhanced needle insertion guidance.
Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle, and uses Convolutional Neural Network (CNN) based algorithms to enable real-time estimation of the needle tip's position and orientation.
Given the average femoral arterial radius of 4 to 5mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures.
arXiv Detail & Related papers (2023-08-28T10:30:08Z) - Collaborative Robotic Biopsy with Trajectory Guidance and Needle Tip
Force Feedback [49.32653090178743]
We present a collaborative robotic biopsy system that combines trajectory guidance with kinesthetic feedback to assist the physician in needle placement.
A needle design that senses forces at the needle tip based on optical coherence tomography and machine learning for real-time data processing.
We demonstrate that even smaller, deep target structures can be accurately sampled by performing post-mortem in situ biopsies of the pancreas.
arXiv Detail & Related papers (2023-06-12T14:07:53Z) - Identifying visible tissue in intraoperative ultrasound: a method and application [3.076170146656896]
Intraoperative ultrasound scanning is a demanding visuotactile task.<n>An iterative filtering and topological method is proposed to identify the underlying visible tissue.<n>A novel framework for evaluating the confidence estimation of probe tissue contact is created.
arXiv Detail & Related papers (2023-06-01T23:06:14Z) - Automatic breach detection during spine pedicle drilling based on
vibroacoustic sensing [0.0]
This work proposes a new radiation-free breach detection algorithm leveraging a non-visual sensor setup in combination with deep learning approach.
Multiple vibroacoustic sensors, such as a contact microphone, a free-field microphone, a tri-axial accelerometer, and an optical tracking system were integrated into the setup.
The proposed method shows the great potential of non-visual sensor fusion for avoiding screw misplacement and accidental bone breaches during pedicle drilling.
arXiv Detail & Related papers (2023-03-27T11:32:14Z) - Deep Learning for Ultrasound Beamforming [120.12255978513912]
Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain.
Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing.
Deep learning methods can play a compelling role in the digital beamforming pipeline.
arXiv Detail & Related papers (2021-09-23T15:15:21Z) - Follow the Curve: Robotic-Ultrasound Navigation with Learning Based
Localization of Spinous Processes for Scoliosis Assessment [1.7594269512136405]
This paper introduces a robotic-ultrasound approach for spinal curvature tracking and automatic navigation.
A fully connected network with deconvolutional heads is developed to locate the spinous process efficiently with real-time ultrasound images.
We developed a new force-driven controller that automatically adjusts the probe's pose relative to the skin surface to ensure a good acoustic coupling between the probe and skin.
arXiv Detail & Related papers (2021-09-11T06:25:30Z) - Assisted Probe Positioning for Ultrasound Guided Radiotherapy Using
Image Sequence Classification [55.96221340756895]
Effective transperineal ultrasound image guidance in prostate external beam radiotherapy requires consistent alignment between probe and prostate at each session during patient set-up.
We demonstrate a method for ensuring accurate probe placement through joint classification of images and probe position data.
Using a multi-input multi-task algorithm, spatial coordinate data from an optically tracked ultrasound probe is combined with an image clas-sifier using a recurrent neural network to generate two sets of predictions in real-time.
The algorithm identified optimal probe alignment within a mean (standard deviation) range of 3.7$circ$ (1.2$circ$) from
arXiv Detail & Related papers (2020-10-06T13:55:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.