Towards Automated Initial Probe Placement in Transthoracic Teleultrasound Using Human Mesh and Skeleton Recovery

• URL: http://arxiv.org/abs/2603.11257v1
• Date: Wed, 11 Mar 2026 19:36:29 GMT
• Title: Towards Automated Initial Probe Placement in Transthoracic Teleultrasound Using Human Mesh and Skeleton Recovery
• Abstract summary: A novice or robot faces the difficult task of first placing the probe on the patient without in-person expert assistance.<n>We present a framework for automating Patient registration and anatomy-informed Initial Probe placement Guidance.<n>Pilot experiments with healthy volunteers suggest that the proposed probe placement prediction and MR guidance yield consistent initial placement.
• Score: 2.99938892718088
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Cardiac and lung ultrasound are technically demanding because operators must identify patient-specific intercostal acoustic windows and then navigate between standard views by adjusting probe position, rotation, and force across different imaging planes. These challenges are amplified in teleultrasound when a novice or robot faces the difficult task of first placing the probe on the patient without in-person expert assistance. We present a framework for automating Patient registration and anatomy-informed Initial Probe placement Guidance (PIPG) using only RGB images from a calibrated camera. The novice first captures the patient using the camera on a mixed reality (MR) head-mounted display (HMD). An edge server then infers a patient-specific body-surface and skeleton model, with spatial smoothing across multiple views. Using bony landmarks from the predicted skeleton, we estimate the intercostal region and project the guidance back onto the reconstructed body surface. To validate the framework, we overlaid the reconstructed body mesh and the virtual probe pose guidance across multiple transthoracic echocardiography scan planes in situ and measured the quantitative placement error. Pilot experiments with healthy volunteers suggest that the proposed probe placement prediction and MR guidance yield consistent initial placement within anatomical variability acceptable for teleultrasound setup

Related papers

• From Self-Normal-Positioning to Omni-Directional Tracking: Real-Time Surface Modeling Enabled Probe Tilt Control for Robotic Ultrasound Imaging [0.8952229340927186]
  Ultrasound (US) provides real-time, radiation-free imaging, but the image quality depends strongly on how the probe is oriented against the patient body.<n>Most existing systems focus on normal positioning, where the probe is maintained perpendicular to the local surface.<n>We propose an omni-directional probe-orientation control framework that integrates RGB-D perception, local-surface modeling, and task-space orientation control.
  arXiv  Detail & Related papers  (2026-08-11T20:16:39Z)
• Rendering Novel Views of MRI Using 3D Gaussian Splatting [54.6286495315908]
  We adapt 3D Gaussian Splatting to form a reconstruction starting from sparse anisotropic MRIs, and imaging planes aligned with the anatomy relevant for clinical evaluation are then sampled and rendered.<n>The novel view plane is optimal for diagnostic radiological grading of the target anatomy, whereas the original MRI is not.
  arXiv  Detail & Related papers  (2026-06-24T18:00:03Z)
• SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasound [60.64817443833982]
  We present SAMe, a semantic anatomy mapping engine that provides robotic ultrasound with an explicit anatomical prior layer.<n> SAMe addresses scan initiation as a target-to-anatomy-to-action process.<n>It instantiates a patient-specific anatomical representation for the grounded targets from a single external body image.
  arXiv  Detail & Related papers  (2026-04-28T13:44:09Z)
• VA-Adapter: Adapting Ultrasound Foundation Model to Echocardiography Probe Guidance [57.43511837589102]
  We adapt medical knowledge learned by foundation models from vast datasets to the probe guidance task.<n>We meticulously design a parameter-efficient Vision-Action Adapter (VA-Adapter) to enable foundation model's image encoder to encode vision-action sequences.<n>With built-in sequential reasoning capabilities in a compact design, the VA-Adapter enables a pre-trained ultrasound foundation model to learn precise probe adjustment strategies.
  arXiv  Detail & Related papers  (2025-10-08T09:38:30Z)
• UltraSeP: Sequence-aware Pre-training for Echocardiography Probe Movement Guidance [70.94473797093293]
  We introduce a novel probe movement guidance algorithm that has the potential to be applied in guiding robotic systems or novices with probe pose adjustment for high-quality standard plane image acquisition.<n>Our approach learns personalized three-dimensional cardiac structural features by predicting the masked-out image features and probe movement actions in a scanning sequence.
  arXiv  Detail & Related papers  (2024-08-27T12:55:54Z)
• Robotic Eye-in-hand Visual Servo Axially Aligning Nasopharyngeal Swabs with the Nasal Cavity [7.209758868768353]
  The nasopharyngeal (NP) swab test is a method for collecting cultures to diagnose respiratory illnesses, including COVID-19. A critical component of the NP swab test is having the swab aligned properly with the nasal cavity so that it does not cause excessive discomfort or injury by traveling down the wrong passage. Our work creates a vision-guided pipeline to allow an instrumented robot arm to properly position and orient NP swabs with respect to the nostrils of free-standing patients.
  arXiv  Detail & Related papers  (2024-08-22T14:36:06Z)
• Class-Aware Cartilage Segmentation for Autonomous US-CT Registration in Robotic Intercostal Ultrasound Imaging [39.597735935731386]
  A class-aware cartilage bone segmentation network with geometry-constraint post-processing is presented to capture patient-specific rib skeletons. A dense skeleton graph-based non-rigid registration is presented to map the intercostal scanning path from a generic template to individual patients. Results demonstrate that the proposed graph-based registration method can robustly and precisely map the path from CT template to individual patients.
  arXiv  Detail & Related papers  (2024-06-06T14:15:15Z)
• CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
  We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images. The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism. We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
  arXiv  Detail & Related papers  (2024-03-21T15:13:36Z)
• Robot-Assisted Deep Venous Thrombosis Ultrasound Examination using Virtual Fixture [45.97156332608481]
  Deep Venous Thrombosis (DVT) is a common vascular disease with blood clots inside deep veins, which may block blood flow or even cause a life-threatening pulmonary embolism. A typical exam for DVT using ultrasound (US) imaging is by pressing the target vein until its lumens is fully compressed. We present a robotic US system with a novel hybrid force motion control scheme ensuring position and force tracking accuracy, and soft landing of the probe onto the target surface.
  arXiv  Detail & Related papers  (2024-01-04T21:02:39Z)
• RUSOpt: Robotic UltraSound Probe Normalization with Bayesian Optimization for In-plane and Out-plane Scanning [4.420121239028863]
  Proper orientation of the robotized probe plays a crucial role in governing the quality of ultrasound images. We propose a sample-efficient method to automatically adjust the orientation of the ultrasound probe normal to the point of contact on the scanning surface.
  arXiv  Detail & Related papers  (2023-10-05T09:22:16Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• Follow the Curve: Robotic-Ultrasound Navigation with Learning Based Localization of Spinous Processes for Scoliosis Assessment [1.7594269512136405]
  This paper introduces a robotic-ultrasound approach for spinal curvature tracking and automatic navigation. A fully connected network with deconvolutional heads is developed to locate the spinous process efficiently with real-time ultrasound images. We developed a new force-driven controller that automatically adjusts the probe's pose relative to the skin surface to ensure a good acoustic coupling between the probe and skin.
  arXiv  Detail & Related papers  (2021-09-11T06:25:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.