Visuotactile and Explicitly Force-Controlled Robotic Ultrasound for Abdominal Volumetric Reconstruction

• URL: http://arxiv.org/abs/2606.05848v1
• Date: Thu, 04 Jun 2026 08:23:34 GMT
• Title: Visuotactile and Explicitly Force-Controlled Robotic Ultrasound for Abdominal Volumetric Reconstruction
• Abstract summary: We present a robotic ultrasound acquisition system that integrates stereo vision, touch-based feedback, and expert-informed strategies.<n>The system achieves high-quality imaging comparable to expert scans while dynamically adapting to patient-specific topographies.
• Score: 0.5862480696321741
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we present a robotic ultrasound acquisition system that integrates stereo vision, touch-based feedback, and expert-informed strategies to perform autonomous and adaptive abdominal scans. The system records freehand motion and force data from expert radiologists, creating a framework to capture transducer motion, applied forces, and anatomical scanning strategies. This expert data is replayed to replicate characteristic scans with the robot, forming a foundation for further autonomous capabilities. Using stereo vision, the system generates three-dimensional topography maps of the patient's abdomen, which are refined through stiffness measurements at key points to delineate the rib cage boundary. These combined techniques enable the robot to execute two distinct scanning paths: an upward-angled sweep beneath the rib cage to visualize structures near the upper abdomen and a perpendicular sweep across soft tissue regions. A compliant, torque-controlled seven degree-of-freedom robotic manipulator is controlled to maintain consistent probe contact through closed-loop force control over the varied anatomical surfaces. Physical experiments demonstrate that the system achieves high-quality imaging comparable to expert scans while dynamically adapting to patient-specific topographies. Furthermore, the robotic system surpasses expert capabilities by enabling three-dimensional volume acquisition, which enhances diagnostic potential and provides volumetric data for advanced analyses. This work highlights the integration of expert knowledge into autonomous robotic systems and underscores the potential of combining perception-based autonomy with physical reasoning for enhanced diagnostic performance.

Related papers

• SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasound [60.64817443833982]
  We present SAMe, a semantic anatomy mapping engine that provides robotic ultrasound with an explicit anatomical prior layer.<n> SAMe addresses scan initiation as a target-to-anatomy-to-action process.<n>It instantiates a patient-specific anatomical representation for the grounded targets from a single external body image.
  arXiv  Detail & Related papers  (2026-04-28T13:44:09Z)
• Real-time Monocular 2D and 3D Perception of Endoluminal Scenes for Controlling Flexible Robotic Endoscopic Instruments [28.77639956401214]
  This paper presents a visual perception platform for a continuum robotic system in endoluminal surgery.<n>We introduce 2D and 3D learning-based perception algorithms to identify position and orientation of flexible instruments.<n>A physically-realistic simulator generates realistic endoluminal scenes, enabling control of flexible robots.
  arXiv  Detail & Related papers  (2026-02-16T11:46:14Z)
• From Slices to Structures: Unsupervised 3D Reconstruction of Female Pelvic Anatomy from Freehand Transvaginal Ultrasound [8.740779457368255]
  We present a novel framework for reconstructing 3D anatomical structures from 2D transvaginal ultrasound (TVS) sweeps.<n>Our method adapts the principles of Gaussian Splatting to the domain of ultrasound, introducing a slice-aware, differentiable spatializer.<n>The result is a compact, flexible, and memory-efficient representation that captures anatomical detail with high fidelity.
  arXiv  Detail & Related papers  (2025-08-20T09:09:06Z)
• Shape Completion and Real-Time Visualization in Robotic Ultrasound Spine Acquisitions [35.52384354036415]
  We introduce a novel integrated system that combines robotic ultrasound with real-time completion to enhance spinal visualization.<n>Our robotic platform autonomously acquires US sweeps of the lumbar spine, extracts vertebral surfaces from ultrasound, and reconstructs the complete anatomy.<n>This framework provides interactive, real-time visualization with the capability to autonomously repeat scans and can enable navigation to target locations.
  arXiv  Detail & Related papers  (2025-08-12T13:19:37Z)
• UltraSeP: Sequence-aware Pre-training for Echocardiography Probe Movement Guidance [70.94473797093293]
  We introduce a novel probe movement guidance algorithm that has the potential to be applied in guiding robotic systems or novices with probe pose adjustment for high-quality standard plane image acquisition.<n>Our approach learns personalized three-dimensional cardiac structural features by predicting the masked-out image features and probe movement actions in a scanning sequence.
  arXiv  Detail & Related papers  (2024-08-27T12:55:54Z)
• Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics [24.014073238400137]
  This paper introduces a novel Ultrasound Embodied Intelligence system that combines ultrasound robots with large language models (LLMs) and domain-specific knowledge augmentation. Our approach employs a dual strategy: firstly, integrating LLMs with ultrasound robots to interpret doctors' verbal instructions into precise motion planning. Our findings suggest that the proposed system improves the efficiency and quality of ultrasound scans and paves the way for further advancements in autonomous medical scanning technologies.
  arXiv  Detail & Related papers  (2024-06-18T14:22:16Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing [88.99939660183881]
  We propose a framework for autonomous robotic navigation for subretinal injection. Our method consists of an instrument pose estimation method, an online registration between the robotic and the i OCT system, and trajectory planning tailored for navigation to an injection target. Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method.
  arXiv  Detail & Related papers  (2023-01-17T21:41:21Z)
• Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion [48.52403516006036]
  This paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs.
  arXiv  Detail & Related papers  (2022-08-10T15:39:20Z)
• Deep Learning for Ultrasound Beamforming [120.12255978513912]
  Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain. Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing. Deep learning methods can play a compelling role in the digital beamforming pipeline.
  arXiv  Detail & Related papers  (2021-09-23T15:15:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.